Changes between Version 3 and Version 4 of 2ndInstMeasWork


Ignore:
Timestamp:
06/28/10 16:59:36 (9 years ago)
Author:
hmussman@bbn.com
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • 2ndInstMeasWork

    v3 v4  
    11[[PageOutline]]
    22
    3 = 2nd GENI Instrumentation and Measurement Workshop:  Agenda and Notes =
     3=  2nd GENI Instrumentation and Measurement Workshop  =
     4
    45Tuesday, June 8, 1pm - Wednesday, June 9, 2pm  [[BR]]
    56Chicago O'Hare Hilton [[BR]]
    67NOTE:  By invitation only
    78
    8 [http://groups.geni.net/geni/attachment/wiki/2ndInstMeasWork/051810%20%20InstMeasWorkshopAgenda.pdf  Announcement, v1.1]
    9 
     9
     10==  Announcement with goals, topics and reference material  ==
     11
     12The following announcement (with figures and references) was sent to the attendees to prepare for the workshop:  [[BR]]
     13
     14[  Announcement, v1.1 (060410)]
     15[  Figures, v1.1 (060410)]
     16
     17
     18==  Announcement with notes  ==
     19
     20The following announcement now includes all notes from the workshop:
     21
     22[  Announcement, v1.2 (062510)]
     23[  Figures, v1.2 (062510)]
     24
     25==  Attendees at workshop  ==
     26
     27(attended workshop:  yes or no)
     28        Paul Barford - University of Wisconsin – Madison  (no)
     29        Bruce Maggs – Duke University and Akamai  (yes)
     30        Harry Mussman – BBN/GPO  (yes)
     31        Vic Thomas - BBN/GPO  (yes)
     32        Evan Zhang – BBN/GPO  (yes)
     33OML (ORBIT Measurement Library) OMF (ORBIT Management Framework)
     34        Max Ott – NICTA  (yes, by phone)
     35        Ivan Seskar – Rutgers WINLAB  (yes)
     36Instrumentation Tools 
     37        Jim Griffioen - Univ Kentucky  (yes)
     38perfSONAR 
     39        Matt Zekauskas - Internet2 (no)
     40        Jason Zurawski – Internet2  (yes)
     41        Martin Swany - Univ Delaware (yes)
     42        Guilherme Fernandes – Univ Delaware  (yes)
     43        Ezra Kissel – Univ Delaware  (yes)
     44Scalable Sensing Service (S3)
     45        Sonia Fahmy – Purdue  (yes)
     46        Puneet Sharma - HP Labs  (yes)
     47OnTimeMeasure for network measurements
     48        Prasad Calyam - Ohio Supercomputing Ctr  (yes)
     49GENI Meta-Operations Center and NetKArma
     50        Jon-Paul Herron - Indiana Univ
     51        Camilo Viecco - Indiana Univ   (yes)   
     52        Chris Small - Indiana Univ  (yes)
     53        Beth Plale - Indiana Univ  (yes)
     54Virtual Machine Introspection (VMI)
     55        Brian Hay – Univ Alaska  (yes)
     56Data-Intensive Cloud Control for GENI
     57        Michael Zink  - UMass Amherst  (yes)
     58Experiment Management Service – Digital Object Registry
     59        Jim French - CNRI    (yes)
     60        Giridhar Manepalli - CNRI   (yes)
     61        Larry Lannom – CNRI  (no)
     62
     63==  Priority topics  ==
     64
     65The following priority topics were identified at the workshop, and teams of attendees were identified for each topic to discuss it, and write a text summary for review by the WG at GEC8.
     66
     67
     68=== 6.1  GENI I&M use cases ===
     69
     70Team members:
     71        Paul Barford - University of Wisconsin – Madison  (no)
     72        Jim Griffioen - Univ Kentucky  (yes)
     73        *  Prasad Calyam - Ohio Supercomputing Ctr  (yes)
     74        Camilo Viecco - Indiana Univ   (yes)
     75        Brian Hay – Univ Alaska  (yes)
     76        * agreed to organize first discussion and writing
     77
     78Identify all user groups, and provide basic use cases:
     79        1)  GMOC operations group (NOC)
     80        2)  Cluster and aggregate operations groups (NOCs)
     81        3)  Archive service providers
     82        4)  Experiment researchers
     83        5)  Experiment (opt-in) users  (see http://groups.geni.net/geni/attachment/wiki/041409NYCOptInWGAgenda/071509%20%20GENI-SE-OI-Overview-01.4.pdf for  listing of opt-in issues, such as privacy)
     84        6)  Researchers that use measurement data archived by other researchers (DatCat model)
     85
     86=== 6.2  GENI I&M services ===
     87
     88Team members:
     89        *  Harry Mussman – BBN/GPO  (yes)
     90        Evan Zhang – BBN/GPO
     91        Giridhar Manepalli - CNRI   (yes)
     92        Chris Small - Indiana Univ  (yes)       
     93        Beth Plale - Indiana Univ  (yes)
     94        * agreed to organize first discussion and writing
     95
     96Summarize current view
     97
     98Identify different types of services:
     99        Completely dedicated to an experiment
     100        Common portion, plus parts associated with different experiments
     101        Common service, with data provided to multiple experiments
     102
     103Need:  Basic definition of an archive service
     104
     105
     106=== 6.3  GENI I&M resources ===
     107
     108Team members:
     109        Vic Thomas - BBN/GPO  (yes)
     110        *  Jim Griffioen - Univ Kentucky  (yes)
     111        Martin Swany - Univ Delaware (yes)
     112        Camilo Viecco - Indiana Univ   (yes)   
     113        Brian Hay – Univ Alaska  (yes)
     114        Giridhar Manepalli - CNRI   (yes)
     115        * agreed to organize first discussion and writing
     116
     117Significant question uncovered at workshop!
     118Jim on 6/25 via email:  We should involve Rob Ricci in the discussion.
     119
     120What are resources:
     121        1)  Hosts, VMs, etc.
     122        2)  Network connectivity
     123        3)  Software, e.g., I&M software that can be included in an experiment
     124        3)  I&M services
     125        4)  I&M data flows and file transfers
     126        5)  I&M data files stored in archives
     127
     128How are each of these discovered, specified, authorized and assigned:
     129        a)  Always by mechanisms provided by the CF?
     130        b)  With CF plus additional mechanisms? 
     131        Consider example of LS in perfSONAR 
     132        Consider example of data file stored in archive, owned by an experimenter
     133
     134Goals:
     135        Need to define and then compare these options
     136        Need to understand interop with CF for each option
     137        Does CF setup secondary authorization mechanisms in some cases?  If so, how?
     138
     139Does each item have:
     140        Unique and persistent name?
     141        Unique and persistent identifier?
     142        Need to carefully consider this for all of GENI
     143
     144For each item, consider how to:
     145        Create
     146        Name
     147        Register and discover
     148        Authorize and assign
     149
     150For each item, consider:
     151        Ownership
     152        What sort of policies the owner may want to apply
     153
     154
     155
     156
     157
     158
     159       
     160=== 6.4  GENI I&M measurement plane and  interfaces ===
     161
     162Team members:
     163        *  Harry Mussman – BBN/GPO  (yes)
     164        Ezra Kissel – Univ Delaware  (yes)
     165        Chris Small - Indiana Univ  (yes)
     166        * agreed to organize first discussion and writing
     167
     168Consider:
     169        IP network
     170        Layer 2 (VLAN) connections
     171
     172Discuss
     173        Which protocols are active
     174        Access to resources in aggregates, even when resources are in private address space, via GWs or proxies
     175        How to provide authentication and authorization
     176        How to provide QoS to protect measurement traffic
     177        How to provide QoS to protect other traffic when measurement traffic is large. 
     178        Reserve bandwidth?
     179
     180Martin on 6/28:  Consider XSP (extensible session protocol) to provide transport layer GW functions.
     1816.5  GENI I&M  interfaces and protocols (APIs):  manage services
     182
     183        Vic Thomas - BBN/GPO  (yes)
     184        Ivan Seskar – Rutgers WINLAB  (yes)
     185        Max Ott – NICTA  (yes, by phone)
     186        *  Sonia Fahmy – Purdue  (yes)
     187        Giridhar Manepalli - CNRI   (yes)
     188        * agreed to organize first discussion and writing
     189
     190Define an approach based on OMF/OML and S3:
     191        HTTP(S)
     192        REST vs SOAP
     193        Authorization by credentials or ?  If credentials, how to revoke?
     194        Pass XML fragments
     195        Define basic API
     196
     197=== 6.6  GENI I&M  interfaces and protocols (APIs):  data flows and data file transfers ===
     198
     199        *  Harry Mussman – BBN/GPO  (yes)
     200        Ivan Seskar – Rutgers WINLAB  (yes)
     201        Max Ott – NICTA  (yes, by phone)
     202        Ezra Kissel – Univ Delaware  (yes)
     203        Prasad Calyam - Ohio Supercomputing Ctr  (yes)
     204        Michael Zink  - UMass Amherst  (yes)
     205        * agreed to organize first discussion and writing
     206
     207Consider data flows and data file transfers between all services
     208
     209Define range of options:
     210
     211What:
     212        Data flows
     213        Data files transfers
     214       
     215Type:
     216        Pull
     217        Push
     218        Pub/Sub
     219
     220Protocol:
     221        SNMP
     222        SCP
     223        FTP and gridFTP
     224        HTTP
     225        XMPP
     226        TCP
     227        SCTP
     228
     229Consider:
     230        Naming
     231        Discovery
     232        Connectivity
     233        Authentication and authorization mechanisms
     234
     235Map to current projects, giving examples:
     236Consider:  Minimum set required for GENI
     237
     238
     239
     240
     241=== 6.7  GENI I&M  interfaces and protocols (APIs):  service registration and discovery ===
     242
     243Team members:
     244        *  Jason Zurawski – Internet2  (yes)
     245        Prasad Calyam - Ohio Supercomputing Ctr  (yes)
     246        * agreed to organize first discussion and writing
     247
     248Consider approach used in perfSONAR
     249
     250Summarize for:
     251        Services with data flows
     252        Also sources of file transfers?
     253        Also GUIs?
     254
     255
     256=== 6.8  GENI I&M  interfaces and protocols (APIs):  GUIs ===
     257
     258Team members:
     259        Jeremy Reed - Univ Kentucky  (yes)
     260        *  Guilherme Fernandes – Univ Delaware  (yes)
     261        Puneet Sharma - HP Labs  (yes)
     262        * Agreed to organize team
     263Define overall goals for GENI GUIs
     264
     265Types of GUIs:
     266        Control experiments
     267        Display I&M results
     268        Report status
     269        View archive service
     270
     271Consider portal, for access to multiple GUIs
     272
     273Consider need for authentication and authroization
     274
     275=== 6.9  GENI measurement data schema ===
     276
     277Team members:
     278        Bruce Maggs – Duke University and Akamai  (yes)
     279        Max Ott – NICTA  (yes, by phone)
     280        Ivan Seskar – Rutgers WINLAB  (yes)
     281        *  Martin Swany - Univ Delaware (yes)
     282        Camilo Viecco - Indiana Univ   (yes)   
     283        Michael Zink  - UMass Amherst  (yes)
     284        Jim French - CNRI    (yes)
     285        * agreed to organize first discussion and writing
     286
     287
     288Consider:
     289        Measurement data schema
     290        Metadata schema
     291        Metadata contents
     292
     293
     294Consider measurement data schema and/or metadata schema from:
     295        perfSONAR
     296        GMOC-provided
     297        Current OML
     298        Proposed using IPFIX
     299        NetCDF (as used by DI Cloud)
     300
     301Consider:  Minimum set required for GENI
     302
     303Provide overall template for GENI metadata, considering above.
     304Which items in GENI metadata template are:
     305        Required?
     306        Invariant?
     307 
     308
     309==  Figures  ==
     310
     311All figures
     312
     313
     314
     315==  References  ==
     316
     317
     318Ref  GIMS_Design_UseCases:  “Use-cases for GENI Instrumentation and Measurement Architecture Design”
     319
     320Ref  MeasPlane-1:  “RESTful Web Services vs. “Big” Web Services:  Making the Right Architectural Decision”
     321
     322Ref  OMF_OML-1:  “XDR: External Data Representation Standard”
     323
     324Ref  OMF_OML-2:  “ORBIT Measurements Framework and Library (OML): Motivations, Design, Implementation, and Features”
     325
     326Ref  OMF-OML-3:  “OML Overview” slides
     327
     328Ref  OMF-OML-4:  “Measurement Architectures for Network Experiments with Disconnected Mobile Nodes”
     329
     330Ref  InsTools-1:  “Architectural Design and Specification of the INSTOOLS Measurement System”
     331
     332Ref  perfSONAR-1:   “Scalable Framework for Representation and Exchange of Network Measurements”
     333
     334Ref  perfSONAR-2:  “An Extensible Schema for Network Measurement and Performance Data”
     335
     336Ref  perfSONAR-3:   “NM-WG/perfSONAR Topology Schema”
     337
     338Ref  GMOC-1:  “GMOC Topology-Entity Data Exchange Format Specification”
     339
     340Ref  GMOC-2:   “Proposal: Use of URN's as GENI Identifiers”