[[PageOutline]] = Instrumentation and Measurement (I&M) Working Session for GEC12 = Wednesday, November 2, 2011, 8:30am - 12noon [[BR]] Room: [[BR]] Session Leader: Harry Mussman, (GPO, Raytheon BBN Technologies) [[BR]] == Description == This session will review the GENI I&M design and prototyping projects planned for Spiral 4 (this year), including the two large Solicitation 3 I&M D&P projects and those projects continuing from Solicitation 2. Then, it will define and discuss the priority topics that must be resolved between now and GEC13. [[BR]] == Summary == == Agenda == This is a tentative agenda, which may change. [[BR]] == 1) Introductions == 8:30am [[BR]] == 2) GENI I&M D&P Projects for Spiral 4 == 8:35am [[BR]] Harry Mussman [[BR]] Goals: Approach: === 2.1) New Sol 3 Projects === GIMI [[BR]] PI: Mike Zink (UMass Amherst) [[BR]] Co-PI/Key: Max Ott (NICTA); Ilia Baldine (RENCI); David Irwin (UMass Amherst); Thanasis Korakis (NYU Poly) [[BR]] Goals: [[BR]] **Starts with OML, and provides easy-to-use tools for GENI environment [[BR]] First focus: I&M use cases for experiments, with default OML Client in nodes that gathers passive measurements like INSTOOLS [[BR]] First supported aggregates: ORCA servers/VMs and ExoGENI (RENCI) racks [[BR]] First utilized experiment control tools: GUSH, with additions [[BR]] First utilized interfaces: GENI AM API for resources; ns3 for topology; ssh; OMF for orchestration [[BR]] Requires XML messaging service, with pub/sub, in public IP space [[BR]] Introduces portal service, with: OML Server, for collection; Results Service, for presentation; measurement orchestration service using OMF; documentation service to create and edit MDOD. Can portal be shared with GEMINI project? [[BR]] Introduces iRODS service for user workspace and archive. Can GEMINI use iRODS? Can iRODS serve as registry for MDOD? [[BR]] Begin effort: support for WiMAX sites [[BR]] Consider: adding OML server with perfSONAR interface, for sharing data with GEMINI tools [[BR]] Later: add sensor measurement data, carried in data network [[BR]] GEMINI [[BR]] PI: Martin Swany (Indiana U) [[BR]] Co-PI/Key: Chris Small (Indiana U); Eric Boyd (Internet2); Jim Griffioen (U Kentucky); Zongming Fei (U Kentucky) [[BR]]; Hussamuddin Nasir (U Kentucky) Goals: [[BR]] **Starts with INSTOOLS, and continues to provide easy-to-use tools in GENI environment [[BR]] Consider: how to gather customized data from application [[BR]] First focus: I&M use cases for experiments [[BR]] First supported aggregates: protoGENI servers/VMs; can these be used for HP racks? [[BR]] First utilized experiment control tools: FLACK, with additions [[BR]] First utilized interfaces: protoGENI API for resources; ns3 for topology; ssh; [[BR]] Continues portal to presentation service; need to add documentation service to create and edit MDOD. Can portal be shared with GIMI project? [[BR]] Continues use of Kentucky and CNRI services for user workspace and archive. Consider move to iRODS? [[BR]] **Starts with LAMP/perfSONAR, and continues to provide for infrastructure measurement, and for sharing of data [[BR]] Continue to setup within resources assigned by slice mechanism [[BR]] Consider: monitoring of clusters/racks [[BR]] Consider: measurements of Layer 2 and OpenFlow paths [[BR]] First focus on I&M use cases for infrastructure measurement [[BR]] First supported aggregates: protoGENI servers/VMs; can these be used for HP racks? [[BR]] First utilized experiment control tools: FLACK, with additions [[BR]] First utilized interfaces: protoGENI API for resources; ns3 for topology; ssh; [[BR]] Continues home and global Lookup Services [[BR]] Create and map MDOD into metadata that is registered [[BR]] Continue to use perfSONAR clients to present data; can these be integrated into portal? [[BR]] **Consider how INSTOOLS and LAMP/perfSONAR tools might be shared or merged [[BR]] === 2.2) Continuing Sol 2 Projects === LAMP/perfSONAR [[BR]] PI: Martin Swany (Indiana U) [[BR]] Co-PI/Key: Eric Boyd (Internet2); Jason Zurawski (Internet 2); Guilherme Fernandes (U Delaware); Ezra Kissel (U Delaware); Mathew Jaffee (U Delaware) [[BR]] Goals: [[BR]] **Demonstrate and/or help others to demonstrate “infrastructure measurement slices” in both protoGENI and ORCA environments, with the data available at the perfSONAR MP is registered with the operational Lookup Service. [[BR]] Provide operational home and global Lookup Services [[BR]] Creates and maps MDOD into metadata that is registered in Lookup Service [[BR]] Expand authorization at interface where data is shared; introduce use of GENI credentials [[BR]] OnTimeMeasure [[BR]] PI: Prasad Calyam (Ohio Super Center) [[BR]] Co-PI: Paul Schopis (OARnet) [[BR]] Goals: **Work with the LAMP project to understand the LAMP/perfSONAR tools, and demonstrate using them to implement “infrastructure measurement slices” in today’s GENI backbone and access networks. [[BR]] Assuming LAMP/perfSONAR tools, develop a plan to evaluate the performance of today’s GENI IP backbone and access networks, using persistent or temporary “infrastructure measurement slices”, and utilizing existing perSONAR nodes in I2 and/or other networks. [[BR]] Define a procedure for evaluating the performance of GENI’s backbone and access networks when carrying L2 VLANs; start with the existing IP measurement tools including in the LAMP/perfSONAR tools, but consider tools that are specialized for evaluating the performance of L2 networks. [[BR]] Define a procedure for evaluating the performance of GENI’s backbone and access networks when using OpenFlow (e.g., “Tango GENI”); consider how to monitor the performance of OF networks, and introducing new specialized tools. [[BR]] NetKarma [[BR]] PI: Beth Plale (Indiana U) [[BR]] Co-PI/Key: Chris Small (Indiana U); Scott Jensen (Indiana U); Mehmet Aktas (Indiana U) [[BR]] Goals: **Participate in defining the schema for the “measurement data object descriptor”, and uses of “descriptors” in tracking provenance. [[BR]] Work with the GENI community to define extensions to the “descriptor” that would locate and describe objects beyond “measurement data objects” associated with an experiment, such as scripts, images, etc. [[BR]] Modify your tools to create, gather and forward “descriptors”, that could locate and describe all objects associated with an experiment; demonstrate how “descriptors” can be automatically created. [[BR]] Work with the GENI I&M community to define a modified “descriptor” that would provide a standardized GENI “resource event record”; these records could describe events such as assignments, faults or errors. [[BR]] Add modules to your tools to create, gather and forward “resource event records”, that when logged could fully describe the sequence of an experiment. [[BR]] Work towards fitting your provenance tools into the “experimenter’s portal”. [[BR]] IMF [[BR]] PI: Rudra Dutta (NCSU) [[BR]] Co-PI/Key: George Rouskas (NCSU); Ilia Baldine (RENCI); Keren Bergman (Columbia U) [[BR]] Goals: [[BR]] **Prototype and operate a GENI XML messaging service, with pub/sub, based on an XMPP server and XCP-0060. [[BR]] Prototype and demonstrate a GENI I&M “measurement orchestration service”, based on the ORBIT Management Framework (OMF) software modules provided by NICTA, including the Experiment Controller (EC) and the Resource Controller (RC). [[BR]] Prototype and demonstrate using your pub/sub capability to transport and distribute standardized GENI “resource event records”, as defined by the NetKarma project. [[BR]] DOR [[BR]] PI: Larry Lannom (CNRI) [[BR]] Co-PI/Key: Giridhar Manepalli (CNRI); Jim French (CNRI); Christophe Blanchi (CNRI) [[BR]] Goals: [[BR]] Continue to deploy a prototype Measurement Data Archive (MDA) service. [[BR]] **Participate in the GENI I&M effort, particularly in the MDA specification effort that includes defining metadata model for archived entities, defining access-control layer, and integrating control framework authorization scheme with the MDA. [[BR]] Enforce metadata schema on archived objects, and enable access control rights as defined by the MDA specification. [[BR]] Evangelize and demonstrate how the MDA/DOR service can be used to archive published data. [[BR]] === 2.3 GIMI Project Overview === 8:45am [[BR]] PI: Mike Zink (UMass Amherst) [[BR]] Co-PI/Key: Max Ott (NICTA); Ilia Baldine (RENCI); David Irwin (UMass Amherst); Thanasis Korakis (NYU Poly) [[BR]] Goals [[BR]] Configuration [[BR]] Issues to be resolved [[BR]] [ slides] [[BR]] Figure 1 GIMI Tools Configuration [[BR]] [[Image(Visio-102411b_GIMIonly_UseCases_Projects_Figures_Page_1.jpg, 90%)]] [[BR]] Figure 2 WiMAX Site Tools Configuration [[BR]] [[Image(Visio-102411b_GIMIonly_UseCases_Projects_Figures_Page_2.jpg, 90%)]] [[BR]] Figure 3 OMF/OML Services and Messages [[BR]] [[Image(Visio-102411b_GIMIonly_UseCases_Projects_Figures_Page_3.jpg, 90%)]] [[BR]] === 2.4 GEMINI Project Overview === 9:05am [[BR]] PI: Martin Swany (Indiana U) [[BR]] Co-PI/Key: Chris Small (Indiana U); Eric Boyd (Internet2); Jim Griffioen (U Kentucky); Zongming Fei (U Kentucky) [[BR]]; Hussamuddin Nasir (U Kentucky) Goals [[BR]] Configuration [[BR]] Issues to be resolved [[BR]] [ slides] [[BR]] Figure 1 GEMINI Tools Configuration [[BR]] [[Image(, 90%)]] [[BR]] Figure 2 INSTOOLS Services and Messages [[BR]] [[Image(Visio-102411b_GEMINIonly_UseCases_Projects_Figures_Page_2.jpg, 90%)]] [[BR]] Figure 3 perfSONAR Services and Messages [[BR]] [[Image(Visio-102411b_GEMINIonly_UseCases_Projects_Figures_Page_3.jpg, 90%)]] [[BR]] === 2.4 LAMP/perfSONAR Project Overview === 9:25am [[BR]] PI: Martin Swany (Indiana U) [[BR]] Co-PI/Key: Eric Boyd (Internet2); Jason Zurawski (Internet 2); Guilherme Fernandes (U Delaware); Ezra Kissel (U Delaware); Mathew Jaffee (U Delaware) [[BR]] Goals [[BR]] Configuration [[BR]] Issues to be resolved [[BR]] [ slides] [[BR]] === 2.6 OnTimeMeasure Project Overview === 9:30am [[BR]] PI: Prasad Calyam (Ohio Super Center) [[BR]] Co-PI: Paul Schopis (OARnet) [[BR]] Goals [[BR]] Configuration [[BR]] Issues to be resolved [[BR]] [ slides] [[BR]] === 2.7 NetKarma Project Overview === 9:35am [[BR]] PI: Beth Plale (Indiana U) [[BR]] Co-PI/Key: Chris Small (Indiana U); Scott Jensen (Indiana U); Mehmet Aktas (Indiana U) [[BR]] Goals [[BR]] Configuration [[BR]] Issues to be resolved [[BR]] [ slides] [[BR]] === 2.8 IMF Project Overview === 9:40am [[BR]] PI: Rudra Dutta (NCSU) [[BR]] Co-PI/Key: George Rouskas (NCSU); Ilia Baldine (RENCI); Keren Bergman (Columbia U) [[BR]] Goals [[BR]] Configuration [[BR]] Issues to be resolved [[BR]] [ slides] [[BR]] === 2.9 DOR Project Overview === 9:45am [[BR]] PI: Larry Lannom (CNRI) [[BR]] Co-PI/Key: Giridhar Manepalli (CNRI); Jim French (CNRI); Christophe Blanchi (CNRI) [[BR]] Goals [[BR]] Configuration [[BR]] Issues to be resolved [[BR]] [ slides] [[BR]] === 2.10 Discussion === 9:50am == 3) Break == 10:00am [[BR]] == 4) GENI I&M Priority Topics == 10:35am [[BR]] Goals: [[BR]] Resolve between now (GEC12) and GEC13. [[BR]] Simplify where possible! [[BR]] Approach: [[BR]] Form teams for each topic. [[BR]] === 4.1) Overview === 10:35am [[BR]] I&M Use Cases for Experiments [[BR]] I&M Use Cases for Infrastructure Measurement [[BR]] Platform Targets [[BR]] Experiment and Measurement Orchestration Tools [[BR]] Interfaces/Protocols Between Tools and Services [[BR]] Descriptor Schema and Registry Service [[BR]] Object Names and Registry Service [[BR]] XML Messaging Service [[BR]] Lookup Service [[BR]] Portal Service [[BR]] User Workspace and Archive Services [[BR]] Operational Services [[BR]] Services Shared by GIMI and GEMINI [[BR]] Support for Experimenters [[BR]] Support for Operators [[BR]] === 4.2) I&M for Experiments === 10:40am [[BR]] I&M Use Cases for Experiments [[BR]] Support for Experimenters [[BR]] a) How do we work towards Max Ott's vision for experiment support? [ slides] [[BR]] b) Nominal experiment use case: [[BR]] 1) Setup and run experiment using Experiment Control Tools, Experiment Orchestration Service and Lab Portal. [[BR]] 2) Setup and run measurements using services within slice, and persistent services. Option: get measurement data from persistent MP. [[BR]] 3) Gather MD, and observe during experiment; formulate MDOD. [[BR]] 4) Archive MD with MDOD. [[BR]] 5) Share archived MD with others, per policy included within MDOD. [[BR]] 6) Pull MD out of archive, to analyze and/or visualize. [[BR]] c) What support must be provided for Experimenters? how? [[BR]] d) Who: Max Ott (NICTA); Jim Griffioen (U Kentucky); Prasad Calyam (Ohio Super Center); Beth Plale (Indiana U) [[BR]] === 4.3) I&M Use Cases for Infrastructure Measurement === 10:50am [[BR]] I&M Use Cases for Infrastructure Measurement [[BR]] Support for Operators [[BR]] a) Delineate what infrastructure monitoring is and is not covered by this approach. [[BR]] 1) Yes: monitoring of clusters/racks [[BR]] 2) Yes: passive measurements of transport switches, etc. [[BR]] 3) Yes: active measurements of IP networks, of Layer 2 and OpenFlow paths [[BR]] b) Nominal infrastructure measurement process: [[BR]] 1) Setup persistent or on-demand infrastructure measurement slice. [[BR]] 2) Make passive measurements or make active measurements. [[BR]] 3) Gather MD, and observe as it is gathered; formulate MDOD. [[BR]] 4) Store MD in collector, describe with MDOD, and register MDOD so that MD can be shared. [[BR]] 5) Typically share MD with Aggregate Operator, GMOC and/or Experimenters, per policy written into MDOD. [[BR]] 6) Pull MD out of collector, analyze and visualize. [[BR]] 7) Archive MD with MDOD. [[BR]] 8) Share archived MD with others, per policy included within MDOD. [[BR]] 9) Pull MD out of archive, to analyze and/or visualize. [[BR]] c) What support must be provided for Operator? how? [[BR]] d) Who: Martin Swany (Indiana U); Eric Boyd (Internet2); Jason Zurawski (Internet2); Chris Small (Indiana U) [[BR]] === 4.4) GENI Environment === 11:00am [[BR]] Platform Targets [[BR]] Experiment and Measurement Orchestration Tools [[BR]] Interfaces/Protocols Between Tools and Services [[BR]] a) Platform targets: [[BR]] 1) protoGENI servers/VMs [[BR]] 2) ORCA servers/VMs [[BR]] 3) WiMAX sites [[BR]] 4) ExoGENI (RENCI) racks; like ORCA [[BR]] 5) TransCloud (HP) racks; like protoGENI? [[BR]] 6) PlanetLab? b) Experiment and Measurement Orchestration tools: [[BR]] 1) FLACK [[BR]] 2) GUSH (with Omni) [[BR]] 3) SFACE + RAVEN? [[BR]] c) Interfaces/protocols between tools and services: [[BR]] 1) protoGENI API, with protoGENI RSpec v2, for resource assignment [[BR]] 2) GENI AM API, with protoGENI RSpec v2, for resource assignment [[BR]] 3) ns for topology [[BR]] 4) ssh [[BR]] 5) OMF messages for orchestration [[BR]] d) Who: Jim Griffioen (U Kentucky); Ilia Baldine (RENCI); David Tirwin (UMass Amherst); Mike Zink (UMass Amherst); Christoph Dwertmann (NICTA); Tom Mitchell (GPO); Aaron Helsinger (GPO) [[BR]] === 4.5) Descriptors, Objects and Registries === 11:10am [[BR]] Descriptor Schema and Registry Service [[BR]] Object Names and Registry Service [[BR]] a) MDOD schema, for XML file. [http://groups.geni.net/geni/wiki/GEC11InstMeasWorkingSession#a2MeasurementDataObjectDescriptorMDOD References] [[BR]] b) MDOD registry. Use DOR registry? Include in iRODS? [[BR]] c) Object (e.g., I&M service) names. [[BR]] d) Object registry, with names and public key. [[BR]] e) Who: Jason Zurawski (Internet2); Ezra Kissel (U Delaware); Scott Jensen (Indiana U); Larry Lannom (CNRI); Giridhar Manepalli (CNRI) [[BR]] === 4.6) Messaging Service === 11:20am [[BR]] XML Messaging Service [[BR]] a) XMPP server, in public IP space. [[BR]] b) Entities connect, and are authenticated. [[BR]] c) An entity may start a pub/sub node. [[BR]] d) When an entity subscribes, a message is sent to publisher requesting authorization. [[BR]] e) Use for OMF messages. [[BR]] f) Use for "event record messages". [[BR]] g) Who: Rudra Dutta (NCSU); Ilia Baldine (RENCI); Max Ott, or rep (NICTA) [[BR]] === 4.7) Lookup Service === 11:25am [[BR]] Lookup Service [[BR]] a) Home and global Lookup Service, as defined by perfSONAR [[BR]] b) Map MDOD into metadata that is registered [[BR]] c) Can Lookup Service be used for finding portals? [[BR]] d) Also Topology Service? following UNIS? [[BR]] d) Who: Jason Zurawski (Internet2); Jim Griffioen, or rep (U Kentucky); Max Ott, or rep (NICTA) Aaron Helsinger (GPO) [[BR]] === 4.8) Portal Service === 11:30am [[BR]] Portal Service [[BR]] a) Towards Max Ott's vision for experiment support [[BR]] b) Consider INSTOOLS portal service [[BR]] c) Define portal service for GIMI tools, with multipel functions. [[BR]] d) How are partitions for different users managed? [[BR]] e) Can these portal services be merged? [[BR]] f) Who: Jim Griffioen, or rep (U Kentucky); Max Ott, or rep (NICTA) [[BR]] === 4.9) User Workspace and Archive Services === 11:40am [[BR]] User Workspace and Archive Services [[BR]] a) Consider CNRI prototype user workspace and archive service [[BR]] b) Consider U Kentucky archive service [[BR]] c) Consider iRODS service [[BR]] d) How to move data to service: move file; move SQL DB; or? [[BR]] e) How are partitions for different users managed? [[BR]] f) How is data in MDOD used to set archive sharing policy? what is required in MDOD? [[BR]] g) Who: Giridhar Manepalli (CNRI); Ilia Baldine (RENCI) ; Larry Lannom (CNRI)[[BR]] === 4.10 Operational Services === 11:50am [[BR]] Operational Services [[BR]] Services Shared by GIMI and GEMINI [[BR]] a) What operational services must be supported: [[BR]] 1) Descriptor registry. DOR? iRODS? [[BR]] 2) Object registry. DOR? [[BR]] 3) XML messaging service [[BR]] 4) Home and global Lookup Services; also Topology Service? UNIS? [[BR]] 5) INSTOOLS portal service [[BR]] 6) GIMI portal service [[BR]] 7) U Kentucky archive service [[BR]] 8) CNRI prototype user workspace and archive service [[BR]] 9) iRODS [[BR]] b) What services can be shared by GIMI and GEMINI tools? [[BR]] c) Who: Mike Zink (UMass Amherst); Martin Swany (Inidana U); Jim Griffioen (U Kentucky); Giridhar Manepalli (CNRI) [[BR]] == 5) Adjourn == 12noon [[BR]] == Background Reading == [http://groups.geni.net/geni/wiki/GeniInstMeas I&M integration wiki][[BR]] [http://groups.geni.net/geni/wiki/GENIIandMCAPCAT GENI I&M Capabilities Catalog][[BR]] [http://groups.geni.net/geni/wiki/GeniInstrumentationandMeasurementsArchitecture GENI I&M Architecture document][[BR]]