= GENI Instrumentation and Measurements Architecture = An effort is underway to define and document the GENI Instrumentation and Measurements Architecture. Plan:[[BR]] + Completed by GEC7: v0.1 DRAFT, by GPO [[BR]] + Completed by GEC8: v0.5 DRAFT, by GPO, with revised outline and contributions after 2nd workshop[[BR]] + In preparation: v1.0 DRAFT, including contributions from WG[[BR]] A first DRAFT (v0.1) was completed by the GPO: [http://groups.geni.net/geni/attachment/wiki/GeniInstrumentationandMeasurementsArchitecture/030810%20%20GENI-SE-IM-ARCH-0.1.pdf GENI I&M Architecture (Document ID: GENI-SE-IM-ARCH-0.1, Date: March 8, 2010)] [[BR]] This DRAFT includes proposed I&M services and a proposed configuration [[BR]] Document outline:[[BR]] 1. Document Scope[[BR]] 2. Introduction[[BR]] 3. Definition and configuration of I&M services[[BR]] 4. Interfaces, protocols and schema for Measurement Data (MD)[[BR]] 5. Ownership of MD and privacy of owners[[BR]] 6. Interfaces, protocols and APIs for using I&M services[[BR]] 7. Basic GENI I&M use cases[[BR]] 8. MD transport via the GENI Measurement Plane[[BR]] 9. Discovery, authorization, assignment and binding of GENI I&M services[[BR]] 10. Measurement Orchestration (MO) service[[BR]] 11. Measurement Point (MP)[[BR]] 12. Time-stamping MD[[BR]] 13. Measurement Collection (MC) service[[BR]] 14. Measurement Analysis and Presentation (MAP) service[[BR]] 15. Measurement Data Archive (MDA) service[[BR]] 16. Additional GENI I&M use cases[[BR]] This document was reviewed at the Inst&Meas WG meeting at GEC7: [http://groups.geni.net/geni/attachment/wiki/Gec7InstMeasWGAgenda/031210%20%20IM-ARCH-GEC7Slides.pdf slides] [[BR]] A second DRAFT (v0.5) was completed by the GPO, with input from the 2nd I&M Workshop: [http://groups.geni.net/geni/attachment/wiki/GeniInstrumentationandMeasurementsArchitecture/072210%20%20GENI-SE-IM-ARCH-0.5.pdf GENI I&M Architecture (Document ID: GENI-SE-IM-ARCH-0.5, Date: July 22, 2010)] [[BR]] This DRAFT has a revised outline: [[BR]] Document outline:[[BR]] 1 DOCUMENT SCOPE [[BR]] 2 INTRODUCTION [[BR]] 3 INSTRUMENTATION AND MEASUREMENT (I&M) USE CASES [[BR]] 3.1 FOR EXPERIMENT RESEARCHERS [[BR]] 3.2 FOR EXPERIMENT (OPT-IN) USERS [[BR]] 3.3 FOR CENTRAL (I.E., GMOC) OPERATORS [[BR]] 3.4 FOR AGGREGATE PROVIDERS AND OPERATORS [[BR]] 3.5 FOR ARCHIVE PROVIDERS AND OPERATORS [[BR]] 3.6 FOR RESEARCHERS THAT USE ARCHIVED MEASUREMENT DATA [[BR]] 4 CONFIGURATION OF I&M SERVICES [[BR]] 4.1 FUNCTIONS OF I&M SERVICES [[BR]] 4.1.1 Measurement Orchestration (MO) Service [[BR]] 4.1.2 Measurement Point (MP) Service [[BR]] 4.1.3 Measurement Information (MI) Service [[BR]] 4.1.4 Measurement Collection (MC) Service [[BR]] 4.1.5 Measurement Analysis and Presentation (MAP) Service [[BR]] 4.1.6 Measurement Data Archive (MDA) Service [[BR]] 4.2 TYPES OF I&M SERVICES [[BR]] 4.2.1 Type 1: Dedicated Service Platform for Customized Information [[BR]] 4.2.2 Type 2: Common Service Platform with Dedicated Slivers for Customized Information [[BR]] 4.2.3 Type 3: Common Service for Common or Customized Information [[BR]] 4.3 DATA FLOWS/TRANSFERS BETWEEN I&M SERVICES [[BR]] 4.3.1 Pull Data [[BR]] 4.3.2 Push Data [[BR]] 4.3.3 Publish and Subscribe to Data [[BR]] 4.4 USING I&M SERVICES [[BR]] 4.5 BASIC RESEARCHER I&M CONFIGURATION [[BR]] 4.6 BASIC OPERATOR I&M CONFIGURATION [[BR]] 4.7 RESEARCHER INCLUDING OPERATOR I&M CONFIGURATION [[BR]] 4.8 RANGE OF I&M SERVICE IMPLEMENTATIONS [[BR]] 5 INTERFACES TO I&M SERVICES [[BR]] 5.1 DISCOVER RESOURCES AND ASSIGN SLIVERS [[BR]] 5.2 CONFIGURE AND PROGRAM SLIVERS [[BR]] 5.3 MANAGE SERVICES [[BR]] 5.4 MEASUREMENT DATA FLOWS/TRANSFERS [[BR]] 5.5 REGISTER AVAILABILITY OF MD FROM I&M SERVICE [[BR]] 5.6 DISCOVER AVAILABILITY OF MD FROM I&M SERVICE AND START MD FLOW/TRANSFER [[BR]] 5.7 OBSERVE I&M SERVICE STATUS AND EXAMINE MD [[BR]] 6 MEASUREMENT TRAFFIC FLOWS [[BR]] 6.1 GENI ENVIRONMENT [[BR]] 6.1.1 Control Traffic [[BR]] 6.1.2 Experiment Traffic [[BR]] 6.2 MEASUREMENT TRAFFIC CARRIED WITH CONTROL TRAFFIC [[BR]] 6.2.1 When Server has a Public (reachable) IP Address [[BR]] 6.2.2 When Server has a Private IP Address [[BR]] 6.3 MEASUREMENT TRAFFIC CARRIED WITH EXPERIMENT TRAFFIC [[BR]] 7 SCHEMA AND PROTOCOLS FOR MEASUREMENT DATA (MD) FLOWS/TRANSFERS [[BR]] 7.1 RANGE OF SCHEMA AND PROTOCOLS [[BR]] 7.2 METADATA INCLUDED WITH MD [[BR]] 7.2.1 Identifiers, Annotation, Provenance, Privacy [[BR]] 7.2.2 Description, Collection, Description, Processing [[BR]] 7.3 OPTION 1: BYTES OF MD VIA SNMP (INSTRUMENTATION TOOLS, GMOC) [[BR]] 7.4 OPTION 2: FILE OF MD VIA MULTIPLE PROTOCOLS [[BR]] 7.5 OPTION 3: XML-FORMATTED MD VIA HTTP (PERFSONAR) [[BR]] 7.6 OPTION 4: TUPLES OF MD VIA CUSTOM OML PROTOCOL OVER TCP (OML) [[BR]] 7.7 OPTION 5: TUPLES OF MD VIA IPFIX OVER SCTP (PROPOSED FOR OML) [[BR]] 7.8 OPTION 6: METCDF-FORMATTED FILES OF DATA USING LDM OVER TCP (DICLOUD) [[BR]] 8 OWNERSHIP OF MD AND PRIVACY OF OWNERS [[BR]] 8.1 OWNERSHIP OF MD [[BR]] 8.2 PRIVACY OF RESEARCHERS/SLICES [[BR]] 8.3 PRIVACY OF APPLICATION USERS [[BR]] 9 API�S AND PROTOCOLS FOR USING I&M SERVICES [[BR]] 9.1 ASSIGN SLIVERS FOR I&M SERVICES [[BR]] 9.2 CONFIGURE AND PROGRAM SLIVERS FOR I&M SERVICES [[BR]] 9.3 MANAGE I&M SERVICES [[BR]] 9.4 REGISTER AVAILABILITY OF MD FROM I&M SERVICE [[BR]] 9.5 DISCOVER AVAILABILITY OF MD AND START MD FLOW/TRANSFER [[BR]] 9.6 OBSERVE I&M SERVICES AND EXAMINE MD [[BR]] 10 DISCOVERY, AUTHORIZATION, ASSIGNMENT AND BINDING OF GENI I&M SERVICES [[BR]] 11 MEASUREMENT ORCHESTRATION (MO) SERVICE [[BR]] 12 MEASUREMENT POINT (MP) SERVICE [[BR]] 12.1 FUNCTIONS [[BR]] 12.2 TYPES OF MP SERVICES [[BR]] 12.3 GATHERING MEASUREMENT DATA FROM INSTRUMENTATION (SENSORS) [[BR]] 12.4 TYPES OF INSTRUMENTATION (SENSORS) [[BR]] 13 TIME-STAMPING MD [[BR]] 14 MEASUREMENT INFORMATION (MI) SERVICE [[BR]] 15 MEASUREMENT COLLECTION (MC) SERVICE [[BR]] 16 MEASUREMENT ANALYSIS AND PRESENTATION (MAP) SERVICE [[BR]] 17 MEASUREMENT DATA ARCHIVE (MDA) SERVICE [[BR]] 17.1 FUNCTIONS [[BR]] 17.2 IMPLEMENTATION [[BR]] 17.3 USE [[BR]] 18 GLOSSARY [[BR]] 19 REFERENCES [[BR]] A third DRAFT (v1.0) is in preparation, with input from the WG. [[BR]] The community is invited to help prepare and review this draft, and provide comments, additions or changes to the Inst&Meas WG SE, Harry Mussman, at hmussman@bbn.com