GENI Instrumentation and Measurements Architecture

An effort is underway to define and document the GENI Instrumentation and Measurements Architecture.

Plan:
+ Completed by GEC7: v0.1 DRAFT, by GPO
+ Completed by GEC8: v0.5 DRAFT, by GPO, with revised outline and contributions after 2nd workshop
+ In preparation: v1.0 DRAFT, including contributions from WG

A first DRAFT (v0.1) was completed by the GPO: ​GENI I&M Architecture (Document ID: GENI-SE-IM-ARCH-0.1, Date: March 8, 2010)
This DRAFT includes proposed I&M services and a proposed configuration

Document outline:

1. Document Scope
   
2. Introduction
   
3. Definition and configuration of I&M services
   
4. Interfaces, protocols and schema for Measurement Data (MD)
   
5. Ownership of MD and privacy of owners
   
6. Interfaces, protocols and APIs for using I&M services
   
7. Basic GENI I&M use cases
   
8. MD transport via the GENI Measurement Plane
   
9. Discovery, authorization, assignment and binding of GENI I&M services
   
10. Measurement Orchestration (MO) service
    
11. Measurement Point (MP)
    
12. Time-stamping MD
    
13. Measurement Collection (MC) service
    
14. Measurement Analysis and Presentation (MAP) service
    
15. Measurement Data Archive (MDA) service
    
16. Additional GENI I&M use cases
    

This document was reviewed at the Inst&Meas WG meeting at GEC7: ​slides

A second DRAFT (v0.5) was completed by the GPO, with input from the 2nd I&M Workshop: ​GENI I&M Architecture (Document ID: GENI-SE-IM-ARCH-0.5, Date: July 22, 2010)

This DRAFT has a revised outline:

Document outline:
1 DOCUMENT SCOPE
2 INTRODUCTION
3 INSTRUMENTATION AND MEASUREMENT (I&M) USE CASES

3.1 FOR EXPERIMENT RESEARCHERS
3.2 FOR EXPERIMENT (OPT-IN) USERS
3.3 FOR CENTRAL (I.E., GMOC) OPERATORS
3.4 FOR AGGREGATE PROVIDERS AND OPERATORS
3.5 FOR ARCHIVE PROVIDERS AND OPERATORS
3.6 FOR RESEARCHERS THAT USE ARCHIVED MEASUREMENT DATA

4 CONFIGURATION OF I&M SERVICES

4.1 FUNCTIONS OF I&M SERVICES

4.1.1 Measurement Orchestration (MO) Service
4.1.2 Measurement Point (MP) Service
4.1.3 Measurement Information (MI) Service
4.1.4 Measurement Collection (MC) Service
4.1.5 Measurement Analysis and Presentation (MAP) Service
4.1.6 Measurement Data Archive (MDA) Service

4.2 TYPES OF I&M SERVICES

4.2.1 Type 1: Dedicated Service Platform for Customized Information
4.2.2 Type 2: Common Service Platform with Dedicated Slivers for Customized Information
4.2.3 Type 3: Common Service for Common or Customized Information

4.3 DATA FLOWS/TRANSFERS BETWEEN I&M SERVICES

4.3.1 Pull Data
4.3.2 Push Data
4.3.3 Publish and Subscribe to Data

4.4 USING I&M SERVICES
4.5 BASIC RESEARCHER I&M CONFIGURATION
4.6 BASIC OPERATOR I&M CONFIGURATION
4.7 RESEARCHER INCLUDING OPERATOR I&M CONFIGURATION
4.8 RANGE OF I&M SERVICE IMPLEMENTATIONS

5 INTERFACES TO I&M SERVICES

5.1 DISCOVER RESOURCES AND ASSIGN SLIVERS
5.2 CONFIGURE AND PROGRAM SLIVERS
5.3 MANAGE SERVICES
5.4 MEASUREMENT DATA FLOWS/TRANSFERS
5.5 REGISTER AVAILABILITY OF MD FROM I&M SERVICE
5.6 DISCOVER AVAILABILITY OF MD FROM I&M SERVICE AND START MD FLOW/TRANSFER
5.7 OBSERVE I&M SERVICE STATUS AND EXAMINE MD

6 MEASUREMENT TRAFFIC FLOWS

6.1 GENI ENVIRONMENT

6.1.1 Control Traffic
6.1.2 Experiment Traffic

6.2 MEASUREMENT TRAFFIC CARRIED WITH CONTROL TRAFFIC

6.2.1 When Server has a Public (reachable) IP Address
6.2.2 When Server has a Private IP Address

6.3 MEASUREMENT TRAFFIC CARRIED WITH EXPERIMENT TRAFFIC

7 SCHEMA AND PROTOCOLS FOR MEASUREMENT DATA (MD) FLOWS/TRANSFERS

7.1 RANGE OF SCHEMA AND PROTOCOLS
7.2 METADATA INCLUDED WITH MD

7.2.1 Identifiers, Annotation, Provenance, Privacy
7.2.2 Description, Collection, Description, Processing

7.3 OPTION 1: BYTES OF MD VIA SNMP (INSTRUMENTATION TOOLS, GMOC)
7.4 OPTION 2: FILE OF MD VIA MULTIPLE PROTOCOLS
7.5 OPTION 3: XML-FORMATTED MD VIA HTTP (PERFSONAR)
7.6 OPTION 4: TUPLES OF MD VIA CUSTOM OML PROTOCOL OVER TCP (OML)
7.7 OPTION 5: TUPLES OF MD VIA IPFIX OVER SCTP (PROPOSED FOR OML)
7.8 OPTION 6: METCDF-FORMATTED FILES OF DATA USING LDM OVER TCP (DICLOUD)

8 OWNERSHIP OF MD AND PRIVACY OF OWNERS

8.1 OWNERSHIP OF MD
8.2 PRIVACY OF RESEARCHERS/SLICES
8.3 PRIVACY OF APPLICATION USERS

9 API�S AND PROTOCOLS FOR USING I&M SERVICES

9.1 ASSIGN SLIVERS FOR I&M SERVICES
9.2 CONFIGURE AND PROGRAM SLIVERS FOR I&M SERVICES
9.3 MANAGE I&M SERVICES
9.4 REGISTER AVAILABILITY OF MD FROM I&M SERVICE
9.5 DISCOVER AVAILABILITY OF MD AND START MD FLOW/TRANSFER
9.6 OBSERVE I&M SERVICES AND EXAMINE MD

10 DISCOVERY, AUTHORIZATION, ASSIGNMENT AND BINDING OF GENI I&M SERVICES
11 MEASUREMENT ORCHESTRATION (MO) SERVICE
12 MEASUREMENT POINT (MP) SERVICE

12.1 FUNCTIONS
12.2 TYPES OF MP SERVICES
12.3 GATHERING MEASUREMENT DATA FROM INSTRUMENTATION (SENSORS)
12.4 TYPES OF INSTRUMENTATION (SENSORS)

13 TIME-STAMPING MD
14 MEASUREMENT INFORMATION (MI) SERVICE
15 MEASUREMENT COLLECTION (MC) SERVICE
16 MEASUREMENT ANALYSIS AND PRESENTATION (MAP) SERVICE
17 MEASUREMENT DATA ARCHIVE (MDA) SERVICE

17.1 FUNCTIONS
17.2 IMPLEMENTATION
17.3 USE

18 GLOSSARY
19 REFERENCES

A third DRAFT (v1.0) is in preparation, with input from the WG.

The community is invited to help prepare and review this draft, and provide comments, additions or changes to the Inst&Meas WG SE, Harry Mussman, at ​hmussman@bbn.com