Instrumentation and Measurement (I&M) Working Session

Wednesday, November 2, 2011, 8:3oam - 12noon
Room:
Session Leader: Harry Mussman, (GPO, Raytheon BBN Technologies)

Description

This session will review the GENI I&M design and prototyping projects planned for Spiral 4 (this year), including the two large Solicitation 3 I&M D&P projects and those continuing projects from Solicitation 2. Then, it will define and discuss the priority topics that must be resolved between now and GEC13.

Summary

Agenda

This is a tentative agenda, which may change.

1) Introductions

8:30am

2) GENI I&M D&P Projects for Spiral 4

8:35am
Harry Mussman

2.1) New Sol 3 Projects

GIMI
PI: Mike Zink (UMass Amherst)
Co-PI/Key: Max Ott (NICTA); Ilia Baldine (RENCI)

Starts with OML, and provides easy-to-use tools in GENI environment

First focus on I&M use cases for experiments, with default OML Client in nodes that gathers passive measurements like INSTOOLS
First supported aggregates: ORCA servers/VMs and RENCI racks
First utilized experiment control tools: GUSH, with additions
First utilized interfaces: GENI AM API for resources; ns3 for topology; ssh; add OMF for orchestration

Requires XML messaging service, with pub/sub, in public IP space

Introduces portal service, with: OML Server, for collection; Results Service, for presentation; measurement orchestration service using OMF; documentation service to create and edit MDOD. Can this be shared with GEMINI project?

Introduces iRODS service for user workspace and archive. Start with CNRI prototype? Can GEMINI use iRODS? Can iRODS serve as registry for MDOD?

Begin: support for WiMAX sites
Consider: adding OML server with perfSONAR interface, for sharing data
Later: add sensor measurement data, carried in data network

GEMINI
PI: Martin Swany (Indiana U)
Co-PI/Key: Chris Small (Indiana U); Eric Boyd (Internet2); Jim Griffioen (U Kentucky); Zongming Fei (U Kentucky)

Starts with INSTOOLS, and continues to provide easy-to-use tools in GENI environment
Consider: how to gather customized data from application

First focus on I&M use cases for experiments
First supported aggregates: protoGENI servers/VMs; can these be used for HP racks?
First utilized experiment control tools: FLACK, with additions
First utilized interfaces: protoGENI API for resources; ns3 for topology; ssh;

Continues portal to presentation service; need to add documentation service to create and edit MDOD. Can portal be shared with GIMI project?

Continues use of Kentucky and CNRI services for user workspace and archive. Consider move to iRODS?

Starts with LAMP/perfSONAR, and continues to provide for infrastructure measurement, and for sharing of data
Continue to setup within resources assigned by slice mechanism
Consider: monitoring of clusters/racks
Consider: measurements of Layer 2 and OpenFlow paths

First focus on I&M use cases for infrastructure measurement
First supported aggregates: protoGENI servers/VMs; can these be used for HP racks?
First utilized experiment control tools: FLACK, with additions
First utilized interfaces: protoGENI API for resources; ns3 for topology; ssh;

Continues local and global Lookup Services
Need to map MDOD into metadata that is registered

Continue to use perfSONAR clients to present data; can these be integrated into portal?

Consider how INSTOOLS and LAMP/perfSONAR tools might be shared

2.2) Continuing Sol 2 Projects

LAMP/perfSONAR
PI: Martin Swany (Indiana U)
Co-PI/Key: Eric Boyd (Internet2); Jason Zurawski (Internet 2); Guilherme Fernandes (U Delaware); Ezra Kissel (U Delaware)

OnTimeMeasure
PI: Prasad Calyam (Ohio Super Center)
Co-PI: Paul Schopis (OARnet)

NetKarma
PI: Beth Plale (Indiana U)
Co-PI/Key: Chris Small (Indiana U); Scott Jensen (Indiana U)

IMF
PI: Rudra Dutta (NCSU)
Co-PI/Key: George Rouskas (NCSU); Ilia Baldine (RENCI); Keren Bergman (Columbia U)

DOR
PI: Larry Lannom (CNRI)
Co-PI/Key: Giridhar Manepalli (CNRI); Jim French (CNRI); Christophe Blanchi (CNRI)

2.3 GIMI Project Overview

8:45am
PI: Mike Zink (UMass Amherst)
co-PI/Key: Max Ott (NICTA); Ilia Baldine (RENCI)
[ slides]

2.4 GEMINI Project Overviews

9:05am PI: Martin Swany (Indiana U)
Co-PI/Key: Chris Small (Indiana U); Eric Boyd (Internet2); Jim Griffioen (U Kentucky); Zongming Fei (U Kentucky)
[ slides]

2.4 LAMP/perfSONAR Project Overviews

9:25am PI: Martin Swany (Indiana U)
Co-PI/Key: Eric Boyd (Internet2); Jason Zurawski (Internet 2); Guilherme Fernandes (U Delaware); Ezra Kissel (U Delaware)
[ slides]

2.6 OnTimeMeasure Project Overview

9:30am PI: Prasad Calyam (Ohio Super Center)
Co-PI: Paul Schopis (OARnet)
[ slides]

2.7 NetKarma Project Overview

9:35am PI: Beth Plale (Indiana U)
Co-PI/Key: Chris Small (Indiana U); Scott Jensen (Indiana U)
[ slides]

2.8 IMF Project Overview

9:40am PI: Rudra Dutta (NCSU)
Co-PI/Key: George Rouskas (NCSU); Ilia Baldine (RENCI); Keren Bergman (Columbia U)
[ slides]

2.9 DOR Project Overview

9:45am PI: Larry Lannom (CNRI)
Co-PI/Key: Giridhar Manepalli (CNRI); Jim French (CNRI); Christophe Blanchi (CNRI)
[ slides]

2.10 Discussion

9:50am

3) Break

10:00am

4) GENI I&M Operational Environment at End of Spiral 4

10:30am

5) Priority Topics and Next Steps

10:35am

5.1) Overview

10:35am

I&M Use Cases for Experiments

I&M Use Cases for Infrastructure Measurement

Platform Targets

Experiment and Measurement Orchestration Tools

Interfaces/Protocols Between Tools and Services

Descriptor Schema and Registry Service

Object Names and Registry Service

XML Messaging Service

Lookup Service

Portal Service

User Workspace and Archive Services

Operational Services

Services Shared by GIMI and GEMINI

Support for Experimenters

Support for Operators

5.2) I&M for Experiments

10:40am I&M Use Cases for Experiments
Support for Experimenters

5.3) I&M Use Cases for Infrastructure Measurement

10:50am I&M Use Cases for Infrastructure Measurement
Support for Operators

5.4) GENI Environment

11:00am Platform Targets
Experiment and Measurement Orchestration Tools
Interfaces/Protocols Between Tools and Services

5.5) Descriptors, Objects and Registries

11:10am Descriptor Schema and Registry Service
Object Names and Registry Service

5.6) Messaging Service

11:20am XML Messaging Service

5.7) Lookup Service

11:25am Lookup Service

5.8) Portal Service

11:30am Portal Service

5.9) User Workspace and Archive Services

11:40am User Workspace and Archive Services

5.10 Operational Services

11:50am Operational Services
Services Shared by GIMI and GEMINI

6) Adjourn

12noon

Background Reading

​I&M integration wiki
​GENI I&M Capabilities Catalog
​GENI I&M Architecture document