Instrumentation & Measurement Working Session

Wed, 0830-1200

Organizer: Harry Mussman, GPO

Description: This session will review the status of current I&M design and prototyping efforts, including the I&M services that have been deployed in GENI and the I&M software that is now available to experimenters and operators. Various I&M use cases will then be illustrated using example experiments.

Instrumentation and Measurement (I&M) Working Session

Wednesday, November 2, 2011, 8:3oam - 12noon
Room:
Session Leader: Harry Mussman, (GPO, Raytheon BBN Technologies)

Description

This session will review the GENI I&M design and prototyping projects planned for Spiral 4 (this year), including the two large Solicitation 3 I&M D&P projects and those continuing projects from Solicitation 2. Then, it will define and discuss the priority topics that must be resolved between now and GEC13.

Summary

Agenda

This is a tentative agenda, which may change.

1) Introductions

8:30am

2) GENI I&M D&P Projects for Spiral 4

1:05pm
Harry Mussman

2.1) New Sol 3 Projects

GIMI

Goal remains: one data model for GENI
Assume: transfer format is XML record (file)
Have example in XML-like format, and schema/types in RelaxNG
Need: first software to generate (and consume) MDODs

GEMINI

Few required elements, many optional elements
To meet use cases in arch document, sec 4.5
Want one-for-one mapping to key elements in current tools (started: perfSONAR; GENI rspec)

2.2) Continuing Sol 2 Projects =

NetKarma

IMF

LAMP/perfSONAR

OnTimeMeasure

DOR

2.3 GIMI Project Overview

2.4 GEMINI Project Overview

Few required elements, many optional elements
To meet use cases in arch document, sec 4.5
Want one-for-one mapping to key elements in current tools (started: perfSONAR; GENI rspec)

2.5 LAMP/perfSONAR Project Overview

2.6 NetKarma Project Overview

2.7 IMF Project Overview

2.8 OnTimeMeasure Project Overview

2.9 DOR Project Overview

3) Current I&M Design and Prototyping Efforts

1:35pm

3.1) Instrumentation Tools (Kentucky)

1:35pm
Jim Griffioen, Hussam Nassir

​slides
Summary and status
Intended use(s): experimenter's slice operator's infrastructure measurement slice?
Creates or includes info for MDOD? in druple DB? mapping to MDOD elements? object_type? object_format? interpretation_method?
Includes persistent operational services? portal local archive
Integrates with MDA service? how? stores tarball status? issues?
Authorization methods supported? issues?

Note from Jim on 7/6: As for other topics you may want to discuss, one of the things that continues to be a big headache for us is limiting access to measurement data. Currently we have to deal with several different users accounts, authentication schemes, object granularity, etc. BTW, we have integrated INSTOOLS with the CNRI workspace model, but again, they have yet another set of user accounts and passwords to deal with. If we could start moving toward some standards in this area, that would be very helpful.

3.2) OMF/OML (NICTA)

1:45pm
Max Ott

​slides
Summary and status
Intended use(s): experimenter's slice operator's infrastructure measurement slice?
Creates or includes info for MDOD? mapping to MDOD elements? object_type? object_format? interpretation_method?
Includes persistent operational services? centralized OML data service (will be needed for WiMAX base stations)
Integrates with MDA service? how? status? issues?
Authorization methods supported? issues?

3.3) perSONAR/LAMP (Delaware, I2)

1:55pm
Jason Zurawski, Ezra Kissel, Martin Swany

​slides
Summary and status
Intended use(s): experimenter's slice? operator's infrastructure measurement slice?
Creates or includes info for MDOD? mapping to MDOD elements? object_type? object_format? interpretation_method?
Includes persistent operational services? lookup (meas info) services
Integrates with MDA service? how? status? issues?
Authorization methods supported? issues?

3.4) OnTimeMeasure (Ohio State)

2:05pm
Prasad Calyam

​slides
Summary and status
Intended use(s): experimenter's slice? operator's infrastructure measurement slice?
Creates or includes info for MDOD? mapping to MDOD elements? object_format? interpretation_method?
Includes persistent operational services?
Integrates with MDA service? how? status? issues?
Authorization methods supported? issues?

3.5) Meas Data Archive (MDA) Prototype Service

2:15pm
Giridhar Manepalli, Larry Lannom

​slides
Summary and status
Intended use(s): experimenter's slice operator's infrastructure measurement slice
Receives MDOD? mapping to MDOD elements? object_format? uses sharing_policy? uses disposal policy?
Provides persistent operational services? user workspace service object archive service
Integrates with other tools and services? how? status? issues?
Authorization methods supported? issues?

3.6) Others?

Scalable Sensing Service? (Purdue, HP Labs)
GMOC? (Indiana)

NetKarma: Experiment Provenance
Mehmet Aktas, Beth Plale, Scott Jensen
​slides

4) New Topics and Next Steps

2:30pm
Open discussion, led by Harry Mussman

4.1) Measurement Data Object Descriptors (MDODs) (“metadata”)

First review of data model and schema (completed)

For each tool: map key elements into current data model; review expected use cases who? when?
Review suggested approach to recording provenance who? when?
Review choice for primary and secondary identifiers who? when?
Review formats for slice_id, etc. who? when?

Understand relationship to rspec? who? when?

Complete third pass at data model and schema who? when?

Complete first prototype software to create MDOD who? when?

4.3) Deploy Prototype Operational Services

Measurement Data Archive (MDA) service, including User Workspace (UW) service and Digital Object Archive (DOA) service (ongoing)
INSTOOLS portal? who? when?
INSTOOLS archive service? who? when?
perfSONAR/LAMP lookup (Measurement Information) service? who? when?
other MI service? who? when?
Centralized OML server? (useful for monitoring WiMAX sites) who? when?
others?

4.4) Integrate I&M services for Experimenters

INSTOOLS tools with MDA service (ongoing)
OnTimeMeas tools, with MDA service (ongoing)

4.5) Integrate I&M services for Operators monitoring infrastructure

LAMP for OpenFlow slice monitoring (Ali Sydney)

4.6) Use DOA for Sharing Data with Others

Who? when?

4.7) Authorization Mechanisms

Define situation who? when?
Note from Jim on 7/6: As for other topics you may want to discuss, one of the things that continues to be a big headache for us is limiting access to measurement data. Currently we have to deal with several different users accounts, authentication schemes, object granularity, etc. BTW, we have integrated INSTOOLS with the CNRI workspace model, but again, they have yet another set of user accounts and passwords to deal with. If we could start moving toward some standards in this area, that would be very helpful.

Suggest approaches who? when?

4.8) Extensions

Use MDA as a full Experiment Repository to archive all experiment objects, including: meas data; software; topology/rspec?
Use various versions of MDOD to negotiate transfer of data object, e.g., like GENI resource assignment; use versions of MDOD to like rspec advertisement, request, amnifest.

Use MDOD with descriptor and holder/transaction records for "object assignment record"; use similar structure in GENI resource assignment to give "resource usage record"

Adjourn

3:00pm

Background Reading

​I&M integration wiki
​GENI I&M Capabilities Catalog
​GENI I&M Architecture document