Instrumentation and Measurement (I&M) Working Session

Thursday, July 28, 2011, 1:00pm - 3:00pm
Room:
Session Leader: Harry Mussman, (GPO, Raytheon BBN Technologies)

Description

This session will review the latest DRAFT of the measurement_data_object_descriptor, commonly known as "metadata"; review the status of current I&M tools and services; and review new topics and next steps.

Summary

[ slides]

Agenda

This is a tentative agenda, which may change.

1) Introductions

1:00pm

2) Measurement Data Object Descriptor (MDOD)

1:05pm
Harry Mussman

2.1) Overview

2.2) Use Cases

Read the following sections of the ​Architecture document:[[BR] 4.5 GATHERING, TRANSFERRING AND SHARING MD
4.5.1 Schema and Provenance of MD
4.5.2 Gathering MD into a Slice
4.5.3 Transferring MD between I&M Services in the Same Slice
4.5.4 Transferring MD between I&M Services in Different Slices
4.5.5 Sharing MD with Others

Use these ​figures

A summary of the topic is presented in these ​slides

See: I&M in Experimenter's Slice

See: I&M in Operator's Infrastructure Measurement Slice

2.3) Content (Semantics)

Read the following sections of the ​Architecture document:
8 SCHEMA AND ELEMENTS FOR MEASUREMENT DATA OBJECT DESCRIPTORS (MDODS)
8.1 MEASUREMENT DATA OBJECTS (MDOS)
8.2 MEASUREMENT DATA (MD) OBJECT DESCRIPTOR
8.2.1 Uses
8.2.2 One Data Model
8.2.3 Multiple Schemas
8.3 MD OBJECT DESCRIPTOR DATA MODEL
8.3.1 Vocabulary
8.3.2 Identifier Elements
8.3.3 Interoperability Elements:
8.3.4 Discovery Elements
8.3.5 Administrative Elements:
8.3.6 Mapping into Descriptors from GENI MD Schemas
8.4 MD OBJECT DESCRIPTOR SCHEMAS
8.4.1 File Schema
8.4.2 MI Registration Schema
8.4.3 Archive Schema

A summary of the topic is presented in these ​slides

DRAFT ver0.2 MDOD Data Model, Elements and Values:

2.4) Supported Object Types

Instrumentation Tools (Kentucky)
OMF/OML (NICTA)
perSONAR/LAMP (Delaware, I2)
OnTimeMeasure (Ohio State)
Scalable Sensing Service? (Purdue, HP Labs)
GMOC? (Indiana)
NetCDF?
others?

2.5 Next Steps

3) Current I&M Design and Prototyping Efforts

1:35pm

3.1) Instrumentation Tools (Kentucky)

(Each one slide, or less) Summary and status Intended use(s): experimenter's slice? operator's infrastructure measurement slice? Creates or includes info for MDOD? mapping to MDOD elements? object_format? interpretation_method? Includes (or requires) persistent operational services? Status of integration with MDA service? issues? Authorization methods supported and/or issues?

3.2) OMF/OML (NICTA)

(Each one slide, or less) Summary and status Intended use(s): experimenter's slice? operator's infrastructure measurement slice? Creates or includes info for MDOD? mapping to MDOD elements? object_format? interpretation_method? Includes (or requires) persistent operational services? Status of integration with MDA service? issues? Authorization methods supported and/or issues?

3.3) perSONAR/LAMP (Delaware, I2)

(Each one slide, or less) Summary and status Intended use(s): experimenter's slice? operator's infrastructure measurement slice? Creates or includes info for MDOD? mapping to MDOD elements? object_format? interpretation_method? Includes (or requires) persistent operational services? Status of integration with MDA service? issues? Authorization methods supported and/or issues?

3.4) OnTimeMeasure (Ohio State)

(Each one slide, or less) Summary and status Intended use(s): experimenter's slice? operator's infrastructure measurement slice? Creates or includes info for MDOD? mapping to MDOD elements? object_format? interpretation_method? Includes (or requires) persistent operational services? Status of integration with MDA service? issues? Authorization methods supported and/or issues?

3.5) Meas Data Archive (MDA) Prototype Service

(Each one slide, or less) Summary and status Intended use(s): experimenter's slice? operator's infrastructure measurement slice? Creates or includes info for MDOD? mapping to MDOD elements? object_format? interpretation_method? Includes (or requires) persistent operational services? Status of integration with MDA service? issues? Authorization methods supported and/or issues?

3.6) Others?

Scalable Sensing Service? (Purdue, HP Labs)
GMOC? (Indiana)

I&M services for Experimenters, including:

Instrumentation Tools (for use with protoGENI)
OMF/OML
LAMP (uses perfSONAR technology, for use with protoGENI)
OnTimeMeasure (for use with protoGENI or PlanetLab)

I&M services for monitoring infrastructure, including:

Measurement System, for packet capture
Shadownet, for router monitoring
Scalable Sensing Service

Measurement Data Archive (MDA) service

First prototype by CNRI, including User Workspace (UW) service and Digital Object Archive (DOA) service

Management of an I&M service, from Measurement Orchestration (MO) service:

First prototype by IMF and ERM projects, following OMF approach

Measurement Data Objects, and Descriptors (“metadata”):

Defining common data model, then schemas
First prototype software by ?

Measurement traffic flows, proxies/mechanisms) to reach servers in private address space

First prototype of ssh access by ORCA project

​slides

Is anything missing?

Next steps?

6) I&M Service Deployments

3:50pm

Current I&M services for Experimenters, including:

Instrumentation Tools (for use with protoGENI)
OMF/OML
LAMP (uses perfSONAR technology, for use with protoGENI)
OnTimeMeasure (for use with protoGENI or PlanetLab)

Introduce I&M services for monitoring infrastructure, including:

perfSONAR components, with Measurement Information (MI) service, and first use of Measurement Data Object Descriptors (MDOD’s)? Who?
Measurement System for packet capture?
Scalable Sensing Service?

Introduce Measurement Data Archive (MDA) service:

Include User Workspace (UW) service
Include Digital Object Archive (DOA) service
Who are first users?
Are there other uses, e.g., software downloads?
When ready to support Researchers?

​slides

Discussion

Can we build a guide?

Adjourn

3:00pm

Background Reading

​I&M integration wiki
​GENI I&M Capabilities Catalog
​GENI I&M Architecture document