Version 24 (modified by 13 years ago) (diff) | ,
---|
-
Instrumentation and Measurement (I&M) Working Session
- Description
- Summary
-
Agenda
- 1) Introductions
- 2) Measurement Data Object Descriptor (MDOD)
- 3) Current I&M Design and Prototyping Efforts
-
4) New Topics and Next Steps
- 4.1) Measurement Data Object Descriptors (MDODs) (“metadata”)
- 4.2) Deployment Plan for Tools and Services
- 4.3) Prototype Operational Services
- 4.4) Integrate I&M services for Experimenters
- 4.5) Integrate I&M services for Operators monitoring infrastructure
- 4.6) Use DOA for Sharing Data with Others
- 4.7) Authorization Mechanisms
- 4.8) Extensions
- Adjourn
- Background Reading
Instrumentation and Measurement (I&M) Working Session
Thursday, July 28, 2011, 1:00pm - 3:00pm
Room:
Session Leader: Harry Mussman, (GPO, Raytheon BBN Technologies)
Description
This session will review the latest DRAFT of the measurement_data_object_descriptor, commonly known as "metadata"; review the status of current I&M design and prototyping efforts; and review new topics and next steps.
Summary
[ slides]
Agenda
This is a tentative agenda, which may change.
1) Introductions
1:00pm
2) Measurement Data Object Descriptor (MDOD)
1:05pm
Harry Mussman
2.1) Overview
Format (syntax)
Goal remains: one data model for GENI
Assume: transfer format is XML record (file)
Have example in XML-like format, and schema/types in RelaxNG
Need: first software to generate (and consume) MDODs
Contents (semantics)
Few required elements, many optional elements
To meet use cases in arch document, sec 4.5
Want one-for-one mapping to key elements in current tools (started: perfSONAR; GENI rspec)
Point-of-view
Often global; therefore includes locators for data objects; must be updated as objects are copied, moved
Sometimes associated; need to understand
Should we consider: storing MDODs in global, GENI registry?
Structure
identifier(s)
descriptor(s)
holder(s)
2.2) Use Cases
Read the following sections of the Architecture document:
4.5 GATHERING, TRANSFERRING AND SHARING MD
4.5.1 Schema and Provenance of MD
schema for MD object contained in MDOD provenance of MD object contianed in MDOD
4.5.2 Gathering MD into a Slice
by first holder, the "owner"
starts MDOD
as owner, sets sharing policy, disposal policy
as gatherer, deals with privacy
4.5.3 Transferring MD between I&M Services in the Same Slice
4.5.4 Transferring MD between I&M Services in Different Slices
4.5.5 Sharing MD with Others
Use these figures
A summary of the topic is presented in these slides
See: I&M in Experimenter's Slice
See: I&M in Operator's Infrastructure Measurement Slice
For example: a GENI operator could get resources, setup a long-running measurement slice, and make data available to other operators or even experimenters.
2.3) Content (Semantics)
Read the following sections of the Architecture document:
8 SCHEMA AND ELEMENTS FOR MEASUREMENT DATA OBJECT DESCRIPTORS (MDODS)
8.1 MEASUREMENT DATA OBJECTS (MDOS)
8.2 MEASUREMENT DATA (MD) OBJECT DESCRIPTOR
8.3 MD OBJECT DESCRIPTOR DATA MODEL
8.4 MD OBJECT DESCRIPTOR SCHEMAS
A summary of the topic is presented in these slides
DRAFT MDOD Data Models, Elements and Values
v0.2.x XML-like example (HEM)
v0.2 text
v0.2.1 text
v0.2.1 text, only mandatory elements
v0.3.x RelaxNG-Compact version (EK); includes RNC and converted XSD files, both schema and types
v0.3 schema RNC
v0.3 schema converted XSD
v0.3 types RNC
v0.3 types converted XSD
MDOD Discussion Points
072511 text
2.4) Supported Object Types and Formats
Instrumentation Tools (Kentucky)
OMF/OML (NICTA)
perSONAR/LAMP (Delaware, I2)
OnTimeMeasure (Ohio State)
Scalable Sensing Service? (Purdue, HP Labs)
GMOC? (Indiana)
NetCDF?
others?
2.5 Next Steps
Complete defining common data model by ? who?
Complete formal schema by? who?
First prototype software to create MDOD by ? who?
Understand relationship to rspec?
3) Current I&M Design and Prototyping Efforts
1:35pm
3.1) Instrumentation Tools (Kentucky)
1:35pm
Jim Griffioen, Hussam Nassir
(Each one slide, or less)
Summary and status
Intended use(s): experimenter's slice operator's infrastructure measurement slice?
Creates or includes info for MDOD? in druple DB? mapping to MDOD elements? object_type? object_format? interpretation_method?
Includes persistent operational services? portal local archive
Integrates with MDA service? how? stores tarball status? issues?
Authorization methods supported? issues?
Note from Jim on 7/6: As for other topics you may want to discuss, one of the things that continues to be a big headache for us is limiting access to measurement data. Currently we have to deal with several different users accounts, authentication schemes, object granularity, etc. BTW, we have integrated INSTOOLS with the CNRI workspace model, but again, they have yet another set of user accounts and passwords to deal with. If we could start moving toward some standards in this area, that would be very helpful.
3.2) OMF/OML (NICTA)
1:45pm
Max Ott
(Each one slide, or less)
Summary and status
Intended use(s): experimenter's slice operator's infrastructure measurement slice?
Creates or includes info for MDOD? mapping to MDOD elements? object_type? object_format? interpretation_method?
Includes persistent operational services? centralized OML data service (will be needed for WiMAX base stations)
Integrates with MDA service? how? status? issues?
Authorization methods supported? issues?
3.3) perSONAR/LAMP (Delaware, I2)
1:55pm
Jason Zurawski, Ezra Kissel, Martin Swany
(Each one slide, or less)
Summary and status
Intended use(s): experimenter's slice? operator's infrastructure measurement slice?
Creates or includes info for MDOD? mapping to MDOD elements? object_type? object_format? interpretation_method?
Includes persistent operational services? lookup (meas info) services
Integrates with MDA service? how? status? issues?
Authorization methods supported? issues?
3.4) OnTimeMeasure (Ohio State)
2:05pm
Prasad Calyam
(Each one slide, or less)
Summary and status
Intended use(s): experimenter's slice? operator's infrastructure measurement slice?
Creates or includes info for MDOD? mapping to MDOD elements? object_format? interpretation_method?
Includes persistent operational services?
Integrates with MDA service? how? status? issues?
Authorization methods supported? issues?
3.5) Meas Data Archive (MDA) Prototype Service
2:15pm
Giridhar Manepalli, Larry Lannom
(Each one slide, or less)
Summary and status
Intended use(s): experimenter's slice operator's infrastructure measurement slice
Receives MDOD? mapping to MDOD elements? object_format? uses sharing_policy? uses disposal policy?
Provides persistent operational services? user workspace service object archive service
Integrates with other tools and services? how? status? issues?
Authorization methods supported? issues?
3.6) Others?
Scalable Sensing Service? (Purdue, HP Labs)
GMOC? (Indiana)
4) New Topics and Next Steps
2:30pm
Open discussion, led by Harry Mussman
4.1) Measurement Data Object Descriptors (MDODs) (“metadata”)
Complete defining common data model by ? who?
Complete formal schema by? who?
First prototype software to create MDOD by ? who?
Understand relationship to rspec?
4.2) Deployment Plan for Tools and Services
4.3) Prototype Operational Services
Measurement Data Archive (MDA) service, including User Workspace (UW) service and Digital Object Archive (DOA) service
INSTOOLS portal?
perfSONAR/LAMP lookup (measurement information) service?
Centralized OML server?
others?
4.4) Integrate I&M services for Experimenters
4.5) Integrate I&M services for Operators monitoring infrastructure
4.6) Use DOA for Sharing Data with Others
4.7) Authorization Mechanisms
Note from Jim on 7/6: As for other topics you may want to discuss, one of the things that continues to be a big headache for us is limiting access to measurement data. Currently we have to deal with several different users accounts, authentication schemes, object granularity, etc. BTW, we have integrated INSTOOLS with the CNRI workspace model, but again, they have yet another set of user accounts and passwords to deal with. If we could start moving toward some standards in this area, that would be very helpful.
4.8) Extensions
Use MDA as a full Experiment Repository to archive all experiment objects, including: meas data; software; topology/rspec?
Use various versions of MDOD to negotiate transfer of data object, e.g., like GENI resource assignment; use versions of MDOD to like rspec advertisement, request, amnifest.
Use MDOD with descriptor and holder/transaction records for "object assignment record"; use similar structure in GENI resource assignment to give "resource usage record"
Adjourn
3:00pm
Background Reading
I&M integration wiki
GENI I&M Capabilities Catalog
GENI I&M Architecture document
Attachments (19)
- Visio-070111_UseCases_Services_MDOD_Page_01.jpg (447.3 KB) - added by 13 years ago.
- Visio-070111_UseCases_Services_MDOD_Page_02.jpg (492.5 KB) - added by 13 years ago.
- 062211_MDOD_DataModel.txt (4.6 KB) - added by 13 years ago.
- 072011_ver0.2_MDOD_DataModel.txt (4.6 KB) - added by 13 years ago.
- 072511_ver0.2.1_mandatoryonly_MDOD_DataModel.txt (2.6 KB) - added by 13 years ago.
- 072511_ver0.2.1_MDOD_DataModel.txt (5.0 KB) - added by 13 years ago.
- 072511_MDOD_Discussion.txt (8.2 KB) - added by 13 years ago.
- 072111_v0.3_MDOD.rnc (1.9 KB) - added by 13 years ago.
- 072111_v0.3_MDOD.xsd (3.6 KB) - added by 13 years ago.
- 072111_v0.3_MDOD_types.rnc (3.7 KB) - added by 13 years ago.
- 072111_v0.3_MDOD_types.xsd (8.9 KB) - added by 13 years ago.
- 20110728-IM-LAMP.ppt (1.0 MB) - added by 13 years ago.
- GEC11 - OML update.pptx (486.8 KB) - added by 13 years ago.
- I&M Meeting_discussion_ma.ppt (2.8 MB) - added by 13 years ago.
- Instrumentation Tools.pdf (63.4 KB) - added by 13 years ago.
- MDA_IntegrationEffort.pptx (57.7 KB) - added by 13 years ago.
- OnTimeMeasure_GEC11-I&M-Talk.pdf (344.9 KB) - added by 13 years ago.
- 072811Zurawski_instance1.xml (8.6 KB) - added by 13 years ago.
- 072811Zurawski_instance_proposed.xml (6.0 KB) - added by 13 years ago.