[[PageOutline]] = Instrumentation and Measurement (I&M) Working Session = Thursday, July 28, 2011, 1:00pm - 3:00pm [[BR]] Room: [[BR]] Session Leader: Harry Mussman, (GPO, Raytheon BBN Technologies) [[BR]] == Description == This session will review the latest DRAFT of the measurement_data_object_descriptor, commonly known as "metadata"; review the status of current I&M design and prototyping efforts; and review new topics and next steps. [[BR]] == Summary == [ slides] [[BR]] == Agenda == This is a tentative agenda, which may change. [[BR]] === 1) Introductions === 1:00pm [[BR]] === 2) Measurement Data Object Descriptor (MDOD) === 1:05pm [[BR]] Harry Mussman[[BR]] ==== 2.1) Overview ==== ==== 2.2) Use Cases ==== Read the following sections of the [http://groups.geni.net/geni/attachment/wiki/GeniInstrumentationandMeasurementsArchitecture/122010i%20GENI-SE-IM-ARCH-1.0.doc Architecture document:] [[BR]] 4.5 GATHERING, TRANSFERRING AND SHARING MD [[BR]] 4.5.1 Schema and Provenance of MD [[BR]] 4.5.2 Gathering MD into a Slice [[BR]] 4.5.3 Transferring MD between I&M Services in the Same Slice [[BR]] 4.5.4 Transferring MD between I&M Services in Different Slices [[BR]] 4.5.5 Sharing MD with Others Use these [http://groups.geni.net/geni/attachment/wiki/GeniInstrumentationandMeasurementsArchitecture/Visio-4.x%20%20030911%20_IM-ARCH-Figures.pdf figures][[BR]] A summary of the topic is presented in these [http://groups.geni.net/geni/attachment/wiki/GEC10InstMeasWorkingSession/031711_GatheringTransferringMD_I%26MArch_Overview.pptx slides][[BR]] See: I&M in Experimenter's Slice [[BR]] See: I&M in Operator's Infrastructure Measurement Slice [[BR]] FOr example: a GENI operator could get resources, setup a long-running measurement slice, and make data vaailable to other operators or even experimenters. [[BR]] ==== 2.3) Content (Semantics) ==== Read the following sections of the [http://groups.geni.net/geni/attachment/wiki/GeniInstrumentationandMeasurementsArchitecture/122010i%20GENI-SE-IM-ARCH-1.0.doc Architecture document:] [[BR]] 8 SCHEMA AND ELEMENTS FOR MEASUREMENT DATA OBJECT DESCRIPTORS (MDODS) [[BR]] 8.1 MEASUREMENT DATA OBJECTS (MDOS) [[BR]] 8.2 MEASUREMENT DATA (MD) OBJECT DESCRIPTOR [[BR]] 8.2.1 Uses [[BR]] 8.2.2 One Data Model [[BR]] 8.2.3 Multiple Schemas [[BR]] 8.3 MD OBJECT DESCRIPTOR DATA MODEL [[BR]] 8.3.1 Vocabulary [[BR]] 8.3.2 Identifier Elements [[BR]] 8.3.3 Interoperability Elements: [[BR]] 8.3.4 Discovery Elements [[BR]] 8.3.5 Administrative Elements: [[BR]] 8.3.6 Mapping into Descriptors from GENI MD Schemas [[BR]] 8.4 MD OBJECT DESCRIPTOR SCHEMAS [[BR]] 8.4.1 File Schema [[BR]] 8.4.2 MI Registration Schema [[BR]] 8.4.3 Archive Schema [[BR]] A summary of the topic is presented in these [http://groups.geni.net/geni/attachment/wiki/GEC10InstMeasWorkingSession/031711_MDObjectsDescriptors%20_I%26MArch_Overview.pptx slides][[BR]] DRAFT v0.2 MDOD Data Model, Elements and Values: [[BR]] ==== 2.4) Supported Object Types and Formats ==== Instrumentation Tools (Kentucky) [[BR]] OMF/OML (NICTA) [[BR]] perSONAR/LAMP (Delaware, I2) [[BR]] OnTimeMeasure (Ohio State) [[BR]] Scalable Sensing Service? (Purdue, HP Labs) [[BR]] GMOC? (Indiana)[[BR]] NetCDF?[[BR]] others? [[BR]] ==== 2.5 Next Steps ==== === 3) Current I&M Design and Prototyping Efforts === 1:35pm [[BR]] ==== 3.1) Instrumentation Tools (Kentucky) ==== 1:35pm [[BR]] Jim Griffieon, Hussam Nassir[[BR]] (Each one slide, or less)[[BR]] Summary and status [[BR]] Intended use(s): experimenter's slice operator's infrastructure measurement slice?[[BR]] Creates or includes info for MDOD? in druple DB? mapping to MDOD elements? object_type? object_format? interpretation_method?[[BR]] Includes persistent operational services? portal local archive [[BR]] Integrates with MDA service? how? stores tarball status? issues?[[BR]] Authorization methods supported? issues?[[BR]] Note from Jim on 7/6: As for other topics you may want to discuss, one of the things that continues to be a big headache for us is limiting access to measurement data. Currently we have to deal with several different users accounts, authentication schemes, object granularity, etc. BTW, we have integrated INSTOOLS with the CNRI workspace model, but again, they have yet another set of user accounts and passwords to deal with. If we could start moving toward some standards in this area, that would be very helpful. [[BR]] ==== 3.2) OMF/OML (NICTA) ==== 1:45pm [[BR]] Max Ott[[BR]] (Each one slide, or less)[[BR]] Summary and status [[BR]] Intended use(s): experimenter's slice operator's infrastructure measurement slice?[[BR]] Creates or includes info for MDOD? mapping to MDOD elements? object_type? object_format? interpretation_method?[[BR]] Includes persistent operational services? centralized OML data service (will be needed for WiMAX base stations)[[BR]] Integrates with MDA service? how? status? issues?[[BR]] Authorization methods supported? issues?[[BR]] ==== 3.3) perSONAR/LAMP (Delaware, I2) ==== 1:55pm [[BR]] Jason Zurawski, Ezra Kissel[[BR]] (Each one slide, or less)[[BR]] Summary and status [[BR]] Intended use(s): experimenter's slice? operator's infrastructure measurement slice?[[BR]] Creates or includes info for MDOD? mapping to MDOD elements? object_type? object_format? interpretation_method?[[BR]] Includes persistent operational services? lookup (meas info) services[[BR]] Integrates with MDA service? how? status? issues?[[BR]] Authorization methods supported? issues?[[BR]] ==== 3.4) OnTimeMeasure (Ohio State) ==== 2:05pm [[BR]] Prasad Calyam[[BR]] (Each one slide, or less)[[BR]] Summary and status [[BR]] Intended use(s): experimenter's slice? operator's infrastructure measurement slice?[[BR]] Creates or includes info for MDOD? mapping to MDOD elements? object_format? interpretation_method?[[BR]] Includes persistent operational services?[[BR]] Integrates with MDA service? how? status? issues?[[BR]] Authorization methods supported? issues?[[BR]] ==== 3.5) Meas Data Archive (MDA) Prototype Service ==== 2:15pm [[BR]] Giridhar Manepalli[[BR]] (Each one slide, or less)[[BR]] Summary and status [[BR]] Intended use(s): experimenter's slice operator's infrastructure measurement slice [[BR]] Receives MDOD? mapping to MDOD elements? object_format? uses sharing_policy? uses disposal policy?[[BR]] Provides persistent operational services? user workspace service object archive service[[BR]] Integrates with other tools and services? how? status? issues?[[BR]] Authorization methods supported? issues?[[BR]] ==== 3.6) Others? ==== Scalable Sensing Service? (Purdue, HP Labs) [[BR]] GMOC? (Indiana)[[BR]] === 4) New Topics and Next Steps === 2:30pm [[BR]] Open discussion, led by Harry Mussman[[BR]] ==== 4.1) Measurement Data Object Descriptors (MDODs) (“metadata”) ==== Complete defining common data model by ? who?[[BR]] Complete formal schema by? who?[[BR]] First prototype software to create MDOD by ? who?[[BR]] Understand relationship to rspec? [[BR]] ==== 4.2) Deployment Plan for Tools and Services ==== ==== 4.3) Prototype Operational Services ==== Measurement Data Archive (MDA) service, including User Workspace (UW) service and Digital Object Archive (DOA) service [[BR]] INSTOOLS portal?[[BR]] perfSONAR/LAMP lookup (measurement information) service?[[BR]] Centralized OML server? [[BR]] others?[[BR]] ==== 4.4) Integrate I&M services for Experimenters ==== ==== 4.5) Integrate I&M services for Operators monitoring infrastructure ==== ==== 4.6) Use DOA for Sharing Data with Others ==== ==== 4.7) Authorization Mechanisms ==== Note from Jim on 7/6: As for other topics you may want to discuss, one of the things that continues to be a big headache for us is limiting access to measurement data. Currently we have to deal with several different users accounts, authentication schemes, object granularity, etc. BTW, we have integrated INSTOOLS with the CNRI workspace model, but again, they have yet another set of user accounts and passwords to deal with. If we could start moving toward some standards in this area, that would be very helpful. [[BR]] ==== 4.8) Extensions ==== Use MDA as a full Experiment Repository to archive all experiment objects, including: meas data; software; topology/rspec? [[BR]] Use various versions of MDOD to negotiate transfer of data object, e.g., like GENI resource assignment; use versions of MDOD to like rspec advertisement, request, amnifest. [[BR]] Use MDOD with descriptor and holder/transaction records for "object assignment record"; use similar structure in GENI resource assignment to give "resource usage record" === Adjourn === 3:00pm [[BR]] == Background Reading == [http://groups.geni.net/geni/wiki/GeniInstMeas I&M integration wiki][[BR]] [http://groups.geni.net/geni/wiki/GENIIandMCAPCAT GENI I&M Capabilities Catalog][[BR]] [http://groups.geni.net/geni/wiki/GeniInstrumentationandMeasurementsArchitecture GENI I&M Architecture document][[BR]]