[[PageOutline]] = Instrumentation and Measurement (I&M) Working Session = Thursday, July 28, 2011, 1:00pm - 3:00pm [[BR]] Room: [[BR]] Session Leader: Harry Mussman, (GPO, Raytheon BBN Technologies) [[BR]] == Description == This session will review the latest DRAFT of the measurement_data_object_descriptor, commonly known as "metadata"; review the status of current I&M design and prototyping efforts; and review new topics and next steps. [[BR]] == Summary == [ slides] [[BR]] == Agenda == This is a tentative agenda, which may change. [[BR]] === 1) Introductions === 1:00pm [[BR]] === 2) Measurement Data Object Descriptor (MDOD) === 1:05pm [[BR]] Harry Mussman[[BR]] ==== 2.1) Overview ==== ==== 2.2) Use Cases ==== Read the following sections of the [http://groups.geni.net/geni/attachment/wiki/GeniInstrumentationandMeasurementsArchitecture/122010i%20GENI-SE-IM-ARCH-1.0.doc Architecture document: [[BR]] 4.5 GATHERING, TRANSFERRING AND SHARING MD [[BR]] 4.5.1 Schema and Provenance of MD [[BR]] 4.5.2 Gathering MD into a Slice [[BR]] 4.5.3 Transferring MD between I&M Services in the Same Slice [[BR]] 4.5.4 Transferring MD between I&M Services in Different Slices [[BR]] 4.5.5 Sharing MD with Others Use these [http://groups.geni.net/geni/attachment/wiki/GeniInstrumentationandMeasurementsArchitecture/Visio-4.x%20%20030911%20_IM-ARCH-Figures.pdf figures][[BR]] A summary of the topic is presented in these [http://groups.geni.net/geni/attachment/wiki/GEC10InstMeasWorkingSession/031711_GatheringTransferringMD_I%26MArch_Overview.pptx slides][[BR]] See: I&M in Experimenter's Slice [[BR]] See: I&M in Operator's Infrastructure Measurement Slice [[BR]] FOr example: a GENI operator could get resources, setup a long-running measurement slice, and make data vaailable to other operators or even experimenters. [[BR]] ==== 2.3) Content (Semantics) ==== Read the following sections of the [http://groups.geni.net/geni/attachment/wiki/GeniInstrumentationandMeasurementsArchitecture/122010i%20GENI-SE-IM-ARCH-1.0.doc Architecture document:] [[BR]] 8 SCHEMA AND ELEMENTS FOR MEASUREMENT DATA OBJECT DESCRIPTORS (MDODS) [[BR]] 8.1 MEASUREMENT DATA OBJECTS (MDOS) [[BR]] 8.2 MEASUREMENT DATA (MD) OBJECT DESCRIPTOR [[BR]] 8.2.1 Uses [[BR]] 8.2.2 One Data Model [[BR]] 8.2.3 Multiple Schemas [[BR]] 8.3 MD OBJECT DESCRIPTOR DATA MODEL [[BR]] 8.3.1 Vocabulary [[BR]] 8.3.2 Identifier Elements [[BR]] 8.3.3 Interoperability Elements: [[BR]] 8.3.4 Discovery Elements [[BR]] 8.3.5 Administrative Elements: [[BR]] 8.3.6 Mapping into Descriptors from GENI MD Schemas [[BR]] 8.4 MD OBJECT DESCRIPTOR SCHEMAS [[BR]] 8.4.1 File Schema [[BR]] 8.4.2 MI Registration Schema [[BR]] 8.4.3 Archive Schema [[BR]] A summary of the topic is presented in these [http://groups.geni.net/geni/attachment/wiki/GEC10InstMeasWorkingSession/031711_MDObjectsDescriptors%20_I%26MArch_Overview.pptx slides][[BR]] DRAFT v0.2 MDOD Data Model, Elements and Values: [[BR]] ==== 2.4) Supported Object Types and Formats ==== Instrumentation Tools (Kentucky) [[BR]] OMF/OML (NICTA) [[BR]] perSONAR/LAMP (Delaware, I2) [[BR]] OnTimeMeasure (Ohio State) [[BR]] Scalable Sensing Service? (Purdue, HP Labs) [[BR]] GMOC? (Indiana)[[BR]] NetCDF?[[BR]] others? [[BR]] ==== 2.5 Next Steps ==== === 3) Current I&M Design and Prototyping Efforts === 1:35pm [[BR]] ==== 3.1) Instrumentation Tools (Kentucky) ==== 1:35pm [[BR]] Jim Griffieon, Hussam Nassir[[BR]] (Each one slide, or less)[[BR]] Summary and status [[BR]] Intended use(s): experimenter's slice operator's infrastructure measurement slice?[[BR]] Creates or includes info for MDOD? in druple DB? mapping to MDOD elements? object_type? object_format? interpretation_method?[[BR]] Includes persistent operational services? portal local archive [[BR]] Integrates with MDA service? how? stores tarball status? issues?[[BR]] Authorization methods supported? issues?[[BR]] ==== 3.2) OMF/OML (NICTA) ==== 1:45pm [[BR]] Max Ott[[BR]] (Each one slide, or less)[[BR]] Summary and status [[BR]] Intended use(s): experimenter's slice operator's infrastructure measurement slice?[[BR]] Creates or includes info for MDOD? mapping to MDOD elements? object_type? object_format? interpretation_method?[[BR]] Includes persistent operational services? centralized OML data service (will be needed for WiMAX base stations)[[BR]] Integrates with MDA service? how? status? issues?[[BR]] Authorization methods supported? issues?[[BR]] ==== 3.3) perSONAR/LAMP (Delaware, I2) ==== 1:55pm [[BR]] Jason Zurawski, Ezra Kissel[[BR]] (Each one slide, or less)[[BR]] Summary and status [[BR]] Intended use(s): experimenter's slice? operator's infrastructure measurement slice?[[BR]] Creates or includes info for MDOD? mapping to MDOD elements? object_type? object_format? interpretation_method?[[BR]] Includes persistent operational services? lookup (meas info) services[[BR]] Integrates with MDA service? how? status? issues?[[BR]] Authorization methods supported? issues?[[BR]] ==== 3.4) OnTimeMeasure (Ohio State) ==== 2:05pm [[BR]] Prasad Calyam[[BR]] (Each one slide, or less)[[BR]] Summary and status [[BR]] Intended use(s): experimenter's slice? operator's infrastructure measurement slice?[[BR]] Creates or includes info for MDOD? mapping to MDOD elements? object_format? interpretation_method?[[BR]] Includes persistent operational services?[[BR]] Integrates with MDA service? how? status? issues?[[BR]] Authorization methods supported? issues?[[BR]] ==== 3.5) Meas Data Archive (MDA) Prototype Service ==== 2:15pm [[BR]] Giridhar Manepalli[[BR]] (Each one slide, or less)[[BR]] Summary and status [[BR]] Intended use(s): experimenter's slice operator's infrastructure measurement slice [[BR]] Receives MDOD? mapping to MDOD elements? object_format? uses sharing_policy? uses disposal policy?[[BR]] Provides persistent operational services? user workspace service object archive service[[BR]] Integrates with other tools and services? how? status? issues?[[BR]] Authorization methods supported? issues?[[BR]] ==== 3.6) Others? ==== Scalable Sensing Service? (Purdue, HP Labs) [[BR]] GMOC? (Indiana)[[BR]] === 4) New Topics and Next Steps === 2:30pm [[BR]] Open discussion, led by Harry Mussman[[BR]] ==== 4.1) Measurement Data Object Descriptors (MDODs) (“metadata”) ==== Complete defining common data model by ? who?[[BR]] Complete formal schema by? who?[[BR]] First prototype software to create MDOD by ? who?[[BR]] Understand relationship to rspec? [[BR]] ==== 4.2) Deployment Plan for Tools and Services ==== ==== 4.3) Prototype Operational Services ==== Measurement Data Archive (MDA) service, including User Workspace (UW) service and Digital Object Archive (DOA) service [[BR]] INSTOOLS portal?[[BR]] perfSONAR/LAMP lookup (measurement information) service?[[BR]] Centralized OML server? [[BR]] others?[[BR]] ==== 4.4) Integrate I&M services for Experimenters ==== ==== 4.5) Integrate I&M services for Operators monitoring infrastructure ==== ==== 4.6) Use DOA for Sharing Data with Others ==== ==== 4.7) Authorization Mechanisms ==== ==== 4.8) Extensions ==== Use MDA as a full Experiment Repository to archive all experiment objects, including: meas data; software; topology/rspec? [[BR]] Use various versions of MDOD to negotiate transfer of data object, e.g., like GENI resource assignment; use versions of MDOD to like rspec advertisement, request, amnifest. [[BR]] Use MDOD with descriptor and holder/transaction records for "object assignment record"; use similar structure in GENI resource assignment to give "resource usage record" === Adjourn === 3:00pm [[BR]] == Background Reading == [http://groups.geni.net/geni/wiki/GeniInstMeas I&M integration wiki][[BR]] [http://groups.geni.net/geni/wiki/GENIIandMCAPCAT GENI I&M Capabilities Catalog][[BR]] [http://groups.geni.net/geni/wiki/GeniInstrumentationandMeasurementsArchitecture GENI I&M Architecture document][[BR]]