[[PageOutline]] = Instrumentation and Measurement (I&M) Working Session = Thursday, July 28, 2011, 1:00pm - 3:00pm [[BR]] Room: [[BR]] Session Leader: Harry Mussman, (GPO, Raytheon BBN Technologies) [[BR]] == Description == This session will review the latest DRAFT of the measurement_data_object_descriptor, commonly known as "metadata"; review the status of current I&M tools and services; and review new topics and next steps. [[BR]] == Summary == [ slides] [[BR]] == Agenda == This is a tentative agenda, which may change. [[BR]] === 1) Introductions === 1:00pm [[BR]] === 2) Measurement Data Object Descriptor (MDOD) === 1:05pm [[BR]] Harry Mussman[[BR]] ==== 2.1) Overview ==== ==== 2.2) Use Cases ==== Read the following sections of the [http://groups.geni.net/geni/attachment/wiki/GeniInstrumentationandMeasurementsArchitecture/122010i%20GENI-SE-IM-ARCH-1.0.doc Architecture document:[[BR]] 4.5 GATHERING, TRANSFERRING AND SHARING MD [[BR]] 4.5.1 Schema and Provenance of MD [[BR]] 4.5.2 Gathering MD into a Slice [[BR]] 4.5.3 Transferring MD between I&M Services in the Same Slice [[BR]] 4.5.4 Transferring MD between I&M Services in Different Slices [[BR]] 4.5.5 Sharing MD with Others Use these [http://groups.geni.net/geni/attachment/wiki/GeniInstrumentationandMeasurementsArchitecture/Visio-4.x%20%20030911%20_IM-ARCH-Figures.pdf figures][[BR]] A summary of the topic is presented in these [http://groups.geni.net/geni/attachment/wiki/GEC10InstMeasWorkingSession/031711_GatheringTransferringMD_I%26MArch_Overview.pptx slides][[BR]] See: I&M in Experimenter's Slice See: I&M in Operator's Infrastructure Measurement Slice ==== 2.3) Content (Semantics) ==== Read the following sections of the [http://groups.geni.net/geni/attachment/wiki/GeniInstrumentationandMeasurementsArchitecture/122010i%20GENI-SE-IM-ARCH-1.0.doc Architecture document:] [[BR]] 8 SCHEMA AND ELEMENTS FOR MEASUREMENT DATA OBJECT DESCRIPTORS (MDODS) [[BR]] 8.1 MEASUREMENT DATA OBJECTS (MDOS) [[BR]] 8.2 MEASUREMENT DATA (MD) OBJECT DESCRIPTOR [[BR]] 8.2.1 Uses [[BR]] 8.2.2 One Data Model [[BR]] 8.2.3 Multiple Schemas [[BR]] 8.3 MD OBJECT DESCRIPTOR DATA MODEL [[BR]] 8.3.1 Vocabulary [[BR]] 8.3.2 Identifier Elements [[BR]] 8.3.3 Interoperability Elements: [[BR]] 8.3.4 Discovery Elements [[BR]] 8.3.5 Administrative Elements: [[BR]] 8.3.6 Mapping into Descriptors from GENI MD Schemas [[BR]] 8.4 MD OBJECT DESCRIPTOR SCHEMAS [[BR]] 8.4.1 File Schema [[BR]] 8.4.2 MI Registration Schema [[BR]] 8.4.3 Archive Schema [[BR]] A summary of the topic is presented in these [http://groups.geni.net/geni/attachment/wiki/GEC10InstMeasWorkingSession/031711_MDObjectsDescriptors%20_I%26MArch_Overview.pptx slides][[BR]] DRAFT ver0.2 MDOD Data Model, Elements and Values: [[BR]] ==== 2.4) Supported Object Types ==== Instrumentation Tools (Kentucky) [[BR]] OMF/OML (NICTA) [[BR]] perSONAR/LAMP (Delaware, I2) [[BR]] OnTimeMeasure (Ohio State) [[BR]] Scalable Sensing Service? (Purdue, HP Labs) [[BR]] GMOC? (Indiana)[[BR]] NetCDF?[[BR]] others? [[BR]] ==== 2.5 Next Steps ==== === 3) Current I&M Design and Prototyping Efforts === 1:35pm [[BR]] ==== 3.1) Instrumentation Tools (Kentucky) ==== (Each one slide, or less) Summary and status Intended use(s): experimenter's slice? operator's infrastructure measurement slice? Creates or includes info for MDOD? mapping to MDOD elements? object_format? interpretation_method? Includes (or requires) persistent operational services? Status of integration with MDA service? issues? Authorization methods supported and/or issues? ==== 3.2) OMF/OML (NICTA) ==== (Each one slide, or less) Summary and status Intended use(s): experimenter's slice? operator's infrastructure measurement slice? Creates or includes info for MDOD? mapping to MDOD elements? object_format? interpretation_method? Includes (or requires) persistent operational services? Status of integration with MDA service? issues? Authorization methods supported and/or issues? ==== 3.3) perSONAR/LAMP (Delaware, I2) ==== (Each one slide, or less) Summary and status Intended use(s): experimenter's slice? operator's infrastructure measurement slice? Creates or includes info for MDOD? mapping to MDOD elements? object_format? interpretation_method? Includes (or requires) persistent operational services? Status of integration with MDA service? issues? Authorization methods supported and/or issues? ==== 3.4) OnTimeMeasure (Ohio State) ==== (Each one slide, or less) Summary and status Intended use(s): experimenter's slice? operator's infrastructure measurement slice? Creates or includes info for MDOD? mapping to MDOD elements? object_format? interpretation_method? Includes (or requires) persistent operational services? Status of integration with MDA service? issues? Authorization methods supported and/or issues? ==== 3.5) Meas Data Archive (MDA) Prototype Service ==== (Each one slide, or less) Summary and status Intended use(s): experimenter's slice? operator's infrastructure measurement slice? Creates or includes info for MDOD? mapping to MDOD elements? object_format? interpretation_method? Includes (or requires) persistent operational services? Status of integration with MDA service? issues? Authorization methods supported and/or issues? ==== 3.6) Others? ==== Scalable Sensing Service? (Purdue, HP Labs) [[BR]] GMOC? (Indiana)[[BR]] I&M services for Experimenters, including: [[BR]] Instrumentation Tools (for use with protoGENI) [[BR]] OMF/OML [[BR]] LAMP (uses perfSONAR technology, for use with protoGENI) [[BR]] OnTimeMeasure (for use with protoGENI or PlanetLab) [[BR]] I&M services for monitoring infrastructure, including: [[BR]] Measurement System, for packet capture [[BR]] Shadownet, for router monitoring [[BR]] Scalable Sensing Service [[BR]] Measurement Data Archive (MDA) service [[BR]] First prototype by CNRI, including User Workspace (UW) service and Digital Object Archive (DOA) service [[BR]] Management of an I&M service, from Measurement Orchestration (MO) service: [[BR]] First prototype by IMF and ERM projects, following OMF approach [[BR]] Measurement Data Objects, and Descriptors (“metadata”): [[BR]] Defining common data model, then schemas [[BR]] First prototype software by ? [[BR]] Measurement traffic flows, proxies/mechanisms) to reach servers in private address space [[BR]] First prototype of ssh access by ORCA project [[BR]] [http://groups.geni.net/geni/attachment/wiki/GEC10InstMeasWorkingSession/031711_CurrentStatus%20_I%26MArch_Overview.pptx slides] [[BR]] Is anything missing? [[BR]] Next steps? [[BR]] === 6) I&M Service Deployments === 3:50pm [[BR]] Current I&M services for Experimenters, including: [[BR]] Instrumentation Tools (for use with protoGENI) [[BR]] OMF/OML [[BR]] LAMP (uses perfSONAR technology, for use with protoGENI) [[BR]] OnTimeMeasure (for use with protoGENI or PlanetLab) [[BR]] Introduce I&M services for monitoring infrastructure, including: [[BR]] perfSONAR components, with Measurement Information (MI) service, and first use of Measurement Data Object Descriptors (MDOD’s)? Who? [[BR]] Measurement System for packet capture? [[BR]] Scalable Sensing Service? [[BR]] Introduce Measurement Data Archive (MDA) service: [[BR]] Include User Workspace (UW) service [[BR]] Include Digital Object Archive (DOA) service [[BR]] Who are first users? [[BR]] Are there other uses, e.g., software downloads? [[BR]] When ready to support Researchers? [[BR]] [http://groups.geni.net/geni/attachment/wiki/GEC10InstMeasWorkingSession/031711_CurrentStatus%20_I%26MArch_Overview.pptx slides] [[BR]] Discussion [[BR]] Can we build a guide? [[BR]] === Adjourn === 3:00pm [[BR]] == Background Reading == [http://groups.geni.net/geni/wiki/GeniInstMeas I&M integration wiki][[BR]] [http://groups.geni.net/geni/wiki/GENIIandMCAPCAT GENI I&M Capabilities Catalog][[BR]] [http://groups.geni.net/geni/wiki/GeniInstrumentationandMeasurementsArchitecture GENI I&M Architecture document][[BR]]