[[PageOutline]] = GENI Instrumentation and Measurement Working Group = == Charter == '''Scope:''' Discuss, develop and build consensus around the architectural framework for the instrumentation and measurement infrastructure that will be deployed and used in GENI. '''Chairs:''' [mailto:pb@cs.wisc.edu Paul Barford] [mailto:bmm@cs.duke.edu Bruce Maggs] '''GPO System Engineer:''' [mailto:hmussman@bbn.com Harry Mussman] '''Mail list:''' [mailto:inst-meas-wg@geni.net mail to inst-meas-wg@geni.net] / [http://lists.geni.net/mailman/listinfo/inst-meas-wg subscribe] / [http://lists.geni.net/pipermail/inst-meas-wg/ mailman archive] '''Objectives:''' Create an architecture for measurement that enables GENI goals to be achieved, document and refine[[BR]] Facilitate dialog and coordination between teams focussed on I&M[[BR]] Identify key challenges in I&M that could otherwise inhibit the infrastructure[[BR]] Solicit feedback from users[[BR]] Communicate via mailing list, wiki, GECs[[BR]] ---- == Announcements == ---- == Meeting Minutes and Presentations == * [wiki:GENIMeasWS GENI Measurement Workshop, UW-Madison, 26 June, 2009] * [wiki:GEC6InstMeasWGAgenda Instrumentation and Measurement WG Meeting at the GEC-6, Wednesday, November 18, 2009, 9am - 11am, Agenda and Notes] * [http://groups.geni.net/geni/attachment/wiki/GEC6OutbriefsAgenda/111809%20report%20GEC%206%20WGInstAndMeas%20mtg.pdf Instrumentation and Measurement WG Meeting at the GEC-6, Summary Report] * [wiki:Gec7InstMeasWGAgenda Instrumentation and Measurement WG Meeting at the GEC-7, Wednesday, March 17, 3:30pm - 5:30pm, Agenda and Notes] * [http://groups.geni.net/geni/attachment/wiki/Gec7InstMeasWGAgenda/031710%20WGInstAndMeas_Report.ppt Instrumentation and Measurement WG Meeting at the GEC-7, Summary Report] * [wiki:2ndInstMeasWork 2nd GENI Instrumentation and Measurement Workshop, June 8 - 9, 2010] * [http://groups.geni.net/geni/attachment/wiki/Gec8InstMeasWGAgenda/070610%20%20IM-Workshop_%20ARCH-GEC8Slides.ppt 2nd GENI Instrumentation and Measurement Workshop, Summary Report and Priority Topics] * [wiki:Gec8InstMeasWGAgenda Instrumentation and Measurement WG Meeting at the GEC-8, Thursday, July 22, 9:00am - 10:30am, Agenda and Notes] * [http://groups.geni.net/geni/attachment/wiki/Gec8InstMeasWGAgenda/072210%20%20Wrapup%20GEC8%20WGInstAndMeas.ppt Instrumentation and Measurement WG Meeting at the GEC-8, Summary Report] * [wiki:Gec9InstMeasWorkshopAgenda 3rd Instrumentation and Measurement Workshop at the GEC-9, Tuesday, November 2, 9:00am - 12noon, Agenda and Notes] * [wiki:Gec9InstMeasWGAgenda Instrumentation and Measurement WG Meeting at the GEC-9, Thursday, November 4, 9:00am - 10:30am, Agenda and Notes] * [http://groups.geni.net/geni/attachment/wiki/GeniInstMeas/110410%20Wrapup%20%20GEC9_Agenda_WGMtgInstAndMeas.ppt Instrumentation and Measurement WG Meeting at the GEC-9, Summary Report] ---- == Work-in-Progress == === [wiki:GENIIandMCAPCAT GENI I&M Capabilities Catalog] === A v0.1 DRAFT has been completed by the GPO, and includes overview slides, a spreadsheet of the catalog, and drawings from referenced projects. [[BR]] This document reviews each current GENI I&M project, and other selected projects, and lists:[[BR]] Architecture components addressed or implemented[[BR]] Implementations in GENI, or elsewhere[[BR]] Uses in GENI, or elsewhere[[BR]] The purpose is to:[[BR]] Identify projects that can best contribute to architecture topics[[BR]] Identify projects that can implement enhanced GENI capabilities in Spiral 2[[BR]] === [wiki:GeniInstrumentationandMeasurementsArchitecture GENI I&M Architecture Document] === An effort is underway to define and document the GENI Instrumentation and Measurements Architecture. Plan:[[BR]] + Completed by GEC7: v0.1 DRAFT, by GPO [[BR]] + Completed by GEC8: v0.5 DRAFT, by GPO, with revised outline and contributions after 2nd workshop[[BR]] + In preparation: v1.0 DRAFT, including contributions from WG[[BR]] A first DRAFT (v0.1) was completed by the GPO: [http://groups.geni.net/geni/attachment/wiki/GeniInstrumentationandMeasurementsArchitecture/030810%20%20GENI-SE-IM-ARCH-0.1.pdf GENI I&M Architecture (Document ID: GENI-SE-IM-ARCH-0.1, Date: March 8, 2010)] [[BR]] This DRAFT includes proposed I&M services and a proposed configuration [[BR]] [[BR]] A second DRAFT (v0.5) was completed by the GPO, with input from the 2nd I&M Workshop: [http://groups.geni.net/geni/attachment/wiki/GeniInstrumentationandMeasurementsArchitecture/072210%20%20GENI-SE-IM-ARCH-0.5.pdf GENI I&M Architecture (Document ID: GENI-SE-IM-ARCH-0.5, Date: July 22, 2010)] [[BR]] This DRAFT has a revised outline: [[BR]] A third DRAFT (v1.0) is in preparation, with input from the WG. [[BR]] The community is invited to help prepare and review this draft, and provide comments, additions or changes to the Inst&Meas WG SE, Harry Mussman, at hmussman@bbn.com === [wiki:GeniIandMServices Task: Define GENI I&M Services] === === [wiki:GeniMeasurementDataSchema Task: Define GENI Interfaces, Protocols and Schema for Measurement Data] === === [wiki:GeniIandMUseCases Task: Define GENI I&M Use Cases] === === [wiki:GeniMeasurementPlane Task: Define GENI Measurement Plane] === ---- == References == * First DRAFT (v0.1) of [wiki:GeniInstrumentationandMeasurementsArchitecture GENI I&M Architecture document], including configuration drawing [[BR]] * First DRAFT (v0.1) of GENI I&M Capabilities Catalog, including: [[BR]] [http://groups.geni.net/geni/attachment/wiki/GENIIandMCAPCAT/031010%20%20IM-CAPCAT-GEC7Slides.pdf overview slides] [[BR]] [http://groups.geni.net/geni/attachment/wiki/GENIIandMCAPCAT/031010%20I%26MCapabilityCatalog-0.1.xls spreadsheet of catalog] [http://groups.geni.net/geni/attachment/wiki/GENIIandMCAPCAT/031010large%20I%26MCapabilityCatalog-0.1.pdf pdf of spreadsheet] [[BR]] [http://groups.geni.net/geni/attachment/wiki/GENIIandMCAPCAT/Visio-031010%20%20IM-CapCatalog-Figures-0.1.pdf drawings from referenced projects] [[BR]] * [http://groups.geni.net/geni/attachment/wiki/OldGPGDesignDocuments/GDD-06-12.pdf Paul Barford (Ed), "GENI Instrumentation and Measurement Systems (GIMS) Specification," GENI Design Document 06-12, Facility Architecture Working Group, September 2006.] * [wiki:GIMS Early work on GENI Instrumentation and Measurement Service (GIMS)] * [http://groups.geni.net/geni/attachment/wiki/MeasurementSystem/MeasurementSysSpec.pdf "Requirements and Specification for an Instrumentation and Measurement System for GENI", May 11, 2009, Paul Barford et. al.] * Vision for GENI I&M (per Barford on 11/18/09)[[BR]] instrumentation and measurement systems provide broad data gathering, analysis and archieval capability[[BR]] sufficient for scientific mission[[BR]] sufficient for operations[[BR]] key for success of the infrastructure[[BR]] * Requirementsfor for GENI I&M (initial view) (per Barford on 11/18/09)[[BR]] measure details of GENI behavior with high precision and accuracy[[BR]] no impact on experiments[[BR]] ubiquitous[[BR]] extensible[[BR]] large capacity[[BR]] high availability[[BR]] resilient[[BR]] strong access control[[BR]] tight integration with CFs[[BR]] * Conceptual strawman (per Barford on 11/18/09)[[BR]] instrumentation - taps in the metwork and systems that provide basic signals[[BR]] collection and synthesis - programmable systems that collect, combine and transform basic signals[[BR]] archieve - measurement data index and repository[[BR]] * [http://www.datcat.org/ DatCat project], that provides a catalog that indexes Internet measurement data, which you can then find, annotate, and cite. * Contributions on [http://crawdad.cs.dartmouth.edu/ CRAWDAD project] at Dartmouth College , provided via email on March 30, 2009, by David Kotz – Dartmouth College at [wiki:CRAWDAD_Experience]. [[BR]] * [http://groups.geni.net/geni/wiki/ORBIT ORBIT project] [[BR]] * [http://omf.mytestbed.net/projects/show/oml OML Overview (wiki)][[BR]] * [http://groups.geni.net/geni/attachment/wiki/ClusterE/OML%20%20-%20oct%2009.pdf OML Overview (slides)][[BR]] * [http://groups.geni.net/geni/wiki/DOR Digital Object Registry project] [[BR]] * [http://groups.geni.net/geni/attachment/wiki/DigitalObjectRegistry/GENI-ExptMngmntSvc.pdf DOR based GENI Experiment Management Service (slides)] [[BR]] ---- == New to the Instrumentation and Measurement WG? == * [http://groups.geni.net/geni/attachment/wiki/GeniInstMeas/110210%20Day%201%20-%20Newcomers%20-%20WGInstAndMeas.ppt Introduction for Newcomers to GENI I&M WG] * [GeniWorkingGroups GENI Working Groups] * [GeniWikiGettingStarted Getting started on the GENI Wiki] * [GpoDoc Documents published by the GENI Project Office] * [SpiralOne GENI Spiral 1] * [SpiralTwo GENI Spiral 2] * [GeniGlossary GENI Glossary]