Instrumentation and Measurement Working Group meeting at GEC6: Wednesday, November 18, 9am - 11am Welcome and introduction: Paul Barford, University of Wisconsin, WG Co-Chair Approximately 33 attendees. Initial view of I&M vision, requirements, strawman, and WG Objectives for Spiral 2: Paul Barford, University of Wisconsin, WG Co-Chair [http://groups.geni.net/geni/attachment/wiki/GEC6InstMeasWGAgenda/geni_imwg_11_09.pdf slides] Brief history of GENI I&M Vision for GENI I&M instrumentation and measurement systems provide broad data gathering, analysis and archieval capability[[BR]] sufficient for scientific mission[[BR]] sufficient for operations[[BR]] key for success of the infrastructure[[BR]] Requirements[[BR]] measure details of GENI behavior with high precision and accuracy[[BR]] no impact on experiments[[BR]] ubiquitous[[BR]] extensible[[BR]] large capacity[[BR]] high availability[[BR]] resilient[[BR]] strong access control[[BR]] tight integration with CFs[[BR]] Conceptual strawman[[BR]] instrumentation - taps in the metwork and systems that provide basic signals[[BR]] collection and synthesis - programmable systems that collect, combine and transform basic signals[[BR]] archieve - measurement data index and repository[[BR]] Instrumentation[[BR]] link sensors - deployed on network links via taps, provide basic link signals[[BR]] node sensors - deployed on all systems , provide basic utilization/state/configuration data[[BR]] time sensors - deployed at all sites, provide fine-grained, synchronized timestamps[[BR]] Collection and synthesis[[BR]] programmable systems connected to sensors[[BR]] transform basic signals into data suitable for more stnadard analysis[[BR]] transformations can be more sophisticated[[BR]] select/transfer protocol moves data from node sensors[[BR]] short term storage capability[[BR]] Data archieve[[BR]] high capacity data repositroy deployed[[BR]] data catalog[[BR]] Security and access control[[BR]] only accessible by authorized users[[BR]] different views depending on authorization level[[BR]] secure[[BR]] private[[BR]] some mechanisms defined by CF[[BR]] Objectives of I&M WG[[BR]] create an architecture for measuremnt that ensables GENI goals to be achieved, document and refine[[BR]] facilitate dialog and coordination between tams focussed on I&M[[BR]] identify key challenges in I&M that could otherwise inhibit the infrastructure[[BR]] solicit feedback from users[[BR]] mailing list, wiki, GECs[[BR]] Short presentations by Spiral 2 projects involving instrumentation and measurement design and prototyping, including: 1) title and team, 2) Spiral 2 objectives, 3) challenges, and 4) proposed approach (approx 7min) [[BR]] [http://groups.geni.net/geni/wiki/MeasurementSystem Instrumentation and Measurement for GENI (1628)] PI: Paul Barford [http://groups.geni.net/geni/attachment/wiki/GEC6InstMeasWGAgenda/geni_gims_11_17.pdf slides] [http://groups.geni.net/geni/wiki/InstrumentationTools Instrumentation Tools for a GENI Prototype (1642)] PI: James Griffioen [http://groups.geni.net/geni/attachment/wiki/GEC6InstMeasWGAgenda/UK_IMWG_11-2009.pdf slides] [http://groups.geni.net/geni/wiki/OnTimeMeasure OnTimeMeasure: Centralized and Distributed Measurement Orchestration Software (1764)] PI: Prasad Calyam [http://groups.geni.net/geni/attachment/wiki/GEC6InstMeasWGAgenda/Calyam_OnTimeMeasure-GENI_GEC6.pdf slides] [http://groups.geni.net/geni/wiki/LAMP Leveraging and Abstracting Measurements with perfSONAR (LAMP)(1788)] PI: Martin Swany [http://groups.geni.net/geni/attachment/wiki/GEC6InstMeasWGAgenda/20091118-LAMP-GENI-IMWG.pdf slides] [http://groups.geni.net/geni/wiki/ScalableMonitoring Scalable, Extensible, and Safe Monitoring of GENI (1723)] PI: Sonia Fahmy [http://groups.geni.net/geni/attachment/wiki/GEC6InstMeasWGAgenda/gec6-inst-fahmy.pdf slides] [http://groups.geni.net/geni/wiki/VMI-FED Virtual Machine Introspection and Development of a Model Federation Framework for GENI (1773)] PI: Kara Nance (delegate: Brian Hay) [http://groups.geni.net/geni/attachment/wiki/GEC6InstMeasWGAgenda/HayUAF-GEC6-IM-WG.pdf slides] [http://groups.geni.net/geni/wiki/Embedded%20Real-Time%20Measurements Embedding real-time substrate measurements for cross-layer communications (1631)] PI: Keren Bergman (delegates: Caroline Lai and Michael Wang) [http://groups.geni.net/geni/attachment/wiki/GEC6InstMeasWGAgenda/GEC6_ERM_MeasurementWorkGroup.pdf slides] [http://groups.geni.net/geni/wiki/LEARN Programmable Measurements over Texas-based Research Network: LEARN (1733)] PI: Deniz Gurkan [http://groups.geni.net/geni/wiki/IMF Integrated Measurement Framework and Tools for Cross Layer Experimentation (1718)] PI: Rudra Dutta (delegate: Ilia Baldine, co-PI) [http://groups.geni.net/geni/attachment/wiki/GEC6InstMeasWGAgenda/GEC6-ilia-imf-intro.pdf slides] [http://groups.geni.net/geni/wiki/ORBIT ORBIT Measurement Library (OML)(p/o ORBIT project, 1660)] PI: Marco Gruteser (Co-PIs: Max Ott and Ivan Seskar) [http://groups.geni.net/geni/attachment/wiki/GEC6InstMeasWGAgenda/OML%20%20-%20oct%2009.pdf slides] [http://omf.mytestbed.net/projects/show/oml web] [http://groups.geni.net/geni/attachment/wiki/GEC6InstMeasWGAgenda/discussion%20points%20%20%20geni_imwg_11_09.pdf Discussion of WG Objectives for Spiral 2] Paul Barford, University of Wisconsin, WG Co-Chair Objectives of I&M WG (from above) create an architecture for measuremnt that ensables GENI goals to be achieved, document and refine[[BR]] facilitate dialog and coordination between tams focussed on I&M[[BR]] identify key challenges in I&M that could otherwise inhibit the infrastructure[[BR]] solicit feedback from users[[BR]] mailing list, wiki, GECs[[BR]] Comments after presentations: lot of exciting work, many common themes, among current projects Discussion points: what are key components?[[BR]] significant challenges?[[BR]] how should WG be organized?[[BR]] objectives for next year?[[BR]] How should WG be organized? online discussion[[BR]] periodic meetings[[BR]] possibly another workshop[[BR]] Objectives for next year? 1) common schema for measurement data example: see recent datcat project[[BR]] 2) common mechanism for accessing data[[BR]] 3) gather in one document the measurements desired for experiments by other projects, i.e., target problems[[BR]] [http://groups.geni.net/geni/attachment/wiki/GEC6OutbriefsAgenda/111809%20report%20GEC%206%20WGInstAndMeas%20mtg.pdf Wrap up, review of action items and issues for plenary] Harry Mussman - GPO, WG SE 11am Adjourn