GENI Instrumentation and Measurement (I&M) Tools

Contacts

GPO System Engineer: ​Harry Mussman

Mail list: ​mail to inst-meas-wg@geni.net / ​subscribe / ​mailman archive

Scope

Scope: Discuss, develop and build consensus around the architectural framework for the instrumentation and measurement infrastructure that will be deployed and used in GENI.

Objectives

Objectives:

Create an architecture for measurement that enables GENI goals to be achieved, document and refine
Facilitate dialog and coordination between teams focused on I&M
Identify key challenges in I&M that could otherwise inhibit the infrastructure
Solicit feedback from users
Communicate via mailing list, wiki, GECs

Roadmap

Meetings and Presentations

• GENI Measurement Workshop, UW-Madison, 26 June, 2009

• Instrumentation and Measurement WG Meeting at the GEC-6, Wednesday, November 18, 2009, 9am - 11am, Agenda and Notes
• ​Instrumentation and Measurement WG Meeting at the GEC-6, Summary Report

• Instrumentation and Measurement WG Meeting at the GEC-7, Wednesday, March 17, 3:30pm - 5:30pm, Agenda and Notes
• ​Instrumentation and Measurement WG Meeting at the GEC-7, Summary Report

• 2nd GENI Instrumentation and Measurement Workshop, June 8 - 9, 2010
• ​2nd GENI Instrumentation and Measurement Workshop, Summary Report and Priority Topics

• Instrumentation and Measurement WG Meeting at the GEC-8, Thursday, July 22, 9:00am - 10:30am, Agenda and Notes
• ​Instrumentation and Measurement WG Meeting at the GEC-8, Summary Report

• 3rd Instrumentation and Measurement Workshop at the GEC-9, Tuesday, November 2, 9:00am - 12noon, Agenda and Notes

• Instrumentation and Measurement WG Meeting at the GEC-9, Thursday, November 4, 9:00am - 10:30am, Agenda and Notes
• ​Instrumentation and Measurement WG Meeting at the GEC-9, Summary Report

• Instrumentation and Measurement Summary at the GEC-10, Tuesday, March 15, 12noon - 1pm, Agenda and Notes
• Instrumentation and Measurement Working Session at the GEC-10, Thursday, March 17, 1pm - 4pm, Agenda and Notes
• Instrumentation and Measurement Working Session at the GEC-10, Summary Report

• Instrumentation and Measurement Working Session at the GEC-11, Thursday, July 28, 1pm - 3pm, Agenda and Notes

• ​Instrumentation and Measurement Working Session at the GEC-12, Wednesday, November 2, 8:30am - 12noon, Agenda and Notes

---

Available GENI I&M Tools

The GENI I&M Capabilities Catalog identified several available tools at the start of Spiral 2. Throughout Spiral 2, these tools have continued to mature, and several were ready for use by the beginning of Spiral 3.

Tutorials covering four available tools were given in the 3rd I&M Workshop at GEC9, and one was given at GEC10.

INSTOOLS: Instrumenting and Monitoring Slices

Jim Griffioen and Hussamuddin Nasir (University of Kentucky) ​Slides

OML Tutorial

Jolyon White (NICTA) ​Slides

perfSONAR Tutorial

Martin Swany and Guilherme Fernandes (University of Delaware) ​Tutorial

OnTimeMeasure Tutorial

Prasad Calyam (The Ohio State University) ​Slides

Measurement Data Archive Tutorial

​MeasurementData Archive (MDA) prototype design
​GENI Proposed Services Poster CNRI displayed this poster during the GEC10 held in San Juan, PR
​Link to Measurement Data Archive Prototype
​Measurement Data Archive Prototype Video A video demonstration of the MDA Prototype

The community is invited to start using these tools, and provide comments, additions or changes to their developers.

---

Additional References

• ​Paul Barford (Ed), "GENI Instrumentation and Measurement Systems (GIMS) Specification," GENI Design Document 06-12, Facility Architecture Working Group, September 2006.

• Early work on GENI Instrumentation and Measurement Service (GIMS)

• ​"Requirements and Specification for an Instrumentation and Measurement System for GENI", May 11, 2009, Paul Barford et. al.

• Vision for GENI I&M (per Barford on 11/18/09)
  instrumentation and measurement systems provide broad data gathering, analysis and archieval capability
  sufficient for scientific mission
  sufficient for operations
  key for success of the infrastructure
  

• Requirementsfor for GENI I&M (initial view) (per Barford on 11/18/09)
  measure details of GENI behavior with high precision and accuracy
  no impact on experiments
  ubiquitous
  extensible
  large capacity
  high availability
  resilient
  strong access control
  tight integration with CFs
  

• Conceptual strawman (per Barford on 11/18/09)
  instrumentation - taps in the metwork and systems that provide basic signals
  collection and synthesis - programmable systems that collect, combine and transform basic signals
  archieve - measurement data index and repository
  

• ​DatCat project, that provides a catalog that indexes Internet measurement data, which you can then find, annotate, and cite.

• Contributions on ​CRAWDAD project at Dartmouth College , provided via email on March 30, 2009, by David Kotz – Dartmouth College at CRAWDAD_Experience.
  

---

New to Instrumentation and Measurement

• ​Introduction for Newcomers to GENI I&M WG
• GENI Working Groups
• Getting started on the GENI Wiki
• Documents published by the GENI Project Office
• GENI Spiral 1
• GENI Spiral 2
• GENI Glossary