Changes between Initial Version and Version 1 of GENIMetaOps-Q2-status

Timestamp:

06/07/10 10:52:17 (14 years ago)

Author:

jtaylor@bbn.com

Comment:

--

GENIMetaOps-Q2-status

@@ +1 @@
+[[PageOutline]]
+
+= GMOC Project Status Report = 
+
+Period: Q2
+
+== Summary ==
+  * Operating within Budget
+  * Operational Data actively being collected from !PlanetLab
+  * Dataset Discussions underway with all clusters
+  * Operational Dataset Document shared with all clusters and OMIS, mature enough for sharing work to being
+  * GMOC Internal Data Format Document created
+  * GMOC Data Exchange Format Document created
+== I. Major accomplishments ==
+
+=== A. Milestones achieved ===
+''__Actively sharing operational data with !PlanetLab:__'' Based on our conversation
+with the !PlanetLab cluster participants, there was consensus that we should
+begin by gathering existing data from !PlanetLab Central. GMOC visited
+Princeton to discuss this in detail, using our operational dataset document as a
+guide. The result is that we are now actively gathering data from !PlanetLab,
+storing it in the format described by our Internal Operational Data Format
+document. This data is still incomplete, in that we are unable to gather some
+topological data, and in that it is only data covering the !PlanetLab project itself,
+not data about other projects within the !PlanetLab cluster. But, it represents
+both a good initial model for quickly beginning to collect data, and a good start
+for gathering data from the !PlanetLab cluster as other projects in the cluster
+begin to integrate more with the !PlanetLab control framework.
+
+''__GMOC Operational Dataset Document:__'' The Operational Dataset document has
+been shared with all GENI control frameworks, and we’ve updated this
+document based on input. This document is now mature enough that we’ve
+begun to use it to work with projects to begin gathering operational data.
+
+''__GMOC Operational Data Format Document:__'' Initial versions of two documents
+have been created and shared with the GENI community, related to this. First,
+we’ve created a document that describes the internal data format schema we’ve
+developed for storing operational data we collect. Second, we’ve created a
+document that describes the data exchange methodology we hope to employ as
+GENI evolves to gather data from GENI projects, and to share data about GENI
+with other federated networks such as internationals. These documents are
+open to input from the community, but we believe these will require less
+collaboration at this point than our operational dataset document. This is
+because initially the formats used to exchange data with most projects will be
+highly customized for each project.
+
+=== B. Deliverables made ===
+''__Updated Operational Dataset Document:__'' Several new versions of the evolving
+GMOC Operational Dataset Document were created, incorporating the input
+from other GENI projects and clusters.
+
+''__GMOC Internal Operational Data Format Description Document:__'' A new
+document describing the format GMOC will use to store operational data was
+created.
+
+''__GMOC Operational Data Exchange Draft Document:__'' A document describing our
+approach to data exchange with other projects has been created.
+
+== II. Description of work performed during last quarter ==
+
+=== A. Activities and findings ===
+Our activities during Q2 were spent working in depth with control framework
+clusters and other stakeholders to do two things: gather input on our strawman
+operational dataset document, and to understand in technical detail what each
+cluster could provide and how.
+
+This resulted in conversations with staff from every cluster, along with several
+projects within clusters, and with Steve Schwab to discuss how security and
+operational data sharing might begin to interface and interact.
+
+Further details about findings and activities can be found in
+Milestone/Deliverables description, and in the Collaborations sections of this
+document.
+=== B. Project participants ===
+During this time, key participants in GMOC included:
+
+Jon-Paul Herron, PI[[BR]]
+Luke Fowler, Co-PI[[BR]]
+Chris Small, Senior GMOC Engineer[[BR]]
+Camilo Viecco[[BR]]
+Dan Doyle, Undergraduate[[BR]]
+
+=== C. Publications (individual and organizational) ===
+Herron, JP. (2009, March 24-25). The GENI Meta-Operations Center.
+Presented at National Lambda Rail All-Hands Meeting, CalIT2, San Diego, CA.
+
+This presentation focused on challenges of operations in a federated/distributed
+world, and how operations for GENI relate to the future of operations for
+production networks.
+
+__GENI Documents:__
+
+Herron, JP. The GMOC Operational Dataset.
+
+This is a document produced to understand the initial set of data GMOC hopes to gather from GENI projects.
+
+Viecco, C. The GMOC Internal Data Format.
+
+This document lays out the schema and format GMOC will use to store all operational data format.
+
+Viecco, C. GMOC Data Exchange.
+
+This document describes a methodology moving forward to describe how projects and GMOC might share data (other than utilization)
+
+=== D. Outreach activities ===
+__Undergraduate Development Assistance:__ Dan Doyle, an undergraduate for the
+IU Computer Science department continued to assist with research activities
+into GENI projects and existing data sharing options. A second undergraduate
+position is available but has not yet been filled.
+
+GMOC attended the IU Informatics Career Fair on Feb 17 to advertise available
+positions for undergraduate students and discuss the GENI/GMOC projects with
+IU undergraduates as part of our outreach efforts
+
+=== E. Collaborations ===
+
+Similar to Q1, GMOC worked on gathering input and developing discussions
+with many GENI stakeholders during this quarter.
+
+__!PlanetLab:__ After discussion about GMOC with !PlanetLab cluster participants,
+GMOC staff visited Princeton to discuss overall operational data sharing
+strategy and detailed capabilities for collaboration. This resulted in further
+collaboration between GMOC and !PlanetLab staff to enable active data sharing.
+
+__ProtoGENI:__ GMOC discussed the strawman GMOC Operational Dataset
+document with the ProtoGENI cluster participants. There were some comments
+from this discussion on the document, and further discussions between GMOC
+and ProtoGENI developers on potential capabilities are underway. A visit with
+ProtoGENI may be useful, as the !PlanetLab visit was.
+
+__ORCA:__ GMOC spoke directly with Jeff Chase to cover the strawman GMOC
+Operational Dataset document, and discuss future collaboration. We made
+plans for immediate sharing from the ORCA monitoring software and topology
+of some projects. Additionally, we talked about some future collaboration on
+the issue of topology description, and exchange.
+
+__ORBIT:__ ORBIT has provided GMOC some preliminary data output. Further
+discussions will be needed to gather improved data.
+
+__Mid-Atlantic Crossroads/DRAGON:__ GMOC is working with MAX to understand
+how to gather operational data from projects. We are working with MAX to
+understand what data we can/should gather via MAX’s integration with the !PlanetLab control framework, and what data we can/should gather directly from MAX
+
+__NLR:__ GMOC has discussed operational dataset sharing with NLR, and now has
+full capability to gather full initial operational dataset from the NLR GENI
+elements, once it is in use.
+
+__Internet2:__ GMOC has discussed operational dataset sharing with I2, using the
+GRNOC’s existing access to Internet2 data. This data is all accessible for GENI
+use, so we are prepared to gather full initial operational data from Internet2’s
+GENI elements, once this is in use.
+
+__PerfSONAR:__ GMOC has opened an ongoing dialogue with the PerfSONAR
+project, which has already made significant progress in the areas of sharing data
+among production networks. Specifically, PerfSONAR would provide a
+potentially useful default method for projects to share operational data with
+GMOC, or for GMOC to share its data with other federated networks. It
+contains a topology description
+
+=== Planned Activities for Q3 ===
+__Ramp-up of Cluster sharing:__ During Q3 we plan to accelerate our discussions
+with GENI projects to begin gathering data from many projects by GEC5. In
+most cases, this will follow the basic successful model used with the !PlanetLab
+project, using detailed one on one interaction to understand methods and
+capabilities.
+
+__Initial GENI-wide view of operations:__ For GEC5, we plan to develop a
+demonstration of the GMOC operational data view, using some basic
+visualization and data gathered from a broad spectrum of GENI projects. This
+will be the initial proof of concept.
+
+__Initial Investigation of visualization for GENI operations:__ Part of the effort for
+initial GMOC operational data view will require investigation into the best
+methods to visualize the complex, virtualized and federated GENI. A single
+simple “weathermap” won’t work. This provides us an opportunity to reexamine
+methods of visualization for networks and research.
+
+__Finalization of First version of GMOC Documents:__ We’ll also work to bring the
+current versions of the documents describing the operational dataset and the
+formats for exchange and storage of operational data, using this current version
+to build our data-view, and continue to work with projects to gather more and better operational data. New versions will no doubt be needed, but we will need to finalize this version enough to use them as a guide for our work.
+
+[[BR]]
+Converted submitted file by Julia Taylor (jtaylor@bbn.com). Original file can be found [http://groups.geni.net/geni/attachment/wiki/GENIMetaOps/GMOC%20QR%20-Q2.pdf?format=raw here]