wiki:MAX-GENI-Final-Report

Version 1 (modified by tlehman@maxgigapop.net, 10 years ago) (diff)

--

GENI MAX Stitching Project Status Report - Post GEC17

Project Status Report
Project 1658 (MAX)
Final Report
Period of performance
September 10, 2012 - August 31, 2013

I. Major accomplishments

A. Milestones status

MAX: S4.d: Continue to federate the MAX Network with GENI and make it available to GENI experimenters, as well as for testing and demonstrations of network stitching in GENI

  • Implement the GENI RSpec v3
  • Provide resources to experimenter credentials signed by one of the GENI slice authorities

Status:
The MAX AM has been upgraded to be compatible with GENI RSpec v3. The MAX GENI AM is also been federated with ProtoGENI and PlanetLab. Experimenters are able to utilize credentials and slices from those aggregates to instantiate experiments.

MAX: S4.e: Prototype GENI Topology and Path Computation Services

  • Initial Prototype: January 2013
  • Production Ready Service: May 1, 2013
  • Prototype GENI Topology and Path Computation Services (previous SOW is just for a design)

Status:
We have completed a version of the Stitching Computation Service (SCS). This has been utilized for development of the workflow service and is available for general use. A description of the SCS is available here:

The SCS software is available here:

The SCS service was tested as part of the GENI Network Stitching Plan as described here:

The stitching topology service prototype implementation is implemented as part of the computation service. This provides the topology information that the SCS needs, but does not currently provide a generally available query mechanism or an automated update function via GENI AM API calls.

We have also been working with the GEMINI project to utilize their topology services for stitching services. They have implemented the ability to dynamically and automatically obtain topology information from the GENI AM API as well as the existing PerfSonar Topology Service. Additional coordination with the GEMINI group is needed to determine if their topology service will be the basis for a more generally available service. Future topology service functionality will likely be either based on extending what we currently have embedded in the SCS or via utilizing the GEMINI Topology Service.


MAX: S4.f: Prototype shared GENI Stitching Workflow Service, based on Omni libstitch library, and use it from Omni, and make it available to Flack

  • Initial Prototype: February 2013
  • Production Ready Service: May 1, 2013

Status:
The Stitching Computation Service (SCS) includes functionality to generate workflow data as part of experimenter RSpec computation requests. OMNI developers are utilizing this workflow data as input for stitching library which is implemented as part of the OMNI package. This functionality was demonstrated as part of the GENI Network Stitching Test Plan activity noted above, and also demonstrated during GEC 17. The SCS service is available to Flack. We have worked with the Flack developer to get proper Flash security policies running on ION and MAX AM, and allow access to SCS by Flack. There is expected to be continued work in this area to make this part of the standard Flack experience and also associated with the upgrade to Flack to be HTML5 based.


MAX: S4.g: Update MAX/ION AMs to AM API v3 and to work with above services

  • Initial Prototype: March 2013
  • Production Ready Version: May 30, 2013

Status:
We have completed initial design work for the update of the MAX AM API v3. The support for GENI AM APIv3 by other GENI Aggregates (ProtoGENI and ExoGENI) was not available during this time period. As a result we focused on additional stitching activities and are planning to complete the MAX AM APIv3 implementation and upgrade in December 2013.


MAX: S4.h: Demo an InstaGENI and an ExoGENI rack stitched dynamically together using above services across a backbone at GEC16

  • Initial InstaGENI and ExoGENI stitching demonstration: March 2013 (GEC 16)
  • Experimenter ready InstaGENI and ExoGENI stitching capability: May 30, 2013

Status:
We demonstrated stitching between InstaGENI Racks at Utah, ProtoGENI main, and GPO ExoGENI Rack resources connected across ION during GEC17. This included a slice topology with three GENI AMs. The details for this demonstration are available here:

MAX: S4.i: Prototype DYNES/ION proxy AMs (extension of existing prototype ION AM, and includes the features from item iii above)
Initial Prototype: March 2013 Production Ready Version: May 30, 2013

Status:
An instance of the MAX Aggregate Manager has been deployed as the ION Aggregate Manager. The Internet2 NOC has deployed this and is running as an operational service. We will continue to work with the I2 NOC to upgrade their GENI AM as we add new features to the MAX Aggregate Manager software. This same software can also be used to cover any DYNES deployment.

B. Deliverables made

During this reporting period we completed the following deliverables:

GEC17 Stitching Demonstration

  • geni.maxgigapop.net ====> Publications ====> GEC17

or direct

MAX Aggregate Manager support for GENI v3 RSpecs:

Stitching Computation Service (SCS) Design

The SCS software:

MAX Aggregate Manager federated with ProtoGENI and PlanetLab and available for use via user and slice credentials from these aggregates.

II Description of work performed during last quarter

A. Activities and findings

Based on the work we have completed with our prototype deployments of ION and LONI GENI Aggregate Managers, we believe we are ready for a more production level deployment. We have started working with Internet2 NOC to deploy an instance of a GENI AM that they will maintain and support on a trial basis.

We have a well defined stitching architecture which consists of the following components:

  1. Stitching Extensions for RSpec Schemas
  2. Stitching WorkFlow Function (basic and w/negotiation)
  3. GENI AM API Extensions for Stitching
  4. Stitching Topology Service
  5. Stitching Computation Service

Based on completed design, implementation, testing, and demonstrations, we are now have a multi-aggregate stitching capability in place.

B. Project participants

Tom Lehman (MAX)
Xi Yang (MAX)

C. Publications (individual and organizational)

No formal publications were funded by this projects during this time period.

D. Outreach activities

The current focus of our outreach activities is thru our collaborations with other Aggregates such as ProtoGENI, ExoGENI, and GENI Rack deployment sites.

We have received the MAX InstaGENI rack. This has been installed and connected to the MAX Aggregate which enables stitching thru Internet2 ION. The MAX InstaGENI rack is also connected thru Internet2 AL2S to the GENI Mesoscale infrastructure. This rack has completed acceptance testing and will soon be generally available for GENI community use. We also plan to encourage more outreach to potential experimenters at University of Maryland and other universities in the MAX footprint.

E. Collaborations

As part of the activities and milestones described here, we have had extensive collaborations with many in the GENI community. This includes CRON, ProtoGENI, ExoGENI, and GPO developers. A large focus of our milestones during this reporting period revolved around network stitching architecture, design, and software development. These activities required collaborations with other GENI aggregate manager developers.

F. Other Contributions

none.