Project Number

1856

Project Title

GIMI: Large-scale GENI Instrumentation and Measurement Infrastructure
a.k.a GIMI

Technical Contacts

PI Michael Zink, University of Massachusetts at Amherst (​mailto:zink@ecs.umass.edu)
Co-PI Max Ott, NICTA (​mailto:max.ott@nicta.com.au)
Key personnel Ilia Baldine, RENCI (mailto:ibaldin@renci.org)

Participating Organizations

University of Massachusetts at Amherst

NICTA

RENCI

Related Projects

​GIMI website at UMass Amherst

WiMAX Deployment at UMass Amherst

Data-Intensive Cloud Control for GENI (UMass Amherst)

​OML - Measurement Library (NICTA)

Network-agile multi-provisioned infrastructure for GENI and ExoGENI

GPO Engineers

GPO System Engineer: ​Harry Mussman

GPO Software Engineer: ​Jeanne Ohren

Scope

This project will develop and deploy the GIMI instrumentation and measurement framework, capable of supporting the needs of both GENI experimenters and GENI infrastructure operators. It uses the ORBIT Measurement Library (OML) and integrated Rule Oriented Data System (iRODS) as its basis. It will provide libraries to instrument resources, to filter and process measurement flows, and to consume measurement flows. It will use the iRODS data grid for archiving and further processing. It will include access control based on accepted GENI policy and authorization mechanisms.

Strategy and Goals

Its first goal is to provide easy-to-use I&M services for experimenters, who are deploying slices in GENI on selected types of servers, VMs and racks, interconnected by various types of network paths.
Its second goal is to provide comprehensive infrastructure measurement services for infrastructure operators, who are deploying measurement slices on selected types of servers, VMs and racks, interconnected by a various types of network paths. In addition, slices established by other infrastructure operators, or by experimenters, can be authorized to gather data from the measurement slices.

This project will build and operate two persistent services: the GENI Measurement Data Archive service (i.e., iRODs)and the GENI Experimenter Portal Service. These can be utilized by all types of GENI I&M services, including those developed in the GEMINI project. The GENI Experimenter Portal Service will be developed in cooperation with the GEMINI project, to support both GIMI and GEMINI tools. This project will use the GENI Measurement Data Object Descriptor (MDOD) schema, defined for use by all GENI I&M services.

It may utilize two persistent services provided by the GEMINI project: the GENI Global I&M Registry (i.e., UNIS), and the GENI Event Messaging Service.

The GIMI project will use the configuration shown in the diagram below.

GIMI I&M Tools Configuration (p6)

Operational Capabilities

Milestones

Spiral 4

• MilestoneDate(GIMI: S4.a Define MeasurementDataObjectDescriptor (MDOD) schema)?
• MilestoneDate(GIMI: S4.b Define v0.5 I&M use cases for experiments and infrastructure monitoring)?
• MilestoneDate(GIMI: S4.c Develop reference v1.0 experiment control tools)?
• MilestoneDate(GIMI: S4.d Description of ontology extensions)?
• MilestoneDate(GIMI: S4.e Identify use cases and concept of operations for GENI messaging services)?
• MilestoneDate(GIMI: S4.f Deliver v0.5 definition of GIMI architecture and software modules)?
• MilestoneDate(GIMI: S4.g OML Release 2.7.0)?
• MilestoneDate(GIMI: S4.h "Agree on v1.0 I&M use cases for experiments and infrastructure monitoring, in collaboration with I&M teams and the GPO, and document, including")?
• MilestoneDate(GIMI: S4.i Compare available technology and prototypes)?
• MilestoneDate(GIMI: S4.i.1 Compare available technology and prototypes)?
• MilestoneDate(GIMI: S4.j Agree on v1.0 definition of GIMI architecture and software modules)?
• MilestoneDate(GIMI: S4.k Identify necessary mappings)?
• MilestoneDate(GIMI: S4.k.1 Identify necessary mappings)?
• MilestoneDate(GIMI: S4.l Agree on v1.0 target GENI environment for GIMI tools with I&M teams and the GPO)?
• MilestoneDate(GIMI: S4.m Deliver Beta 1.0 of GIMI software)?
• MilestoneDate(GIMI: S4.n Develop use cases and best practices)?
• MilestoneDate(GIMI: S4.n.1 Develop use cases and best practices)?
• MilestoneDate(GIMI: S4.n.2 Develop use cases and best practices)?
• MilestoneDate(GIMI: S4.o Stand up a v1.0 prototype iRods datagrid)?
• MilestoneDate(GIMI: S4.p Deliver Release 1.0 of GIMI software after functional and performance testing)?
• MilestoneDate(GIMI: S4.q OML Release 2.8.0)?
• MilestoneDate(GIMI: S4.r r) Provide v1.0 persistent Experimenter Portal Service (based on NICTA LabWiki) that can be used by GENI experimenters)?
• MilestoneDate(GIMI: S4.s Demonstrate Release 1.0 GIMI tools for experimenter use cases)?
• MilestoneDate(GIMI: S4.t Demonstrate tool-based setup of basic set of measurements using Release 1.0 of GIMI tools)?
• MilestoneDate(GIMI: S4.u "Best-effort operation of persistent OML server in Experimenter Portal Service, for prototyping and testing")?
• MilestoneDate(GIMI: S4.v "Prototype orchestration capability, using OMF EC and RC")?
• MilestoneDate(GIMI: S4.w "Deliver Release 1.1 of GIMI software, with fixes and small features")?
• MilestoneDate(GIMI: S4.x OML Release 2.9.0)?

Status Reports and Demonstrations

​GEC13 Review
​GEC13 Demo Description
​GEC13 Demo Poster

Software Releases and Acceptance Tests

GIMI v1.0 Design Topics

GIMI v1.0 Definition

GIMI v1.0 Configuration?

GIMI v1.0 WiMAX Site Configuration?

GIMI v1.0 Integration Plan and Status

GIMI v1.0 Acceptance Test Plan
GIMI v1.0 Acceptance Test Status

GIMI v1.0 Tutorial at GEC14

GIMI v1.1 Design Topics

GIMI v1.1 Definition?

GIMI v1.1 Integration Plan and Status?

GIMI v1.1 Acceptance Test Plan?
GIMI v1.1 Acceptance Test Status

GIMI v1.1 Tutorial at GEC15

GIMI v2beta Definition?

GIMI v2.0 Definition?

GIMI v2.0 Configuration?

GIMI v2.0 WiMAX Site Configuration? [[BR]

Tutorials and Experimenter Support

​GEC13 Demo Description
​GEC13 Demo Poster

​ORCA/ExoGENI Tutorial at GEC13

Combined ExoGENI and GIMI Tutorial at GEC14
ORCA/ExoGENI Tutorial at GEC14
GIMI v1.0 Tutorial at GEC14

GIMI users (experimenters) mailing list

Technical Documents

​iRODS fact sheet
​iRODS overview
​iRODS configuration
​iRODS use cases

I&M Tools: Basic Test/Tutorial/Experiment Storyboard
I&M Tools: Basic Test/Tutorial/Experiment Workflow