[[PageOutline]] == Project Number == 1856 == Project Title == GIMI: Large-scale GENI Instrumentation and Measurement Infrastructure [[BR]] a.k.a GIMI === Technical Contacts === '''PI''' Michael Zink, University of Massachusetts at Amherst (mailto:zink@ecs.umass.edu) [[BR]] '''Co-PI''' Max Ott, NICTA (mailto:max.ott@nicta.com.au) [[BR]] '''Key personnel''' Ilia Baldine, RENCI (mailto:ibaldin@renci.org) [[BR]] === Participating Organizations === University of Massachusetts at Amherst [[BR]] NICTA [[BR]] RENCI [[BR]] === Related Projects === [http://gimi.ecs.umass.edu/ GIMI website at UMass Amherst] [[BR]] [wiki:WIMXUMASS WiMAX Deployment at UMass Amherst] [[BR]] [wiki:DICLOUD Data-Intensive Cloud Control for GENI (UMass Amherst)] [[BR]] [http://omf.mytestbed.net/projects/oml/wiki OML - Measurement Library (NICTA)] [[BR]] [wiki:EXOGENI Network-agile multi-provisioned infrastructure for GENI and ExoGENI] [[BR]] === GPO Engineers === '''GPO System Engineer:''' [mailto:hmussman@bbn.com Harry Mussman] '''GPO Software Engineer:''' [mailto:johren@BBN.COM Jeanne Ohren] == Scope == This project will develop and deploy the GIMI instrumentation and measurement framework, capable of supporting the needs of both GENI experimenters and GENI infrastructure operators. It uses the ORBIT Measurement Library (OML) and integrated Rule Oriented Data System (iRODS) as its basis. It will provide libraries to instrument resources, to filter and process measurement flows, and to consume measurement flows. It will use the iRODS data grid for archiving and further processing. It will include access control based on accepted GENI policy and authorization mechanisms. [[BR]] == Strategy and Goals == Its first goal is to provide easy-to-use I&M services for experimenters, who are deploying slices in GENI on selected types of servers, VMs and racks, interconnected by various types of network paths. [[BR]] Its second goal is to provide comprehensive infrastructure measurement services for infrastructure operators, who are deploying measurement slices on selected types of servers, VMs and racks, interconnected by a various types of network paths. In addition, slices established by other infrastructure operators, or by experimenters, can be authorized to gather data from the measurement slices. [[BR]] This project will build and operate two persistent services: the GENI Measurement Data Archive service (i.e., iRODs)and the GENI Experimenter Portal Service. These can be utilized by all types of GENI I&M services, including those developed in the GEMINI project. The GENI Experimenter Portal Service will be developed in cooperation with the GEMINI project, to support both GIMI and GEMINI tools. This project will use the GENI Measurement Data Object Descriptor (MDOD) schema, defined for use by all GENI I&M services. [[BR]] It may utilize two persistent services provided by the GEMINI project: the GENI Global I&M Registry (i.e., UNIS), and the GENI Event Messaging Service. [[BR]] The GIMI project will use the configuration shown in the diagram below. [[BR]] GIMI I&M Tools Configuration (p6) [[BR]] == Operational Capabilities == === Milestones === == Spiral 4 == * [[MilestoneDate(GIMI: S4.a Define MeasurementDataObjectDescriptor (MDOD) schema)]] * [[MilestoneDate(GIMI: S4.b Define v0.5 I&M use cases for experiments and infrastructure monitoring)]] * [[MilestoneDate(GIMI: S4.c Develop reference v1.0 experiment control tools)]] * [[MilestoneDate(GIMI: S4.d Description of ontology extensions)]] * [[MilestoneDate(GIMI: S4.e Identify use cases and concept of operations for GENI messaging services)]] * [[MilestoneDate(GIMI: S4.f Deliver v0.5 definition of GIMI architecture and software modules)]] * [[MilestoneDate(GIMI: S4.g OML Release 2.7.0)]] * [[MilestoneDate(GIMI: S4.h "Agree on v1.0 I&M use cases for experiments and infrastructure monitoring, in collaboration with I&M teams and the GPO, and document, including")]] * [[MilestoneDate(GIMI: S4.i Compare available technology and prototypes)]] * [[MilestoneDate(GIMI: S4.i.1 Compare available technology and prototypes)]] * [[MilestoneDate(GIMI: S4.j Agree on v1.0 definition of GIMI architecture and software modules)]] * [[MilestoneDate(GIMI: S4.k Identify necessary mappings)]] * [[MilestoneDate(GIMI: S4.k.1 Identify necessary mappings)]] * [[MilestoneDate(GIMI: S4.l Agree on v1.0 target GENI environment for GIMI tools with I&M teams and the GPO)]] * [[MilestoneDate(GIMI: S4.m Deliver Beta 1.0 of GIMI software)]] * [[MilestoneDate(GIMI: S4.n Develop use cases and best practices)]] * [[MilestoneDate(GIMI: S4.n.1 Develop use cases and best practices)]] * [[MilestoneDate(GIMI: S4.n.2 Develop use cases and best practices)]] * [[MilestoneDate(GIMI: S4.o Stand up a v1.0 prototype iRods datagrid)]] * [[MilestoneDate(GIMI: S4.p Deliver Release 1.0 of GIMI software after functional and performance testing)]] * [[MilestoneDate(GIMI: S4.q OML Release 2.8.0)]] * [[MilestoneDate(GIMI: S4.r r) Provide v1.0 persistent Experimenter Portal Service (based on NICTA LabWiki) that can be used by GENI experimenters)]] * [[MilestoneDate(GIMI: S4.s Demonstrate Release 1.0 GIMI tools for experimenter use cases)]] * [[MilestoneDate(GIMI: S4.t Demonstrate tool-based setup of basic set of measurements using Release 1.0 of GIMI tools)]] * [[MilestoneDate(GIMI: S4.u "Best-effort operation of persistent OML server in Experimenter Portal Service, for prototyping and testing")]] * [[MilestoneDate(GIMI: S4.v "Prototype orchestration capability, using OMF EC and RC")]] * [[MilestoneDate(GIMI: S4.w "Deliver Release 1.1 of GIMI software, with fixes and small features")]] * [[MilestoneDate(GIMI: S4.x OML Release 2.9.0)]] === Status Reports and Demonstrations === [http://groups.geni.net/geni/attachment/wiki/GIMI/GIMI%20GEC%2013.pptx GEC13 Review] [[BR]] [http://groups.geni.net/geni/wiki/GEC13Agenda/EveningDemoSession#GIMI:Large-scaleGENIInstrumentationandMeasurementInfrastructure GEC13 Demo Description] [[BR]] [http://groups.geni.net/geni/attachment/wiki/GEC13Agenda/EveningDemoSession/GIMI_GEC13_poster.pdf GEC13 Demo Poster] [[BR]] === Technical Documents === [wiki:_GIMI_NextSteps GIMI tasks, issues and next steps] [[BR]] [http://groups.geni.net/geni/attachment/wiki/GIMI/041712%20%20gimi_use_cases.pptx iRODS use cases] [[BR]] [wiki:GIMITestPlan GIMI Acceptance Test Plan][[BR]] === Software Releases and Acceptance Tests === === Tutorials and Experimenter Support ===