[[PageOutline]] == Project Number == 1856 == Project Title == GIMI: Large-scale GENI Instrumentation and Measurement Infrastructure [[BR]] a.k.a GIMI === Technical Contacts === '''PI''' Michael Zink, University of Massachusetts at Amherst (mailto:zink@ecs.umass.edu) [[BR]] '''Co-PI''' Max Ott, NICTA (mailto:max.ott@nicta.com.au) [[BR]] '''Key personnel''' Ilia Baldine, RENCI (mailto:ibaldin@renci.org) [[BR]] === Participating Organizations === University of Massachusetts at Amherst [[BR]] NICTA [[BR]] RENCI [[BR]] === Related Projects === [http://gimi.ecs.umass.edu/ GIMI website at UMass Amherst] [[BR]] [wiki:WIMXUMASS WiMAX Deployment at UMass Amherst] [[BR]] [wiki:DICLOUD Data-Intensive Cloud Control for GENI (UMass Amherst)] [[BR]] [http://omf.mytestbed.net/projects/oml/wiki OML - Measurement Library (NICTA)] [[BR]] [wiki:EXOGENI Network-agile multi-provisioned infrastructure for GENI and ExoGENI] [[BR]] === GPO Engineers === '''GPO System Engineer:''' [mailto:hmussman@bbn.com Harry Mussman] '''GPO Software Engineer:''' [mailto:johren@BBN.COM Jeanne Ohren] == Scope == This project will develop and deploy the GIMI instrumentation and measurement framework, capable of supporting the needs of both GENI experimenters and GENI infrastructure operators. It uses the ORBIT Measurement Library (OML) and integrated Rule Oriented Data System (iRODS) as its basis. It will provide libraries to instrument resources, to filter and process measurement flows, and to consume measurement flows. It will use the iRODS data grid for archiving and further processing. It will include access control based on accepted GENI policy and authorization mechanisms. [[BR]] == Strategy and Goals == Its first goal is to provide easy-to-use I&M services for experimenters, who are deploying slices in GENI on selected types of servers, VMs and racks, interconnected by various types of network paths. [[BR]] Its second goal is to provide comprehensive infrastructure measurement services for infrastructure operators, who are deploying measurement slices on selected types of servers, VMs and racks, interconnected by a various types of network paths. In addition, slices established by other infrastructure operators, or by experimenters, can be authorized to gather data from the measurement slices. [[BR]] This project will build and operate two persistent services: the GENI Measurement Data Archive service (i.e., iRODs)and the GENI Experimenter Portal Service. These can be utilized by all types of GENI I&M services, including those developed in the GEMINI project. The GENI Experimenter Portal Service will be developed in cooperation with the GEMINI project, to support both GIMI and GEMINI tools. This project will use the GENI Measurement Data Object Descriptor (MDOD) schema, defined for use by all GENI I&M services. [[BR]] It may utilize two persistent services provided by the GEMINI project: the GENI Global I&M Registry (i.e., UNIS), and the GENI Event Messaging Service. [[BR]] The GIMI project will use the configuration shown in the diagram below. [[BR]] GIMI I&M Tools Configuration (p6) [[BR]] == Operational Capabilities == === Milestones === == Spiral 4 == * [[MilestoneDate(GIMI: S4.a Define MeasurementDataObjectDescriptor (MDOD) schema)]] * [[MilestoneDate(GIMI: S4.b Define v0.5 I&M use cases for experiments and infrastructure monitoring)]] * [[MilestoneDate(GIMI: S4.c Develop reference v1.0 experiment control tools)]] * [[MilestoneDate(GIMI: S4.d Description of ontology extensions)]] * [[MilestoneDate(GIMI: S4.e Identify use cases and concept of operations for GENI messaging services)]] * [[MilestoneDate(GIMI: S4.f Deliver v0.5 definition of GIMI architecture and software modules)]] * [[MilestoneDate(GIMI: S4.g OML Release 2.7.0)]] * [[MilestoneDate(GIMI: S4.h "Agree on v1.0 I&M use cases for experiments and infrastructure monitoring, in collaboration with I&M teams and the GPO, and document, including")]] * [[MilestoneDate(GIMI: S4.i Compare available technology and prototypes)]] * [[MilestoneDate(GIMI: S4.i.1 Compare available technology and prototypes)]] * [[MilestoneDate(GIMI: S4.j Agree on v1.0 definition of GIMI architecture and software modules)]] * [[MilestoneDate(GIMI: S4.k Identify necessary mappings)]] * [[MilestoneDate(GIMI: S4.k.1 Identify necessary mappings)]] * [[MilestoneDate(GIMI: S4.l Agree on v1.0 target GENI environment for GIMI tools with I&M teams and the GPO)]] * [[MilestoneDate(GIMI: S4.m Deliver Beta 1.0 of GIMI software)]] * [[MilestoneDate(GIMI: S4.n Develop use cases and best practices)]] * [[MilestoneDate(GIMI: S4.n.1 Develop use cases and best practices)]] * [[MilestoneDate(GIMI: S4.n.2 Develop use cases and best practices)]] * [[MilestoneDate(GIMI: S4.o Stand up a v1.0 prototype iRods datagrid)]] * [[MilestoneDate(GIMI: S4.p Deliver Release 1.0 of GIMI software after functional and performance testing)]] * [[MilestoneDate(GIMI: S4.q OML Release 2.8.0)]] * [[MilestoneDate(GIMI: S4.r r) Provide v1.0 persistent Experimenter Portal Service (based on NICTA LabWiki) that can be used by GENI experimenters)]] * [[MilestoneDate(GIMI: S4.s Demonstrate Release 1.0 GIMI tools for experimenter use cases)]] * [[MilestoneDate(GIMI: S4.t Demonstrate tool-based setup of basic set of measurements using Release 1.0 of GIMI tools)]] * [[MilestoneDate(GIMI: S4.u "Best-effort operation of persistent OML server in Experimenter Portal Service, for prototyping and testing")]] * [[MilestoneDate(GIMI: S4.v "Prototype orchestration capability, using OMF EC and RC")]] * [[MilestoneDate(GIMI: S4.w "Deliver Release 1.1 of GIMI software, with fixes and small features")]] * [[MilestoneDate(GIMI: S4.x OML Release 2.9.0)]] === Status Reports and Demonstrations === [http://groups.geni.net/geni/attachment/wiki/GIMI/GIMI%20GEC%2013.pptx GEC13 Review] [[BR]] [http://groups.geni.net/geni/wiki/GEC13Agenda/EveningDemoSession#GIMI:Large-scaleGENIInstrumentationandMeasurementInfrastructure GEC13 Demo Description] [[BR]] [http://groups.geni.net/geni/attachment/wiki/GEC13Agenda/EveningDemoSession/GIMI_GEC13_poster.pdf GEC13 Demo Poster] [[BR]] === Software Releases and Acceptance Tests === [wiki:_GIMI_NextSteps GIMI v1.0 Design Topics] [[BR]] [wiki:_GIMI_v1.0_Architecture GIMI v1.0 Definition] [[BR]] GIMI v1.0 Configuration [[BR]] [[Image(Visio-091012d_GIMI_Figures_Page_08.jpg, 50%)]] [[BR]] GIMI v1.0 WiMAX Site Configuration [[BR]] [[Image(Visio-091012d_GIMI_Figures_Page_09.jpg, 50%)]] [[BR]] [wiki:_GIMI_v1.0_Integration GIMI v1.0 Integration Plan and Status] [[BR]] [wiki:GIMIAcceptanceTests/TestPlan GIMI v1.0 Acceptance Test Plan][[BR]] [wiki:GIMIv1.0Tutorial GIMI v1.0 Tutorial at GEC14] [[BR]] [http://groups.geni.net/geni/attachment/wiki/GIMI/GIMI%20GEC14%20tutorial.pdf GIMI v1.0 Tutorial Slides at GEC14] [[BR]] [wiki:GIMIv1.1NextSteps GIMI v1.1 Design Topics] [[BR]] [wiki:GIMIv1.1Architecture GIMI v1.1 Definition] [[BR]] [wiki:GIMIv1.1Integration GIMI v1.1 Integration Plan and Status] [[BR]] [wiki:GIMIv1.1AcceptanceTests/TestPlan GIMI v1.1 Acceptance Test Plan][[BR]] [wiki:GIMIAcceptanceTests/TestStatus GIMI v1.1 Acceptance Test Status][[BR]] [wiki:GIMIv1.1Tutorial GIMI v1.1 Tutorial at GEC15] [[BR]] [wiki:GIMIv2betaArchitecture GIMI v2beta Definition] [[BR]] [wiki:GIMIv2Architecture GIMI v2.0 Definition] [[BR]] GIMI v2.0 Configuration [[BR]] [[Image(Visio-091012d_GIMI_Figures_Page_11.jpg, 50%)]] [[BR]] GIMI v2.0 WiMAX Site Configuration [[BR]] [[Image(Visio-091012d_GIMI_Figures_Page_12.jpg, 50%)]] [[BR]] === Tutorials and Experimenter Support === [http://groups.geni.net/geni/wiki/GEC13Agenda/EveningDemoSession#GIMI:Large-scaleGENIInstrumentationandMeasurementInfrastructure GEC13 Demo Description] [[BR]] [http://groups.geni.net/geni/attachment/wiki/GEC13Agenda/EveningDemoSession/GIMI_GEC13_poster.pdf GEC13 Demo Poster] [[BR]] [http://groups.geni.net/geni/wiki/GEC13Agenda/ORCATutorial ORCA/ExoGENI Tutorial at GEC13] [[BR]] [wiki:GEC14Agenda/ExoGENIGIMITutorial Combined ExoGENI and GIMI Tutorial at GEC14] [[BR]] [wiki:ORCAExoGENITutorial ORCA/ExoGENI Tutorial at GEC14] [[BR]] [wiki:GIMIv1.0Tutorial GIMI v1.0 Tutorial at GEC14] [[BR]] [http://groups.geni.net/geni/attachment/wiki/GIMI/GIMI%20GEC14%20tutorial.pdf GIMI v1.0 Tutorial Slides at GEC14] [[BR]] [wiki:GIMIusersList GIMI users (experimenters) mailing list] [[BR]] === Technical Documents === [http://groups.geni.net/geni/attachment/wiki/GIMI/iRODS_Fact_Sheet-0907c.pdf iRODS fact sheet] [[BR]] [http://groups.geni.net/geni/attachment/wiki/GIMI/iRODS_Overview_0903.pdf iRODS overview] [[BR]] [http://groups.geni.net/geni/attachment/wiki/GIMI/irods-gec14-1.pptx iRODS configuration] [[BR]] [http://groups.geni.net/geni/attachment/wiki/GIMI/041712%20%20gimi_use_cases.pptx iRODS use cases] [[BR]] [http://groups.geni.net/geni/attachment/wiki/GIMI/iRODS%20GENI%20plan.docx iRODS plan] [[BR]] [wiki:TestTutorialExperimentStoryboard I&M Tools: Basic Test/Tutorial/Experiment Storyboard] [[BR]] [wiki:TestTutorialExperimentWorkflow I&M Tools: Basic Test/Tutorial/Experiment Workflow] [[BR]]