[[PageOutline]] == Project Number == 1893 == Project Title == GEMINI: A GENI Measurement and Instrumentation Infrastructure [[BR]] a.k.a GEMINI === Technical Contacts === '''PI''' Martin Swany, Indiana University (mailto:swany@iu.edu) [[BR]] '''Co-PI''' Chris Small, Indiana University (mailto:chsmall@indiana.edu) [[BR]] '''Co-PI''' James Griffioen, University of Kentucky (mailto:griff@netlab.uky.edu) [[BR]] '''Co-PI''' Zongming Fei, University of Kentucky (mailto:fei@netlab.uky.edu) [[BR]] === Participating Organizations === Indiana University [[BR]] University of Kentucky [[BR]] === Related Projects === [wiki:LAMP Leveraging and Abstracting Measurements with perfSONAR (LAMP) ][[BR]] [wiki:InstrumentationTools Instrumentation Tools for a GENI Prototype, a.k.a. INSTOOLS][[BR]] [wiki:Shadow A ShadowBox-based ProtoGENI Instrumentation and Measurement Infrastructure, a.k.a. ShadowNet][[BR]] === GPO Engineers === '''GPO System Engineer:''' [mailto:hmussman@bbn.com Harry Mussman] '''GPO Software Engineer:''' [mailto:johren@BBN.COM Jeanne Ohren] == Scope == This project will develop and deploy the GEMINI instrumentation and measurement framework, capable of supporting the needs of both GENI experimenters and GENI infrastructure operators. It uses the perfSONAR system as its basis, and will include capabilities being developed by key GENI I&M projects, including LAMP and INSTOOLS. It will collect and manage both substrate metrics as well as slice-specific measurements. It will introduce a GENI Global I&M Registry so that GEMINI components can locate one another, and locate measurement sources and data. It will include access control for instrumentation infrastructure, measurements, and measurement data based on GENI policy and authorization mechanisms. [[BR]] == Strategy and Goals == The GENI LAMP project has adapted perfSONAR code for operation in a protoGENI slice, and has included the Periscope display module. The GENI INSTOOLS project has written easy-to-use tools for experimenters who wish to instrument their protoGENI slice. [[BR]] This GEMINI project will merge LAMP (including perfSONAR and Periscope) code and features, with INSTOOLS code and features, to form one set of GEMINI I&M services that can be flexibly deployed in a defined range of GENI environments. [[BR]] Its first goal is to provide easy-to-use I&M services for experimenters, who are deploying slices in GENI on selected types of servers, VMs and racks, interconnected by various types of network paths. [[BR]] Its second goal is to provide comprehensive infrastructure measurement services for infrastructure operators, who are deploying measurement slices on selected types of servers, VMs and racks, interconnected by a various types of network paths. In addition, slices established by other infrastructure operators, or by experimenters, can be authorized to gather data from the measurement slices, via interfaces that retain compatibility with currently deployed perfSONAR services. [[BR]] This project will build and operate three persistent services, including a GENI Global I&M Registry (i.e., UNIS), a GENI Experimenter Portal Service and a GENI Event Messaging Service; these can be utilized by all types of GENI I&M services, including those developed in the GIMI project. The GENI Experimenter Portal Service will be developed in cooperation with the GIMI project, to support both GEMINI and GIMI tools. This project will utilize a persistent service provided by the GIMI project, the GENI Measurement Data Archive service (i.e., iRODs). It will use the GENI Measurement Data Object Descriptor (MDOD) schema, defined for use by all GENI I&M services. [[BR]] == Operational Capabilities == === Milestones === == Spiral 4 == * [[MilestoneDate(GEMINI: S4.a Define and document a defined range of GENI environments)]] * [[MilestoneDate(GEMINI: S4.b Define and document)]] * [[MilestoneDate(GEMINI: S4.c Refactor UNIS)]] * [[MilestoneDate(GEMINI: S4.c.1 Update topology model)]] * [[MilestoneDate(GEMINI: S4.c.2 Modifications)]] * [[MilestoneDate(GEMINI: S4.c.3 Deployment)]] * [[MilestoneDate(GEMINI: S4.c.4 Complete noSQL (MongoDB) backend)]] * [[MilestoneDate(GEMINI: S4.c.5 Unify Perl and Python implementations)]] * [[MilestoneDate(GEMINI: S4.d Refactor LAMP/perfSONAR/Periscope/BLiPP services)]] * [[MilestoneDate(GEMINI: S4.d.1 Refactor LAMP/perfSONAR/Periscope/BLiPP services)]] * [[MilestoneDate(GEMINI: S4.d.2 Refactor LAMP/perfSONAR/Periscope/BLiPP services)]] * [[MilestoneDate(GEMINI: S4.d.3 Refactor LAMP/perfSONAR/Periscope/BLiPP services)]] * [[MilestoneDate(GEMINI: S4.e Refactor and extend LAMP/perfSONAR/Periscope/BLiPP services)]] * [[MilestoneDate(GEMINI: S4.e.1 Refactor and extend LAMP/perfSONAR/Periscope/BLiPP services)]] * [[MilestoneDate(GEMINI: S4.e.2 Refactor and extend LAMP/perfSONAR/Periscope/BLiPP services)]] * [[MilestoneDate(GEMINI: S4.f Refactor perfSONAR Measurement Archive (MA) to Measurement Store (MS) and extend)]] * [[MilestoneDate(GEMINI: S4.f.1 Refactor perfSONAR Measurement Archive (MA) to Measurement Store (MS) and extend)]] * [[MilestoneDate(GEMINI: S4.f.2 Refactor perfSONAR Measurement Archive (MA) to Measurement Store (MS) and extend)]] * [[MilestoneDate(GEMINI: S4.f.3 Refactor perfSONAR Measurement Archive (MA) to Measurement Store (MS) and extend)]] * [[MilestoneDate(GEMINI: S4.g "Refactor INSTOOLS portal service to support GEMINI and GIMI tools, to become the GENI Experimenter Portal Service")]] * [[MilestoneDate(GEMINI: S4.g.1 "Refactor INSTOOLS portal service to support GEMINI and GIMI tools, to become the GENI Experimenter Portal Service")]] * [[MilestoneDate(GEMINI: S4.g.2 "Refactor INSTOOLS portal service to support GEMINI and GIMI tools, to become the GENI Experimenter Portal Service")]] * [[MilestoneDate(GEMINI: S4.g.3 "Refactor INSTOOLS portal service to support GEMINI and GIMI tools, to become the GENI Experimenter Portal Service")]] * [[MilestoneDate(GEMINI: S4.g.4 "Refactor INSTOOLS portal service to support GEMINI and GIMI tools, to become the GENI Experimenter Portal Service")]] * [[MilestoneDate(GEMINI: S4.g.5 "Refactor INSTOOLS portal service to support GEMINI and GIMI tools, to become the GENI Experimenter Portal Service")]] * [[MilestoneDate(GEMINI: S4.g.6 "Refactor INSTOOLS portal service to support GEMINI and GIMI tools, to become the GENI Experimenter Portal Service")]] * [[MilestoneDate(GEMINI: S4.g.7 "Refactor INSTOOLS portal service to support GEMINI and GIMI tools, to become the GENI Experimenter Portal Service")]] * [[MilestoneDate(GEMINI: S4.g.8 "Refactor INSTOOLS portal service to support GEMINI and GIMI tools, to become the GENI Experimenter Portal Service")]] * [[MilestoneDate(GEMINI: S4.h GENI Event Messaging Service (GEMS))]] * [[MilestoneDate(GEMINI: S4.h.1 GENI Event Messaging Service (GEMS))]] * [[MilestoneDate(GEMINI: S4.h.2 GENI Event Messaging Service (GEMS))]] * [[MilestoneDate(GEMINI: S4.h.3 GENI Event Messaging Service (GEMS))]] * [[MilestoneDate(GEMINI: S4.h.4 GENI Event Messaging Service (GEMS))]] * [[MilestoneDate(GEMINI: S4.h.5 GENI Event Messaging Service (GEMS))]] * [[MilestoneDate(GEMINI: S4.i Deliver release of GEMINI v1.0 I&M services software)]] * [[MilestoneDate(GEMINI: S4.j "Demonstrate, document and support the use of GEMINI I&M services")]] * [[MilestoneDate(GEMINI: S4.j.1 "Demonstrate, document and support the use of GEMINI I&M services")]] * [[MilestoneDate(GEMINI: S4.j.2 "Demonstrate, document and support the use of GEMINI I&M services")]] * [[MilestoneDate(GEMINI: S4.j.3 "Demonstrate, document and support the use of GEMINI I&M services")]] * [[MilestoneDate(GEMINI: S4.j.4 "Demonstrate, document and support the use of GEMINI I&M services")]] * [[MilestoneDate(GEMINI: S4.j.5 "Demonstrate, document and support the use of GEMINI I&M services")]] * [[MilestoneDate(GEMINI: S4.k "Demonstrate, document and support the use of GEMINI I&M services")]] * [[MilestoneDate(GEMINI: S4.k.1 "Demonstrate, document and support the use of GEMINI I&M services")]] * [[MilestoneDate(GEMINI: S4.k.2 "Demonstrate, document and support the use of GEMINI I&M services")]] * [[MilestoneDate(GEMINI: S4.k.3 "Demonstrate, document and support the use of GEMINI I&M services")]] * [[MilestoneDate(GEMINI: S4.k.4 "Demonstrate, document and support the use of GEMINI I&M services")]] * [[MilestoneDate(GEMINI: S4.k.5 "Demonstrate, document and support the use of GEMINI I&M services")]] * [[MilestoneDate(GEMINI: S4.k.6 "Demonstrate, document and support the use of GEMINI I&M services")]] === Status Reports and Demonstrations === [http://groups.geni.net/geni/attachment/wiki/GEMINI/gemini-gec13.pptx GEC13 slides] [[BR]] [http://groups.geni.net/geni/attachment/wiki/GEMINI/GEC13%20GEMINI%20Demo%20Poster%20V2.pdf GEC13 demo poster] [[BR]] === Software Releases and Acceptance Tests === [wiki:GEMINI_TopicsIssuesTasks GEMINI v1.0 Design Topics ][[BR]] [wiki:GEMINI_v1.0_Definition GEMINI v1.0 Definition] [[BR]] [wiki:GEMINIIntegrationTasks GEMINI v1.0 Integration Plan and Status][[BR]] [wiki:GEMINITestPlan GEMINI v1.0 Acceptance Test Plan][[BR]] === Tutorials and Experimenter Support === [http://groups.geni.net/geni/attachment/wiki/GEMINI/GEC13%20GEMINI%20Demo%20Poster%20V2.pdf GEC13 demo poster] [[BR]] [http://groups.geni.net/geni/wiki/GEC14Agenda/InstaGENIGEMINITutorial Combined InstaGENI and GEMINI tutorial at GEC14] [[BR]] [http://groups.geni.net/geni/wiki/InstaGENITutorial InstaGENI tutorial at GEC14] [[BR]] [http://groups.geni.net/geni/wiki/GEMINITutorial GEMINI tutorial at GEC14] [[BR]] [wiki:GEMINIUserList GEMINI user (experimenters) mailing list] [[BR]] === Technical Documents === [wiki:RspecExtensionProposal_PortMapping RSpec Extension Proposal to Enable Port Mapping] [[BR]] [wiki:RspecExtensionProposal_ServiceMapping RSpec Extension Proposal for Service Mapping] [[BR]] Current figures: [[BR]] [[Image(Visio-040412_UseCases_Projects_Figures_Page_05.jpg, 90%)]] [[BR]] [[Image(Visio-040412_UseCases_Projects_Figures_Page_16.jpg, 90%)]] [[BR]]