[[PageOutline]] == Project Number == 1893 == Project Title == GEMINI: A GENI Measurement and Instrumentation Infrastructure [[BR]] a.k.a GEMINI === Technical Contacts === '''PI''' Martin Swany, Indiana University (mailto:swany@iu.edu) [[BR]] '''Co-PI''' Chris Small, Indiana University (mailto:chsmall@indiana.edu) [[BR]] '''Co-PI''' James Griffioen, University of Kentucky (mailto:griff@netlab.uky.edu) [[BR]] '''Co-PI''' Zongming Fei, University of Kentucky (mailto:fei@netlab.uky.edu) [[BR]] === Participating Organizations === Indiana University [[BR]] University of Kentucky [[BR]] === Related Projects === [wiki:LAMP Leveraging and Abstracting Measurements with perfSONAR (LAMP) ][[BR]] [wiki:InstrumentationTools Instrumentation Tools for a GENI Prototype, a.k.a. INSTOOLS][[BR]] [wiki:Shadow A ShadowBox-based ProtoGENI Instrumentation and Measurement Infrastructure, a.k.a. ShadowNet][[BR]] === GPO Engineers === '''GPO System Engineer:''' [mailto:hmussman@bbn.com Harry Mussman] '''GPO Software Engineer:''' [mailto:johren@BBN.COM Jeanne Ohren] == Scope == This project will develop and deploy the GEMINI instrumentation and measurement framework, capable of supporting the needs of both GENI experimenters and GENI infrastructure operators. It uses the perfSONAR system as its basis, and will include capabilities being developed by key GENI I&M projects, including LAMP and INSTOOLS. It will collect and manage both substrate metrics as well as slice-specific measurements. It will introduce a GENI Global I&M Registry so that GEMINI components can locate one another, and locate measurement sources and data. It will include access control for instrumentation infrastructure, measurements, and measurement data based on GENI policy and authorization mechanisms. [[BR]] == Strategy and Goals == The GENI LAMP project has adapted perfSONAR code for operation in a protoGENI slice, and has included the Periscope display module. The GENI INSTOOLS project has written easy-to-use tools for experimenters who wish to instrument their protoGENI slice. [[BR]] This GEMINI project will merge LAMP (including perfSONAR and Periscope) code and features, with INSTOOLS code and features, to form one set of GEMINI I&M services that can be flexibly deployed in a defined range of GENI environments. [[BR]] Its first goal is to provide easy-to-use I&M services for experimenters, who are deploying slices in GENI on selected types of servers, VMs and racks, interconnected by various types of network paths. [[BR]] Its second goal is to provide comprehensive infrastructure measurement services for infrastructure operators, who are deploying measurement slices on selected types of servers, VMs and racks, interconnected by a various types of network paths. In addition, slices established by other infrastructure operators, or by experimenters, can be authorized to gather data from the measurement slices, via interfaces that retain compatibility with currently deployed perfSONAR services. [[BR]] This project will build and operate three persistent services, including a GENI Global I&M Registry (i.e., UNIS), a GENI Experimenter Portal Service and a GENI Event Messaging Service; these can be utilized by all types of GENI I&M services, including those developed in the GIMI project. The GENI Experimenter Portal Service will be developed in cooperation with the GIMI project, to support both GEMINI and GIMI tools. This project will utilize a persistent service provided by the GIMI project, the GENI Measurement Data Archive service (i.e., iRODs). It will use the GENI Measurement Data Object Descriptor (MDOD) schema, defined for use by all GENI I&M services. [[BR]] == Operational Capabilities == === Milestones === == Spiral 4 == * [[MilestoneDate(GEMINI: S4.a Define and document a defined range of GENI environments)]] * [[MilestoneDate(GEMINI: S4.b Define and document)]] * [[MilestoneDate(GEMINI: S4.c Refactor UNIS)]] * [[MilestoneDate(GEMINI: S4.c.1 Update topology model)]] * [[MilestoneDate(GEMINI: S4.c.2 Modifications)]] * [[MilestoneDate(GEMINI: S4.c.3 Deployment)]] * [[MilestoneDate(GEMINI: S4.c.4 Complete noSQL (MongoDB) backend)]] * [[MilestoneDate(GEMINI: S4.c.5 Unify Perl and Python implementations)]] * [[MilestoneDate(GEMINI: S4.d Refactor LAMP/perfSONAR/Periscope/BLiPP services)]] * [[MilestoneDate(GEMINI: S4.d.1 Refactor LAMP/perfSONAR/Periscope/BLiPP services)]] * [[MilestoneDate(GEMINI: S4.d.2 Refactor LAMP/perfSONAR/Periscope/BLiPP services)]] * [[MilestoneDate(GEMINI: S4.d.3 Refactor LAMP/perfSONAR/Periscope/BLiPP services)]] * [[MilestoneDate(GEMINI: S4.e Refactor and extend LAMP/perfSONAR/Periscope/BLiPP services)]] * [[MilestoneDate(GEMINI: S4.e.1 Refactor and extend LAMP/perfSONAR/Periscope/BLiPP services)]] * [[MilestoneDate(GEMINI: S4.e.2 Refactor and extend LAMP/perfSONAR/Periscope/BLiPP services)]] * [[MilestoneDate(GEMINI: S4.f Refactor perfSONAR Measurement Archive (MA) to Measurement Store (MS) and extend)]] * [[MilestoneDate(GEMINI: S4.f.1 Refactor perfSONAR Measurement Archive (MA) to Measurement Store (MS) and extend)]] * [[MilestoneDate(GEMINI: S4.f.2 Refactor perfSONAR Measurement Archive (MA) to Measurement Store (MS) and extend)]] * [[MilestoneDate(GEMINI: S4.f.3 Refactor perfSONAR Measurement Archive (MA) to Measurement Store (MS) and extend)]] * [[MilestoneDate(GEMINI: S4.g "Refactor INSTOOLS portal service to support GEMINI and GIMI tools, to become the GENI Experimenter Portal Service")]] * [[MilestoneDate(GEMINI: S4.g.1 "Refactor INSTOOLS portal service to support GEMINI and GIMI tools, to become the GENI Experimenter Portal Service")]] * [[MilestoneDate(GEMINI: S4.g.2 "Refactor INSTOOLS portal service to support GEMINI and GIMI tools, to become the GENI Experimenter Portal Service")]] * [[MilestoneDate(GEMINI: S4.g.3 "Refactor INSTOOLS portal service to support GEMINI and GIMI tools, to become the GENI Experimenter Portal Service")]] * [[MilestoneDate(GEMINI: S4.g.4 "Refactor INSTOOLS portal service to support GEMINI and GIMI tools, to become the GENI Experimenter Portal Service")]] * [[MilestoneDate(GEMINI: S4.g.5 "Refactor INSTOOLS portal service to support GEMINI and GIMI tools, to become the GENI Experimenter Portal Service")]] * [[MilestoneDate(GEMINI: S4.g.6 "Refactor INSTOOLS portal service to support GEMINI and GIMI tools, to become the GENI Experimenter Portal Service")]] * [[MilestoneDate(GEMINI: S4.g.7 "Refactor INSTOOLS portal service to support GEMINI and GIMI tools, to become the GENI Experimenter Portal Service")]] * [[MilestoneDate(GEMINI: S4.g.8 "Refactor INSTOOLS portal service to support GEMINI and GIMI tools, to become the GENI Experimenter Portal Service")]] * [[MilestoneDate(GEMINI: S4.h GENI Event Messaging Service (GEMS))]] * [[MilestoneDate(GEMINI: S4.h.1 GENI Event Messaging Service (GEMS))]] * [[MilestoneDate(GEMINI: S4.h.2 GENI Event Messaging Service (GEMS))]] * [[MilestoneDate(GEMINI: S4.h.3 GENI Event Messaging Service (GEMS))]] * [[MilestoneDate(GEMINI: S4.h.4 GENI Event Messaging Service (GEMS))]] * [[MilestoneDate(GEMINI: S4.h.5 GENI Event Messaging Service (GEMS))]] * [[MilestoneDate(GEMINI: S4.i Deliver release of GEMINI v1.0 I&M services software)]] * [[MilestoneDate(GEMINI: S4.j "Demonstrate, document and support the use of GEMINI I&M services")]] * [[MilestoneDate(GEMINI: S4.j.1 "Demonstrate, document and support the use of GEMINI I&M services")]] * [[MilestoneDate(GEMINI: S4.j.2 "Demonstrate, document and support the use of GEMINI I&M services")]] * [[MilestoneDate(GEMINI: S4.j.3 "Demonstrate, document and support the use of GEMINI I&M services")]] * [[MilestoneDate(GEMINI: S4.j.4 "Demonstrate, document and support the use of GEMINI I&M services")]] * [[MilestoneDate(GEMINI: S4.j.5 "Demonstrate, document and support the use of GEMINI I&M services")]] * [[MilestoneDate(GEMINI: S4.k "Demonstrate, document and support the use of GEMINI I&M services")]] * [[MilestoneDate(GEMINI: S4.k.1 "Demonstrate, document and support the use of GEMINI I&M services")]] * [[MilestoneDate(GEMINI: S4.k.2 "Demonstrate, document and support the use of GEMINI I&M services")]] * [[MilestoneDate(GEMINI: S4.k.3 "Demonstrate, document and support the use of GEMINI I&M services")]] * [[MilestoneDate(GEMINI: S4.k.4 "Demonstrate, document and support the use of GEMINI I&M services")]] * [[MilestoneDate(GEMINI: S4.k.5 "Demonstrate, document and support the use of GEMINI I&M services")]] * [[MilestoneDate(GEMINI: S4.k.6 "Demonstrate, document and support the use of GEMINI I&M services")]] === Status Reports and Demonstrations === [http://groups.geni.net/geni/attachment/wiki/GEMINI/gemini-gec13.pptx GEC13 slides] [[BR]] [http://groups.geni.net/geni/attachment/wiki/GEMINI/GEC13%20GEMINI%20Demo%20Poster%20V2.pdf GEC13 demo poster] [[BR]] === Software Releases and Acceptance Tests === [wiki:GEMINI_TopicsIssuesTasks GEMINI v1.0 Design Topics ][[BR]] [wiki:GEMINI_v1.0_Definition GEMINI v1.0 Definition] [[BR]] GEMINI v1.0 Configuration [[BR]] [[Image(Visio-040412_UseCases_Projects_Figures_Page_16.jpg, 50%)]] [[BR]] [wiki:GEMINIIntegrationTasks GEMINI v1.0 Integration Plan and Status][[BR]] GEMINI v1.0 Test Environment [[BR]] [[Image(Visio-040412_UseCases_Projects_Figures_Page_05.jpg, 50%)]] [[BR]] [wiki:GEMINIAcceptanceTests/TestPlan GEMINI v1.0 Acceptance Test Plan][[BR]] [wiki:GEMINIAcceptanceTests/TestStatus GEMINI v1.0 Acceptance Test Results] [[BR]] [wiki:GEMINIAcceptanceTests/GEMINITest8.22.2012 Results on 8/22/12] [[BR]] [http://groups.geni.net/geni/wiki/GEMINITutorial GEMINI v1.0 Instructions] [[BR]] [wiki:100512GEMINIPlanningMeeting GEMINI v1.1 Planning Meeting on October 5, 2012] [[BR]] [wiki:GEMINIv1.1TopicsIssuesTasks GEMINI v1.1 Design Topics ][[BR]] [wiki:GEMINIv1.1Definition GEMINI v1.1 Definition] [[BR]] GEMINI v1.1 Configuration [[BR]] [[Image(, 10%)]] [[BR]] [wiki:GEMINIv1.1IntegrationTasks GEMINI v1.1 Integration Plan and Status][[BR]] [wiki:GEMINIv1.1AcceptanceTests/TestPlan GEMINI v1.1 Acceptance Test Plan][[BR]] [wiki:GEMINIv1.1AcceptanceTests/TestStatus GEMINI v1.1 Acceptance Test Results] [[BR]] [http://groups.geni.net/geni/wiki/GEMINIv1.1Tutorial GEMINI v1.1 Instructions] [[BR]] [wiki:GEMINIv2betaDefinition GEMINI v2beta Definition] [[BR]] [wiki:GEMINIv2.0Definition GEMINI v2.0 Definition] [[BR]] GEMINI v2.0 Configuration [[BR]] [[Image(, 10%)]] [[BR]] === Tutorials and Experimenter Support === [http://groups.geni.net/geni/attachment/wiki/GEMINI/GEC13%20GEMINI%20Demo%20Poster%20V2.pdf GEC13 demo poster] [[BR]] [http://groups.geni.net/geni/wiki/GEC14Agenda/InstaGENIGEMINITutorial Combined InstaGENI and GEMINI Tutorial at GEC14] [[BR]] [http://groups.geni.net/geni/wiki/InstaGENITutorial InstaGENI Tutorial at GEC14] [[BR]] [http://groups.geni.net/geni/wiki/GEMINITutorial GEMINI v1.0 Instructions] [[BR]] [http://groups.geni.net/geni/wiki/GEC15Agenda/GEMINITutorial GEMINI v1.1 Tutorial at GEC15] [[BR]] [http://groups.geni.net/geni/wiki/GEMINIv1.1Tutorial GEMINI v1.1 Instructions] [[BR]] [wiki:GEMINIUserList GEMINI user (experimenters) mailing list] [[BR]] === Technical References === [wiki:TestTutorialExperimentStoryboard I&M Tools: Basic Test/Tutorial/Experiment Storyboard] [[BR]] [wiki:TestTutorialExperimentWorkflow I&M Tools: Basic Test/Tutorial/Experiment Workflow] [[BR]] [http://groups.geni.net/geni/attachment/wiki/GEMINI/091412_gemini_phoebus.txt Phoebus Reference Experiment] [[BR]] [http://groups.geni.net/geni/attachment/wiki/GEMINI/gec15-components.pptx GEMINI New Modules: BLiPP and MS] [[BR]] [http://groups.geni.net/geni/attachment/wiki/GEMINI/Visio-120312_AuthenticationAuthorization_Figures.pdf AuthN and AuthZ Reference Configurations] [[BR]] [http://groups.geni.net/geni/attachment/wiki/GIMI/iRODS_Fact_Sheet-0907c.pdf iRODS fact sheet] [[BR]] [http://groups.geni.net/geni/attachment/wiki/GIMI/iRODS_Overview_0903.pdf iRODS overview] [[BR]] [http://groups.geni.net/geni/attachment/wiki/GIMI/irods-gec14-1.pptx iRODS configuration] [[BR]] [http://groups.geni.net/geni/attachment/wiki/GIMI/041712%20%20gimi_use_cases.pptx iRODS use cases] [[BR]] [http://groups.geni.net/geni/wiki/iRODSwithGSI iRODS with GSI for AuthN] [[BR]] [http://groups.geni.net/geni/attachment/wiki/GEMINI/Visio-120312_AuthenticationAuthorization_Figures%202.pdf GEMINI config with AuthN interface to iRODS] [[BR]] [http://groups.geni.net/geni/attachment/wiki/GEMINI/AA-workflow.png GEMINI Srvc_to_UNIS Workflow Drawing] [[BR]] [http://groups.geni.net/geni/attachment/wiki/GEMINI/112812%20%20unis_aa_usage.txt GEMINI Srvc_to_UNIS Workflow Process] [[BR]] [http://groups.geni.net/geni/attachment/wiki/GEMINI/092812b_gemini_aa_continued.txt Status] [[BR]] [http://groups.geni.net/geni/attachment/wiki/GEMINI/Visio-120312_AuthenticationAuthorization_Figures%205.pdf GEMINI config with AuthN and AuthZ interfaces to UNIS and MS] [[BR]] [wiki:GENICHPortal GENI Clearinghouse Portal] [[BR]] [wiki:RspecExtensionProposal_PortMapping RSpec Extension Proposal to Enable Port Mapping] [[BR]] [wiki:RspecExtensionProposal_ServiceMapping RSpec Extension Proposal for Service Mapping] [[BR]] [http://groups.geni.net/geni/attachment/wiki/GEMINI/GEMINIRepositories.pdf GEMINI Software Repositories] [[BR]]