Version 76 (modified by 10 years ago) (diff) | ,
---|
Project Number
1893
Project Title
GEMINI: A GENI Measurement and Instrumentation Infrastructure
a.k.a GEMINI
Technical Contacts
PI Martin Swany, Indiana University (mailto:swany@iu.edu)
Co-PI Chris Small, Indiana University (mailto:chsmall@indiana.edu)
Co-PI James Griffioen, University of Kentucky (mailto:griff@netlab.uky.edu)
Co-PI Zongming Fei, University of Kentucky (mailto:fei@netlab.uky.edu)
Participating Organizations
Indiana University
University of Kentucky
Related Projects
Leveraging and Abstracting Measurements with perfSONAR (LAMP)
Instrumentation Tools for a GENI Prototype, a.k.a. INSTOOLS
A ShadowBox-based ProtoGENI Instrumentation and Measurement Infrastructure, a.k.a. ShadowNet
GPO Engineers
GPO System Engineer: Harry Mussman
GPO Software Engineer: Jeanne Ohren
Scope
This project will develop and deploy the GEMINI instrumentation and measurement framework, capable of supporting the needs of both GENI experimenters and GENI infrastructure operators. It uses the perfSONAR system as its basis, and will include capabilities being developed by key GENI I&M projects, including LAMP and INSTOOLS. It will collect and manage both substrate metrics as well as slice-specific measurements. It will introduce a GENI Global I&M Registry so that GEMINI components can locate one another, and locate measurement sources and data. It will include access control for instrumentation infrastructure, measurements, and measurement data based on GENI policy and authorization mechanisms.
Strategy and Goals
The GENI LAMP project has adapted perfSONAR code for operation in a protoGENI slice, and has included the Periscope display module. The GENI INSTOOLS project has written easy-to-use tools for experimenters who wish to instrument their protoGENI slice.
This GEMINI project will merge LAMP (including perfSONAR and Periscope) code and features, with INSTOOLS code and features, to form one set of GEMINI I&M services that can be flexibly deployed in a defined range of GENI environments.
Its first goal is to provide easy-to-use I&M services for experimenters, who are deploying slices in GENI on selected types of servers, VMs and racks, interconnected by various types of network paths.
Its second goal is to provide comprehensive infrastructure measurement services for infrastructure operators, who are deploying measurement slices on selected types of servers, VMs and racks, interconnected by a various types of network paths. In addition, slices established by other infrastructure operators, or by experimenters, can be authorized to gather data from the measurement slices, via interfaces that retain compatibility with currently deployed perfSONAR services.
This project will build and operate three persistent services, including a GENI Global I&M Registry (i.e., UNIS), a GENI Experimenter Portal Service and a GENI Event Messaging Service; these can be utilized by all types of GENI I&M services, including those developed in the GIMI project. The GENI Experimenter Portal Service will be developed in cooperation with the GIMI project, to support both GEMINI and GIMI tools. This project will utilize a persistent service provided by the GIMI project, the GENI Measurement Data Archive service (i.e., iRODs). It will use the GENI Measurement Data Object Descriptor (MDOD) schema, defined for use by all GENI I&M services.
Operational Capabilities
Milestones
Spiral 4
- MilestoneDate(GEMINI: S4.a Define and document a defined range of GENI environments)?
- MilestoneDate(GEMINI: S4.b Define and document)?
- MilestoneDate(GEMINI: S4.c Refactor UNIS)?
- MilestoneDate(GEMINI: S4.c.1 Update topology model)?
- MilestoneDate(GEMINI: S4.c.2 Modifications)?
- MilestoneDate(GEMINI: S4.c.3 Deployment)?
- MilestoneDate(GEMINI: S4.c.4 Complete noSQL (MongoDB) backend)?
- MilestoneDate(GEMINI: S4.c.5 Unify Perl and Python implementations)?
- MilestoneDate(GEMINI: S4.d Refactor LAMP/perfSONAR/Periscope/BLiPP services)?
- MilestoneDate(GEMINI: S4.d.1 Refactor LAMP/perfSONAR/Periscope/BLiPP services)?
- MilestoneDate(GEMINI: S4.d.2 Refactor LAMP/perfSONAR/Periscope/BLiPP services)?
- MilestoneDate(GEMINI: S4.d.3 Refactor LAMP/perfSONAR/Periscope/BLiPP services)?
- MilestoneDate(GEMINI: S4.e Refactor and extend LAMP/perfSONAR/Periscope/BLiPP services)?
- MilestoneDate(GEMINI: S4.e.1 Refactor and extend LAMP/perfSONAR/Periscope/BLiPP services)?
- MilestoneDate(GEMINI: S4.e.2 Refactor and extend LAMP/perfSONAR/Periscope/BLiPP services)?
- MilestoneDate(GEMINI: S4.f Refactor perfSONAR Measurement Archive (MA) to Measurement Store (MS) and extend)?
- MilestoneDate(GEMINI: S4.f.1 Refactor perfSONAR Measurement Archive (MA) to Measurement Store (MS) and extend)?
- MilestoneDate(GEMINI: S4.f.2 Refactor perfSONAR Measurement Archive (MA) to Measurement Store (MS) and extend)?
- MilestoneDate(GEMINI: S4.f.3 Refactor perfSONAR Measurement Archive (MA) to Measurement Store (MS) and extend)?
- MilestoneDate(GEMINI: S4.g "Refactor INSTOOLS portal service to support GEMINI and GIMI tools, to become the GENI Experimenter Portal Service")?
- MilestoneDate(GEMINI: S4.g.1 "Refactor INSTOOLS portal service to support GEMINI and GIMI tools, to become the GENI Experimenter Portal Service")?
- MilestoneDate(GEMINI: S4.g.2 "Refactor INSTOOLS portal service to support GEMINI and GIMI tools, to become the GENI Experimenter Portal Service")?
- MilestoneDate(GEMINI: S4.g.3 "Refactor INSTOOLS portal service to support GEMINI and GIMI tools, to become the GENI Experimenter Portal Service")?
- MilestoneDate(GEMINI: S4.g.4 "Refactor INSTOOLS portal service to support GEMINI and GIMI tools, to become the GENI Experimenter Portal Service")?
- MilestoneDate(GEMINI: S4.g.5 "Refactor INSTOOLS portal service to support GEMINI and GIMI tools, to become the GENI Experimenter Portal Service")?
- MilestoneDate(GEMINI: S4.g.6 "Refactor INSTOOLS portal service to support GEMINI and GIMI tools, to become the GENI Experimenter Portal Service")?
- MilestoneDate(GEMINI: S4.g.7 "Refactor INSTOOLS portal service to support GEMINI and GIMI tools, to become the GENI Experimenter Portal Service")?
- MilestoneDate(GEMINI: S4.g.8 "Refactor INSTOOLS portal service to support GEMINI and GIMI tools, to become the GENI Experimenter Portal Service")?
- MilestoneDate(GEMINI: S4.h GENI Event Messaging Service (GEMS))?
- MilestoneDate(GEMINI: S4.h.1 GENI Event Messaging Service (GEMS))?
- MilestoneDate(GEMINI: S4.h.2 GENI Event Messaging Service (GEMS))?
- MilestoneDate(GEMINI: S4.h.3 GENI Event Messaging Service (GEMS))?
- MilestoneDate(GEMINI: S4.h.4 GENI Event Messaging Service (GEMS))?
- MilestoneDate(GEMINI: S4.h.5 GENI Event Messaging Service (GEMS))?
- MilestoneDate(GEMINI: S4.i Deliver release of GEMINI v1.0 I&M services software)?
- MilestoneDate(GEMINI: S4.j "Demonstrate, document and support the use of GEMINI I&M services")?
- MilestoneDate(GEMINI: S4.j.1 "Demonstrate, document and support the use of GEMINI I&M services")?
- MilestoneDate(GEMINI: S4.j.2 "Demonstrate, document and support the use of GEMINI I&M services")?
- MilestoneDate(GEMINI: S4.j.3 "Demonstrate, document and support the use of GEMINI I&M services")?
- MilestoneDate(GEMINI: S4.j.4 "Demonstrate, document and support the use of GEMINI I&M services")?
- MilestoneDate(GEMINI: S4.j.5 "Demonstrate, document and support the use of GEMINI I&M services")?
- MilestoneDate(GEMINI: S4.k "Demonstrate, document and support the use of GEMINI I&M services")?
- MilestoneDate(GEMINI: S4.k.1 "Demonstrate, document and support the use of GEMINI I&M services")?
- MilestoneDate(GEMINI: S4.k.2 "Demonstrate, document and support the use of GEMINI I&M services")?
- MilestoneDate(GEMINI: S4.k.3 "Demonstrate, document and support the use of GEMINI I&M services")?
- MilestoneDate(GEMINI: S4.k.4 "Demonstrate, document and support the use of GEMINI I&M services")?
- MilestoneDate(GEMINI: S4.k.5 "Demonstrate, document and support the use of GEMINI I&M services")?
- MilestoneDate(GEMINI: S4.k.6 "Demonstrate, document and support the use of GEMINI I&M services")?
Status Reports and Demonstrations
Software Releases and Acceptance Tests
GEMINI v1.0 Acceptance Test Plan
GEMINI v1.0 Acceptance Test Results
Results on 8/22/12
GEMINI v1.1 Configuration
![]()
GEMINI v1.1 Acceptance Test Plan?
GEMINI v1.1 Acceptance Test Results?
GEMINI v2.0 Configuration
![]()
Tutorials and Experimenter Support
Technical References
I&M Tools: Basic Test/Tutorial/Experiment Storyboard
I&M Tools: Basic Test/Tutorial/Experiment Workflow
iRODS fact sheet
iRODS overview
iRODS configuration
iRODS use cases
iRODS with GSI for AuthN
GEMINI config with AuthN interface to iRODS
GEMINI Srvc_to_UNIS Workflow Drawing
GEMINI Srvc_to_UNIS Workflow Process
Status
GEMINI config with AuthN and AuthZ interfaces to UNIS and MS
GENI Clearinghouse Portal
GENI CH_Portal and CH_CertificateKeyStore Configuration
GENI_Desktop (Portal) Configuration
GEMINI config with GEMINI_Portal
GEMINI config with GENI_Desktop (portal)
RSpec Extension Proposal to Enable Port Mapping
RSpec Extension Proposal for Service Mapping
Spiral 5
Status Reports and Demonstrations
Sol3 Year2 Jul-Oct 2013.docx GEMINI 7-10/2013 Quarterly Report
Tutorials and Experimenter Support
Attachments (28)
- GEC13 GEMINI Demo Poster V2.pdf (457.0 KB) - added by 12 years ago.
- gemini-gec13.pptx (1.2 MB) - added by 12 years ago.
- Visio-040412_UseCases_Projects_Figures_Page_04.jpg (455.1 KB) - added by 12 years ago.
- Visio-040412_UseCases_Projects_Figures_Page_05.jpg (588.5 KB) - added by 12 years ago.
- Visio-040412_UseCases_Projects_Figures_Page_06.jpg (278.1 KB) - added by 12 years ago.
- Visio-040412_UseCases_Projects_Figures_Page_07.jpg (380.4 KB) - added by 12 years ago.
- Visio-040412_UseCases_Projects_Figures_Page_08.jpg (439.4 KB) - added by 12 years ago.
- Visio-040412_UseCases_Projects_Figures_Page_16.jpg (612.4 KB) - added by 12 years ago.
- 050312_GEMINI_TopicsIssuesTasks.txt (24.1 KB) - added by 12 years ago.
- Visio-083112_AuthenticationAuthorization_Figures.pdf (27.7 KB) - added by 12 years ago.
- AA-workflow.png (123.8 KB) - added by 12 years ago.
- gec15-components.pptx (80.9 KB) - added by 12 years ago.
- GEMINIRepositories.pdf (56.0 KB) - added by 12 years ago.
- gec15-components.pdf (73.8 KB) - added by 12 years ago.
- 091412_gemini_phoebus.txt (3.9 KB) - added by 12 years ago.
- 092812_gemini_aa_continued.txt (3.9 KB) - added by 12 years ago.
- 092812b_gemini_aa_continued.txt (6.2 KB) - added by 12 years ago.
- 101112 gemini_aa.txt (10.8 KB) - added by 12 years ago.
- Visio-120312_AuthenticationAuthorization_Figures 2.pdf (18.4 KB) - added by 11 years ago.
- Visio-120312_AuthenticationAuthorization_Figures 5.pdf (21.8 KB) - added by 11 years ago.
- Visio-120312_AuthenticationAuthorization_Figures 6.pdf (70.9 KB) - added by 11 years ago.
- Visio-120312_AuthenticationAuthorization_Figures 7.pdf (70.3 KB) - added by 11 years ago.
- Visio-120312_AuthenticationAuthorization_Figures 9.pdf (30.2 KB) - added by 11 years ago.
- Visio-120312_AuthenticationAuthorization_Figures 10.pdf (28.2 KB) - added by 11 years ago.
- Visio-120312_AuthenticationAuthorization_Figures.pdf (283.1 KB) - added by 11 years ago.
- 112812 unis_aa_usage.txt (14.6 KB) - added by 11 years ago.
-
GEMINI_Sol3_Year2_Jul-Oct-2013.docx (19.3 KB) - added by 10 years ago.
GEMINI 7-10/2013 Quarterly Report
-
GEC 19 Project Report.docx (19.4 KB) - added by 10 years ago.
GEMINI 10/13-3/14 Quarterly Report