wiki:GEMINIIntegrationTasks

Version 26 (modified by Jeanne Ohren, 12 years ago) (diff)

--

GEMINI v1.0 Integration Plan and Status

Task List and Status

These tasks are based on the GEMINI v1.0 Integration Plan:

ID Task Owner Due Status Notes
1.1 User workspace VM Jeanne 5/23 Color(green,Complete)? See http://groups.geni.net/geni/wiki/GENIUserWorkspace for instructions
1.2 Find reference experiment Jeanne 5/23 Color(#B0E0E6, In Progress)? 5%
1.3 Document reference cases Jeanne 5/23 Color(green,Complete)? http://groups.geni.net/geni/wiki/GEMINITestPlan#GEMINIv1.0Matrix
1.4 Specify and document rspec extensions Hussam 5/23 Color(green,Complete)? http://groups.geni.net/geni/wiki/GEMINIIntegrationTasks#RSpecExtensions
2.1 Issue tracker Jeanne 5/23 Color(#B0E0E6, In Progress)? 85% Request submitted (ticket 3755), Pinged Chaos on 6/6
3.1 Move Old UNIS to IU Guilherme 5/23 Color(#B0E0E6, In Progress)? 0% Setting up new VM at IU
3.2 Move LAMP CA to IU Guilherme 5/23 Color(#B0E0E6, In Progress)? 0% Setting up new VM at IU
3.3 iRODS at UK Hussam 5/23 Color(green,Complete)? Jeanne and Guilherme received accounts on 5/24
3.4 GEMINI Portal at UK Charles 5/23 Color(orange, Blocked)? Depends on 6.1
4.1 Bug fixes on current perfSONAR modules Guilherme 6/6 Color(#B0E0E6, In Progress)? 50%
4.2 Package and install perfSONAR modules Guilherme 6/6 Color(#B0E0E6, In Progress)? 95% Iterating Packaging and Testing with bug fixes.
4.3 Separate entry into presentation GUI Guilherme 6/6 Not Started
4.4 Verify reference cases Guilherme 6/6 Not Started
5.1 Bug fixes on current INSTOOLS modules Hussam 6/6 Color(#B0E0E6, In Progress)?
5.2 Package INSTOOLS modules Hussam 6/6 Color(#B0E0E6, In Progress)?
5.3 Installation script for INSTOOLS modules Hussam 6/6 Color(#B0E0E6, In Progress)?
5.4 Add ability to verify config ? Hussam 6/6 Not Started
5.5 Verify reference cases Hussam 6/6 Not Started
6.1 Integrate PS and INSTOOLS module installation scripts Hussam and Guilherme 6/20 Not Started
6.2 Verify reference cases for both ANM and PHM together Hussam and Guilherme 6/20 Not Started
6.3 Extend iRODS script to include perfSONAR data Guilherme 6/20 Not Started
7.1 Define acceptance test plan Jeanne 6/20 Color(green,Complete)?
7.2 Execute acceptance tests Jeanne 6/20 Color(#B0E0E6, In Progress)? 10% Executed PS installation and INSTOOLS installation
8.1 Coordinate tutorial with earlier tutorial Harry 7/4 Color(#B0E0E6, In Progress)?
8.2 Define use cases and reference experiments to be included 7/4 Not Started
8.3 Identify tutorial roles 7/4 Not Started
8.4 Prepare tutorial VM Jeanne 7/4 Color(#B0E0E6, In Progress)? 50%
8.5 Prepare materials 7/4 Not Started

Modules and Scripts

Module Owner Status
Old psConfig Guilherme Ready
Old UNIS Guilherme Ready
Bootstrap script Hussam
Service watcher Guilherme Ready
PSBuoy/PINGER Guilherme Ready
PeriViz Guilherme
Drupal CMS Charles
GEMINI Portal Charles
perfSONAR Config Portal Guilherme
PerfAdmin (Presentation) Guilherme
UNIS Encoder Guilherme

Deliverables

User Workspace

Installation Instructions

Credential Instructions

  • 05/25/2012: GENI UW 12.04 v1.0.ova
    • See email for BBN FTP server information
    • See email for usernames and passwords

RSpec Extensions

  • Updated 5/28/2012
    <rspec xmlns:gemini="http://geni.net/resources/rspec/ext/gemini/1">
    	<node>
    		<gemini:node type="global_node">
    			<gemini:monitor_urn name="URN of the AM to monitor"/>
    		</gemini:node>
    	</node> 
    	<node>
    		<gemini:node type="mp_node">
    			<gemini:services>
    				<gemini:active install="yes/no" enable="yes/no" />
    				<gemini:passive install="yes/no" enable="yes/no" />
    			</gemini:services>
    		</gemini:node>
    		<interface>
    		</interface>
    	</node>
    	<link>
    	</link>
    </rspec>
    

GEMINI v1.0 Integration Plan

Based on discussion on 051512:

1) GEMINI v1.0 arch/config/usecases (BBN, IU, UK) (due 5/23)

1.1) Define and document target aggregates, and their interfaces/protocols/APIs

1.2) Define and document user workspace, and experiment control tools

Task: Provide user workspace on a VM, with locations to find keys/certificates/credentials (Jeanne)

1.3) Define and document GEMINI I&M tools, and Reference Experiments

Task: Find useful reference experiments, that are representative and that show usefulness of the tools. (Jeanne)

1.4) Define and document operational services required by GEMINI tools: Old global UNIS; LAMP CA; iRODS; old GEMINI Portal

1.5) Define and document reference use cases

2) GEMINI v1.0 software modules and scripts (IU, UK and BBN) (due 5/16)

2.1) Establish development and integration team: Guilherme Fernandes, Matt Jaffe, Ahmed El-Hassany, Hussam Nasir, Charles Carpenter, Jeanne Ohren

2.2) Establish code repositories: at IU, github; at UK? or use the IU github?

2.3) Establish software development process (IU, UK)

2.4) Establish bug tracking process: trac at BBN (Jeanne)

2.5) Compile list of all modules and scripts, with ownership and status (IU and UK)

3) GEMINI v1.0 required operational services (due 5/23)

3.1) Maintain readiness of old global UNIS (IU)

Task: move from Delaware to IU

3.2) Maintain readiness of LAMP CA (IU)

Task: move from Delaware to IU

3.3) Maintain readiness of iRODS at UK (Hussam)

3.4) Maintain readiness of old GEMINI Portal at UK (Charles)

Issue: may need to modify, to include LAMP tools

4) GEMINI v1.0 integration of LAMP modules, for active network measurements (IU) (due 6/6)

4.1) Take LAMP modules, assemble into packages, load into target aggregates (cases 1 - n)

Task: separate entry to presentation GUI.

4.2) Build installation script for LAMP modules, with ability to specify target hosts, and verify installation into target aggregates (cases 1 - n)

Issue: how to specify target hosts? add to request_rspec, then pull from returned manifest_rspec? Task: how to specify rspecs, with adders for I&M Issue: how many options for each host? perhaps passive host; active network; common node Task: provide script to push manifest_rspec to old global UNIS Issue: Use script provided by UK to pull manifest_rspec from UNIS, and then install desired modules.

4.3) Verify ability to configure and run tools via GUI (separate from presentation GUI)

Task: add ability to verify config; add ability to start/stop/restart tools

4.4) Verify ability to present results via GUI (separate from configuration GUI)

4.5) Use old GEMINI Portal to access configuration and presentation GUIs

4.6) Verify entire reference use case, including: getting keys/certificates/credentials; formulating desired topology; formulating desired request_rspec; specifying installation on desired hosts; getting resources; using installation script to install on desired hosts; configuring tools; running tools; presenting results.

Task: identify issues, and resolve. Task: repeat for target aggregates (cases 1 - n)

4.7) Repeat reference use case, but include reference experiments

Task: identify issues, and resolve. Task: repeat for target aggregates (cases 1 - n)

5) GEMINI v1.0 integration of INSTOOLS modules, for passive host measurements (UK) (due 6/6)

5.1) Take INSTOOLS modules, assemble into packages, load into target aggregates (cases 1 - n)

5.2) Build installation script for INSTOOLS modules, with ability to specify target hosts, and verify installation into target aggregates (cases 1 - n)

Issue: how to specify target hosts? add to request_rspec, then pull from returned manifest_rspec?

Task: how to specify rspecs, with adders for I&M

Issue: how many options for each host? perhaps passive host; active network; common node Task: provide script to pull manifest_rspec from UNIS, and then install all desired modules, LAMP and INSTOOLS.

5.3) Verify ability to configure and run tools via ?

Task: add ability to verify config

5.4) Verify ability to present results via GUI, available via GEMINI Portal

5.5) Verify ability to push results from GEMINI Potal to IRODS archive service, and retrieve

5.6) Verify entire reference use case, including: getting keys/certificates/credentials; formulating desired topology; formulating desired request_rspec; specifying installation on desired hosts; getting resources; using isntallation script to install on desired hosts; configuring tools; running tools; presenting results; pushing to archive service, and retrieving

Task: identify issues, and resolve. Task: repeat for target aggregates (cases 1 - n)

5.7) Repeat reference use case, but include reference experiments

Task: identify issues, and resolve. Task: repeat for target aggregates (cases 1 - n)

6) GEMINI v1.0 integration of both INSTOOLS and LAMP modules, for both passive host measurements and active network measurements (IU, UK and BBN) (due 6/20)

6.1) Take INSTOOLS and LAMP modules modules, assemble into packages, load into target aggregates (cases 1 - n)

6.2) Build installation script for INSTOOLS and LAMP modules modules, with ability to specify target hosts, and verify installation into target aggregates (cases 1 - n)

6.3) Verify ability to configure and run tools via ? and GUI

Task: verify ability to verify config; add verify ability to start/stop/restart tools

6.4) Verify ability to present all results via GUIs, available via GEMINI Portal

6.5) Verify ability to push some results from GEMINI Portal to IRODS archive service, and retrieve

6.6) Verify entire reference use case, including: getting keys/certificates/credentials; formulating desired topology; formulating desired request_rspec; specifying installation on desired hosts; getting resources; using isntallation script to install on desired hosts; configuring tools; running tools; presenting results; pushing to archive service, and retrieving

Task: identify issues, and resolve. Task: repeat for target aggregates (cases 1 - n)

6.7) Repeat reference use case, but include reference experiments

Task: identify issues, and resolve. Task: repeat for target aggregates (cases 1 - n)

7) GEMINI v1.1 acceptance tests (BBN) (due 6/20)

7.1) Define acceptance test plan, and provide tabular view of capabilites

7.2) Execute acceptance test plan

Task: identify issues, and get development team to resolve, then retest

7.3) Recommend capabilites and features that are ready for use by experimenters

8) GEMINI v1.0 tutorial at GEC14 (IU, UK and BBN) (due 7/4)

8.1) Define reference uses cases and reference experiments to be included

Issue: Coordinate with earlier tutorial, that shows how to setup an experiment, and that leaves experiment setup, ready for instrumentation

8.2) Write detailed procedure

Task: practice, identify issues, resolve issues, and refine

8.3) Prepare materials for tutorial

Attachments (2)

Download all attachments as: .zip