wiki:GEMINIIntegrationTasks

Version 34 (modified by Jeanne Ohren, 7 years ago) (diff)

--

GEMINI v1.0 Integration Plan and Status

Task List and Status

These tasks are based on the GEMINI v1.0 Integration Plan:

ID Task Owner Due Status Notes
1.1 User workspace VM Jeanne 5/23 Color(green,Complete)? See http://groups.geni.net/geni/wiki/GENIUserWorkspace for instructions
1.2 Find reference experiment Ezra Color(#B0E0E6, In Progress)? 5% Ezra will try using XSP and prepare instructions
1.3 Document reference cases Jeanne 5/23 Color(green,Complete)? http://groups.geni.net/geni/wiki/GEMINITestPlan#GEMINIv1.0Matrix
1.4 Specify and document rspec extensions Hussam 5/23 Color(green,Complete)? http://groups.geni.net/geni/wiki/GEMINIIntegrationTasks#RSpecExtensions
2.1 Issue tracker Jeanne 5/23 Color(green, Complete)? http://groups.geni.net/gemini
3.1 Move Old UNIS to IU Guilherme 5/23 Color(green,Complete)? https://unis.incntre.iu.edu:8012/perfSONAR_PS/services/unis
3.2 Move LAMP CA to IU Guilherme 5/23 Color(green,Complete)? https://unis.incntre.iu.edu/protogeni/xmlrpc/lampca
3.3 iRODS at UK Hussam 5/23 Color(green,Complete)? https://irodwes.netlab.uky.edu/irodsweb
3.4 GEMINI Portal at UK Charles 5/23 Color(green, Complete)? http://geminiportal.netlab.uky.edu
4.1 Bug fixes on current perfSONAR modules Guilherme 6/6 Color(green,Complete)?
4.2 Package and install perfSONAR modules Guilherme 6/6 Color(green,Complete)?
4.3 Separate entry into presentation GUI Guilherme 6/6 Color(green,Complete)?
4.4 Verify reference cases Guilherme 6/6 Color(#B0E0E6, In Progress)?
5.1 Bug fixes on current INSTOOLS modules Hussam 6/6 Color(green,Complete)?
5.2 Package INSTOOLS modules Hussam 6/6 Color(green,Complete)?
5.3 Installation script for INSTOOLS modules Hussam 6/6 Color(green,Complete)?
5.4 Add ability to verify config ? Hussam 6/6 Not Started
5.5 Verify reference cases Hussam 6/6 Color(#B0E0E6, In Progress)?
6.1 Integrate PS and INSTOOLS module installation scripts Hussam and Guilherme 6/20 Color(green,Complete)?
6.2 Verify reference cases for both active and passive together Hussam and Guilherme 6/20 Color(#B0E0E6, In Progress)?
6.3 Extend iRODS script to include perfSONAR data Guilherme 6/20 Color(#FF6600, "Won't Fix")? Will be done for the new architecture after GEC 14.
7.1 Define acceptance test plan Jeanne 6/20 Color(green,Complete)?
7.2 Execute acceptance tests Jeanne 6/20 Color(#B0E0E6, In Progress)? 75% Executed instrumentize script, passive and active meas.
Executed existing iRODS functionality
No reference experiment
8.1 Coordinate tutorial with earlier tutorial Harry 7/4 Color(#B0E0E6, Complete)? Conf call with Rob Ricci on 6/21
8.2 Define use cases and reference experiments to be included 7/4 Not Started
8.3 Identify tutorial roles 7/4 Not Started
8.4 Prepare tutorial VM Jeanne 7/4 Color(#B0E0E6, In Progress)? 95% Credentials added
need to add bookmarks and GEMINI UW repository
8.5 Prepare materials 7/4 Not Started

Modules and Scripts

Module Owner Status
Old psConfig Guilherme Ready
Old UNIS Guilherme Ready
Bootstrap script Hussam
Service watcher Guilherme Ready
PSBuoy/PINGER Guilherme Ready
Drupal CMS Charles
GEMINI Portal Charles
perfSONAR Config Portal Guilherme Ready
PerfAdmin (Presentation) Guilherme Ready

Deliverables

User Workspace

Installation Instructions

Credential Instructions

  • 05/25/2012: GENI UW 12.04 v1.0.ova
    • See email for BBN FTP server information
    • See email for usernames and passwords

RSpec Extensions

  • Updated 5/28/2012
    <rspec xmlns:gemini="http://geni.net/resources/rspec/ext/gemini/1">
    	<node>
    		<gemini:node type="global_node">
    			<gemini:monitor_urn name="URN of the AM to monitor"/>
    		</gemini:node>
    	</node> 
    	<node>
    		<gemini:node type="mp_node">
    			<gemini:services>
    				<gemini:active install="yes/no" enable="yes/no" />
    				<gemini:passive install="yes/no" enable="yes/no" />
    			</gemini:services>
    		</gemini:node>
    		<interface>
    		</interface>
    	</node>
    	<link>
    	</link>
    </rspec>
    

GEMINI v1.0 Integration Plan

Based on discussion on 051512:

1) GEMINI v1.0 arch/config/usecases (BBN, IU, UK) (due 5/23)

1.1) Define and document target aggregates, and their interfaces/protocols/APIs

1.2) Define and document user workspace, and experiment control tools

Task: Provide user workspace on a VM, with locations to find keys/certificates/credentials (Jeanne)

1.3) Define and document GEMINI I&M tools, and Reference Experiments

Task: Find useful reference experiments, that are representative and that show usefulness of the tools. (Jeanne)

1.4) Define and document operational services required by GEMINI tools: Old global UNIS; LAMP CA; iRODS; old GEMINI Portal

1.5) Define and document reference use cases

2) GEMINI v1.0 software modules and scripts (IU, UK and BBN) (due 5/16)

2.1) Establish development and integration team: Guilherme Fernandes, Matt Jaffe, Ahmed El-Hassany, Hussam Nasir, Charles Carpenter, Jeanne Ohren

2.2) Establish code repositories: at IU, github; at UK? or use the IU github?

2.3) Establish software development process (IU, UK)

2.4) Establish bug tracking process: trac at BBN (Jeanne)

2.5) Compile list of all modules and scripts, with ownership and status (IU and UK)

3) GEMINI v1.0 required operational services (due 5/23)

3.1) Maintain readiness of old global UNIS (IU)

Task: move from Delaware to IU

3.2) Maintain readiness of LAMP CA (IU)

Task: move from Delaware to IU

3.3) Maintain readiness of iRODS at UK (Hussam)

3.4) Maintain readiness of old GEMINI Portal at UK (Charles)

Issue: may need to modify, to include LAMP tools

4) GEMINI v1.0 integration of LAMP modules, for active network measurements (IU) (due 6/6)

4.1) Take LAMP modules, assemble into packages, load into target aggregates (cases 1 - n)

Task: separate entry to presentation GUI.

4.2) Build installation script for LAMP modules, with ability to specify target hosts, and verify installation into target aggregates (cases 1 - n)

Issue: how to specify target hosts? add to request_rspec, then pull from returned manifest_rspec? Task: how to specify rspecs, with adders for I&M Issue: how many options for each host? perhaps passive host; active network; common node Task: provide script to push manifest_rspec to old global UNIS Issue: Use script provided by UK to pull manifest_rspec from UNIS, and then install desired modules.

4.3) Verify ability to configure and run tools via GUI (separate from presentation GUI)

Task: add ability to verify config; add ability to start/stop/restart tools

4.4) Verify ability to present results via GUI (separate from configuration GUI)

4.5) Use old GEMINI Portal to access configuration and presentation GUIs

4.6) Verify entire reference use case, including: getting keys/certificates/credentials; formulating desired topology; formulating desired request_rspec; specifying installation on desired hosts; getting resources; using installation script to install on desired hosts; configuring tools; running tools; presenting results.

Task: identify issues, and resolve. Task: repeat for target aggregates (cases 1 - n)

4.7) Repeat reference use case, but include reference experiments

Task: identify issues, and resolve. Task: repeat for target aggregates (cases 1 - n)

5) GEMINI v1.0 integration of INSTOOLS modules, for passive host measurements (UK) (due 6/6)

5.1) Take INSTOOLS modules, assemble into packages, load into target aggregates (cases 1 - n)

5.2) Build installation script for INSTOOLS modules, with ability to specify target hosts, and verify installation into target aggregates (cases 1 - n)

Issue: how to specify target hosts? add to request_rspec, then pull from returned manifest_rspec?

Task: how to specify rspecs, with adders for I&M

Issue: how many options for each host? perhaps passive host; active network; common node Task: provide script to pull manifest_rspec from UNIS, and then install all desired modules, LAMP and INSTOOLS.

5.3) Verify ability to configure and run tools via ?

Task: add ability to verify config

5.4) Verify ability to present results via GUI, available via GEMINI Portal

5.5) Verify ability to push results from GEMINI Potal to IRODS archive service, and retrieve

5.6) Verify entire reference use case, including: getting keys/certificates/credentials; formulating desired topology; formulating desired request_rspec; specifying installation on desired hosts; getting resources; using isntallation script to install on desired hosts; configuring tools; running tools; presenting results; pushing to archive service, and retrieving

Task: identify issues, and resolve. Task: repeat for target aggregates (cases 1 - n)

5.7) Repeat reference use case, but include reference experiments

Task: identify issues, and resolve. Task: repeat for target aggregates (cases 1 - n)

6) GEMINI v1.0 integration of both INSTOOLS and LAMP modules, for both passive host measurements and active network measurements (IU, UK and BBN) (due 6/20)

6.1) Take INSTOOLS and LAMP modules modules, assemble into packages, load into target aggregates (cases 1 - n)

6.2) Build installation script for INSTOOLS and LAMP modules modules, with ability to specify target hosts, and verify installation into target aggregates (cases 1 - n)

6.3) Verify ability to configure and run tools via ? and GUI

Task: verify ability to verify config; add verify ability to start/stop/restart tools

6.4) Verify ability to present all results via GUIs, available via GEMINI Portal

6.5) Verify ability to push some results from GEMINI Portal to IRODS archive service, and retrieve

6.6) Verify entire reference use case, including: getting keys/certificates/credentials; formulating desired topology; formulating desired request_rspec; specifying installation on desired hosts; getting resources; using isntallation script to install on desired hosts; configuring tools; running tools; presenting results; pushing to archive service, and retrieving

Task: identify issues, and resolve. Task: repeat for target aggregates (cases 1 - n)

6.7) Repeat reference use case, but include reference experiments

Task: identify issues, and resolve. Task: repeat for target aggregates (cases 1 - n)

7) GEMINI v1.1 acceptance tests (BBN) (due 6/20)

7.1) Define acceptance test plan, and provide tabular view of capabilites

7.2) Execute acceptance test plan

Task: identify issues, and get development team to resolve, then retest

7.3) Recommend capabilites and features that are ready for use by experimenters

8) GEMINI v1.0 tutorial at GEC14 (IU, UK and BBN) (due 7/4)

8.1) Define reference uses cases and reference experiments to be included

Issue: Coordinate with earlier tutorial, that shows how to setup an experiment, and that leaves experiment setup, ready for instrumentation

8.2) Write detailed procedure

Task: practice, identify issues, resolve issues, and refine

8.3) Prepare materials for tutorial

Attachments (2)

Download all attachments as: .zip