[[PageOutline]] == GEMINI v1.1 Integration Plan and Status == === Task List and Status === These tasks are based on the [http://groups.geni.net/geni/wiki/GEMINIIntegrationTasks#GEMINIv1.0IntegrationPlan GEMINI v1.0 Integration Plan]: || '''ID''' || ''' Task ''' || '''Owner''' || '''Due''' || '''Status''' || ''' Notes''' || || 1.1 || User workspace VM || Jeanne || 5/23 || [[Color(green,Complete)]] || See [http://groups.geni.net/geni/wiki/GENIUserWorkspace] for instructions || || 1.2 || Find reference experiment || Ezra || || [[Color(#B0E0E6, In Progress)]] 5% || Ezra will try using XSP and prepare instructions || || 1.3 || Document reference cases || Jeanne || 5/23 || [[Color(green,Complete)]] || [http://groups.geni.net/geni/wiki/GEMINITestPlan#GEMINIv1.0Matrix] || || 1.4 || Specify and document rspec extensions || Hussam || 5/23 || [[Color(green,Complete)]] || [http://groups.geni.net/geni/wiki/GEMINIIntegrationTasks#RSpecExtensions] || || 2.1 || Issue tracker || Jeanne || 5/23 || [[Color(green, Complete)]] || [http://groups.geni.net/gemini] || || 3.1 || Move Old UNIS to IU || Guilherme || 5/23 || [[Color(green,Complete)]] || https://unis.incntre.iu.edu:8012/perfSONAR_PS/services/unis || || 3.2 || Move LAMP CA to IU || Guilherme || 5/23 || [[Color(green,Complete)]] || https://unis.incntre.iu.edu/protogeni/xmlrpc/lampca || || 3.3 || iRODS at UK || Hussam || 5/23 || [[Color(green,Complete)]] || [https://irodwes.netlab.uky.edu/irodsweb] || || 3.4 || GEMINI Portal at UK || Charles || 5/23 || [[Color(green, Complete)]] || [http://geminiportal.netlab.uky.edu] || || 4.1 || Bug fixes on current perfSONAR modules || Guilherme || 6/6 || [[Color(green,Complete)]] || || || 4.2 || Package and install perfSONAR modules || Guilherme || 6/6 || [[Color(green,Complete)]] || || || 4.3 || Separate entry into presentation GUI || Guilherme || 6/6 || [[Color(green,Complete)]] || || || 4.4 || Verify reference cases || Guilherme || 6/6 || [[Color(#B0E0E6, In Progress)]] || || || 5.1 || Bug fixes on current INSTOOLS modules || Hussam || 6/6 || [[Color(green,Complete)]] || || || 5.2 || Package INSTOOLS modules || Hussam || 6/6 || [[Color(green,Complete)]] || || || 5.3 || Installation script for INSTOOLS modules || Hussam || 6/6 || [[Color(green,Complete)]] || || || 5.5 || Verify reference cases || Hussam || 6/6 || [[Color(#B0E0E6, In Progress)]] || || || 6.1 || Integrate PS and INSTOOLS module installation scripts || Hussam and Guilherme || 6/20 || [[Color(green,Complete)]] || || || 6.2 || Verify reference cases for both active and passive together || Hussam and Guilherme || 6/20 || [[Color(#B0E0E6, In Progress)]] || || || 6.3 || Extend iRODS script to include perfSONAR data || Guilherme || 6/20 || [[Color(#FF6600, "Won't Fix")]] || Will be done for the new architecture after GEC 14. || || 7.1 || Define acceptance test plan || Jeanne || 6/20 || [[Color(green,Complete)]] || || || 7.2 || Execute acceptance tests || Jeanne || 6/20 || [[Color(#B0E0E6, In Progress)]] 75% || Executed instrumentize script, passive and active meas. [[BR]] Executed existing iRODS functionality [[BR]] No reference experiment || || 8.1 || Coordinate tutorial with earlier tutorial || Harry || 7/4 || [[Color(green, Complete)]] || Conf call with Rob Ricci on 6/21 || || 8.2 || Define use cases and reference experiments to be included || Ezra? || 7/4 || [[Color(#B0E0E6, In Progress)]] || || || 8.3 || Identify tutorial roles || || 7/4 || [[Color(#B0E0E6, In Progress)]] || || || 8.4 || Prepare tutorial VM || Jeanne || 7/4 || [[Color(green, Complete)]] || || || 8.5 || Prepare materials || || 7/4 || Not Started || || === Modules and Scripts === || '''Module''' || '''Owner''' || '''Status''' || || Old psConfig || Guilherme || Ready || || Old UNIS || Guilherme || Ready || || Bootstrap script || Hussam || || || Service watcher || Guilherme || Ready || || PSBuoy/PINGER || Guilherme || Ready || || Drupal CMS || Charles || || || GEMINI Portal || Charles || || || perfSONAR Config Portal || Guilherme || Ready || || !PerfAdmin (Presentation) || Guilherme || Ready || === Deliverables === ==== User Workspace ==== [wiki:GENIUserWorkspace#InstallingtheVM Installation Instructions] [wiki:GENIUserWorkspace#ConfiguringCredentials Credential Instructions] * 05/25/2012: GENI UW 12.04 v1.0.ova - See email for BBN FTP server information - See email for usernames and passwords ==== RSpec Extensions ==== * Updated 5/28/2012 {{{ }}} === GEMINI v1.0 Integration Plan === Based on discussion on 051512: [[BR]] 1) GEMINI v1.0 arch/config/usecases (BBN, IU, UK) (due 5/23) 1.1) Define and document target aggregates, and their interfaces/protocols/APIs 1.2) Define and document user workspace, and experiment control tools Task: Provide user workspace on a VM, with locations to find keys/certificates/credentials (Jeanne) 1.3) Define and document GEMINI I&M tools, and Reference Experiments Task: Find useful reference experiments, that are representative and that show usefulness of the tools. (Jeanne) 1.4) Define and document operational services required by GEMINI tools: Old global UNIS; LAMP CA; iRODS; old GEMINI Portal 1.5) Define and document reference use cases 2) GEMINI v1.0 software modules and scripts (IU, UK and BBN) (due 5/16) 2.1) Establish development and integration team: Guilherme Fernandes, Matt Jaffe, Ahmed El-Hassany, Hussam Nasir, Charles Carpenter, Jeanne Ohren 2.2) Establish code repositories: at IU, github; at UK? or use the IU github? 2.3) Establish software development process (IU, UK) 2.4) Establish bug tracking process: trac at BBN (Jeanne) 2.5) Compile list of all modules and scripts, with ownership and status (IU and UK) 3) GEMINI v1.0 required operational services (due 5/23) 3.1) Maintain readiness of old global UNIS (IU) Task: move from Delaware to IU 3.2) Maintain readiness of LAMP CA (IU) Task: move from Delaware to IU 3.3) Maintain readiness of iRODS at UK (Hussam) 3.4) Maintain readiness of old GEMINI Portal at UK (Charles) Issue: may need to modify, to include LAMP tools 4) GEMINI v1.0 integration of LAMP modules, for active network measurements (IU) (due 6/6) 4.1) Take LAMP modules, assemble into packages, load into target aggregates (cases 1 - n) Task: separate entry to presentation GUI. 4.2) Build installation script for LAMP modules, with ability to specify target hosts, and verify installation into target aggregates (cases 1 - n) Issue: how to specify target hosts? add to request_rspec, then pull from returned manifest_rspec? Task: how to specify rspecs, with adders for I&M Issue: how many options for each host? perhaps passive host; active network; common node Task: provide script to push manifest_rspec to old global UNIS Issue: Use script provided by UK to pull manifest_rspec from UNIS, and then install desired modules. 4.3) Verify ability to configure and run tools via GUI (separate from presentation GUI) Task: add ability to verify config; add ability to start/stop/restart tools 4.4) Verify ability to present results via GUI (separate from configuration GUI) 4.5) Use old GEMINI Portal to access configuration and presentation GUIs 4.6) Verify entire reference use case, including: getting keys/certificates/credentials; formulating desired topology; formulating desired request_rspec; specifying installation on desired hosts; getting resources; using installation script to install on desired hosts; configuring tools; running tools; presenting results. Task: identify issues, and resolve. Task: repeat for target aggregates (cases 1 - n) 4.7) Repeat reference use case, but include reference experiments Task: identify issues, and resolve. Task: repeat for target aggregates (cases 1 - n) 5) GEMINI v1.0 integration of INSTOOLS modules, for passive host measurements (UK) (due 6/6) 5.1) Take INSTOOLS modules, assemble into packages, load into target aggregates (cases 1 - n) 5.2) Build installation script for INSTOOLS modules, with ability to specify target hosts, and verify installation into target aggregates (cases 1 - n) Issue: how to specify target hosts? add to request_rspec, then pull from returned manifest_rspec? Task: how to specify rspecs, with adders for I&M Issue: how many options for each host? perhaps passive host; active network; common node Task: provide script to pull manifest_rspec from UNIS, and then install all desired modules, LAMP and INSTOOLS. 5.3) Verify ability to configure and run tools via ? Task: add ability to verify config 5.4) Verify ability to present results via GUI, available via GEMINI Portal 5.5) Verify ability to push results from GEMINI Potal to IRODS archive service, and retrieve 5.6) Verify entire reference use case, including: getting keys/certificates/credentials; formulating desired topology; formulating desired request_rspec; specifying installation on desired hosts; getting resources; using isntallation script to install on desired hosts; configuring tools; running tools; presenting results; pushing to archive service, and retrieving Task: identify issues, and resolve. Task: repeat for target aggregates (cases 1 - n) 5.7) Repeat reference use case, but include reference experiments Task: identify issues, and resolve. Task: repeat for target aggregates (cases 1 - n) 6) GEMINI v1.0 integration of both INSTOOLS and LAMP modules, for both passive host measurements and active network measurements (IU, UK and BBN) (due 6/20) 6.1) Take INSTOOLS and LAMP modules modules, assemble into packages, load into target aggregates (cases 1 - n) 6.2) Build installation script for INSTOOLS and LAMP modules modules, with ability to specify target hosts, and verify installation into target aggregates (cases 1 - n) 6.3) Verify ability to configure and run tools via ? and GUI Task: verify ability to verify config; add verify ability to start/stop/restart tools 6.4) Verify ability to present all results via GUIs, available via GEMINI Portal 6.5) Verify ability to push some results from GEMINI Portal to IRODS archive service, and retrieve 6.6) Verify entire reference use case, including: getting keys/certificates/credentials; formulating desired topology; formulating desired request_rspec; specifying installation on desired hosts; getting resources; using isntallation script to install on desired hosts; configuring tools; running tools; presenting results; pushing to archive service, and retrieving Task: identify issues, and resolve. Task: repeat for target aggregates (cases 1 - n) 6.7) Repeat reference use case, but include reference experiments Task: identify issues, and resolve. Task: repeat for target aggregates (cases 1 - n) 7) GEMINI v1.1 acceptance tests (BBN) (due 6/20) 7.1) Define acceptance test plan, and provide tabular view of capabilites 7.2) Execute acceptance test plan Task: identify issues, and get development team to resolve, then retest 7.3) Recommend capabilites and features that are ready for use by experimenters 8) GEMINI v1.0 tutorial at GEC14 (IU, UK and BBN) (due 7/4) 8.1) Define reference uses cases and reference experiments to be included Issue: Coordinate with earlier tutorial, that shows how to setup an experiment, and that leaves experiment setup, ready for instrumentation 8.2) Write detailed procedure Task: practice, identify issues, resolve issues, and refine 8.3) Prepare materials for tutorial