Changes between Version 7 and Version 8 of GEMINIv1.1IntegrationTasks


Ignore:
Timestamp:
10/05/12 18:53:20 (12 years ago)
Author:
Jeanne Ohren
Comment:

--

Legend:

Unmodified
Added
Removed
Modified

  • GEMINIv1.1IntegrationTasks

    v7 v8  
    66
    77
    8 || '''ID''' || ''' Task ''' || '''Owner''' || '''Due''' || '''Status''' || ''' Notes''' ||
    9 ||  1.1 || User workspace VM ||  Jeanne || 5/23 || [[Color(green,Complete)]] || See [http://groups.geni.net/geni/wiki/GENIUserWorkspace] for instructions ||
    10 || 1.2 || Find reference experiment || Ezra ||  || [[Color(#B0E0E6, In Progress)]] 5% || Ezra will try using XSP and prepare instructions ||
    11 || 1.3 || Document reference cases || Jeanne || 5/23 || [[Color(green,Complete)]] || [http://groups.geni.net/geni/wiki/GEMINITestPlan#GEMINIv1.0Matrix] ||
    12 || 1.4 || Specify and document rspec extensions || Hussam || 5/23 || [[Color(green,Complete)]] || [http://groups.geni.net/geni/wiki/GEMINIIntegrationTasks#RSpecExtensions] ||
    13 || 2.1 || Issue tracker || Jeanne || 5/23 || [[Color(green, Complete)]] || [http://groups.geni.net/gemini] ||
    14 || 3.1 || Move Old UNIS to IU || Guilherme || 5/23 || [[Color(green,Complete)]] || https://unis.incntre.iu.edu:8012/perfSONAR_PS/services/unis ||
    15 || 3.2 || Move LAMP CA to IU || Guilherme || 5/23 || [[Color(green,Complete)]] || https://unis.incntre.iu.edu/protogeni/xmlrpc/lampca ||
    16 || 3.3 || iRODS at UK || Hussam || 5/23 || [[Color(green,Complete)]] || [https://irodwes.netlab.uky.edu/irodsweb] ||
    17 || 3.4 || GEMINI Portal at UK || Charles || 5/23 || [[Color(green, Complete)]] ||  [http://geminiportal.netlab.uky.edu] ||
    18 || 4.1 || Bug fixes on current perfSONAR modules || Guilherme || 6/6 || [[Color(green,Complete)]] || ||
    19 || 4.2 || Package and install perfSONAR modules || Guilherme || 6/6 || [[Color(green,Complete)]] ||  ||
    20 || 4.3 || Separate entry into presentation GUI || Guilherme || 6/6 || [[Color(green,Complete)]] ||  ||
    21 || 4.4 || Verify reference cases || Guilherme || 6/6 || [[Color(#B0E0E6, In Progress)]] || ||
    22 || 5.1 || Bug fixes on current INSTOOLS modules || Hussam || 6/6 || [[Color(green,Complete)]] || ||
    23 || 5.2 || Package INSTOOLS  modules || Hussam || 6/6 || [[Color(green,Complete)]] || ||
    24 || 5.3 || Installation script for INSTOOLS modules || Hussam || 6/6 || [[Color(green,Complete)]] || ||
    25 || 5.5 || Verify reference cases || Hussam || 6/6 || [[Color(#B0E0E6, In Progress)]] ||  ||
    26 || 6.1 || Integrate PS and INSTOOLS module installation scripts || Hussam and Guilherme || 6/20 || [[Color(green,Complete)]] || ||
    27 || 6.2 || Verify reference cases for both active and passive together || Hussam and Guilherme || 6/20 || [[Color(#B0E0E6, In Progress)]] || ||
    28 || 6.3 || Extend iRODS script to include perfSONAR data || Guilherme || 6/20 || [[Color(#FF6600, "Won't Fix")]] || Will be done for the new architecture after GEC 14. ||
    29 || 7.1 || Define acceptance test plan || Jeanne || 6/20 || [[Color(green,Complete)]] || ||
    30 || 7.2 || Execute acceptance tests || Jeanne || 6/20 || [[Color(#B0E0E6, In Progress)]] 75% || Executed instrumentize script, passive and active meas. [[BR]] Executed existing iRODS functionality [[BR]] No reference experiment ||
    31 || 8.1 || Coordinate tutorial with earlier tutorial || Harry || 7/4 || [[Color(green, Complete)]] || Conf call with Rob Ricci on 6/21 ||
    32 || 8.2 || Define use cases and reference experiments to be included ||  Ezra?  || 7/4 || [[Color(#B0E0E6, In Progress)]] || ||
    33 || 8.3 || Identify tutorial roles || || 7/4 ||  [[Color(#B0E0E6, In Progress)]] || ||
    34 || 8.4 || Prepare tutorial VM || Jeanne || 7/4 ||  [[Color(green, Complete)]] ||   ||
    35 || 8.5 || Prepare materials || || 7/4 ||  Not Started || ||
     8|| '''ID''' || ''' Task ''' || '''Owner''' || '''Due''' || '''Status''' || ''' Notes/Deliverables ''' ||
     9||  1 || Send list of Blipp graphs to KY ||  Ahmed || 10/8 ||  ||  ||
     10||  2 || Set up MS dev instance || Ahmed || 10/8 || || ||
     11||  3 || Send data access code to Jeremy || Ahmed || 10/8 || ||
     12||  4 || Package, instrumentize, and test Blipp/UNIS/MS ||  Ezra and Matt ||  10/12 || || ||
     13|| 5 || Integrate Blipp graphs into drupal || Jeremy and Charles || 10/11, 10/15 || || ||
     14|| 6 || Run Acceptance tests on all supported configurations || Jeanne || 10/22 || || ||
     15|| 7 || Compose tutorial wiki || Jeremy and Ahmed || 10/12 || || 1st draft by 10/12, iterate the week before GEC ||
     16|| 8 || Define topology, produce initial rspec || Jim and Charles || 10/10 || || ||
    3617
    3718
    38 === Modules and Scripts ===
    3919
    40 || '''Module''' || '''Owner''' || '''Status''' ||
    41 || Old psConfig || Guilherme || Ready ||
    42 || Old UNIS || Guilherme || Ready ||
    43 || Bootstrap script || Hussam || ||
    44 || Service watcher || Guilherme || Ready ||
    45 || PSBuoy/PINGER || Guilherme || Ready ||
    46 || Drupal CMS || Charles || ||
    47 || GEMINI Portal || Charles || ||
    48 || perfSONAR Config Portal || Guilherme || Ready ||
    49 || !PerfAdmin (Presentation) || Guilherme || Ready ||
    50 
    51 === Deliverables ===
    52 
    53 ==== User Workspace ====
    54 
    55 [wiki:GENIUserWorkspace#InstallingtheVM Installation Instructions]
    56 
    57 [wiki:GENIUserWorkspace#ConfiguringCredentials Credential Instructions]
    58 
    59  * 05/25/2012:  GENI UW 12.04 v1.0.ova
    60     - See email for BBN FTP server information
    61     - See email for usernames and passwords
    62 
    63 ==== RSpec Extensions ====
    64 
    65  * Updated 5/28/2012
    66 {{{
    67 <rspec xmlns:gemini="http://geni.net/resources/rspec/ext/gemini/1">
    68         <node>
    69                 <gemini:node type="global_node">
    70                         <gemini:monitor_urn name="URN of the AM to monitor"/>
    71                 </gemini:node>
    72         </node>
    73         <node>
    74                 <gemini:node type="mp_node">
    75                         <gemini:services>
    76                                 <gemini:active install="yes/no" enable="yes/no" />
    77                                 <gemini:passive install="yes/no" enable="yes/no" />
    78                         </gemini:services>
    79                 </gemini:node>
    80                 <interface>
    81                 </interface>
    82         </node>
    83         <link>
    84         </link>
    85 </rspec>
    86 }}}
    87 
    88 ===  GEMINI v1.0 Integration Plan ===
    89  
    90 Based on discussion on 051512:  [[BR]]
    91 
    92 1)  GEMINI v1.0 arch/config/usecases  (BBN, IU, UK)  (due 5/23)
    93 
    94  1.1)  Define and document target aggregates, and their interfaces/protocols/APIs
    95  
    96  1.2)  Define and document user workspace, and experiment control tools
    97    Task:  Provide user workspace on a VM, with locations to find keys/certificates/credentials  (Jeanne)
    98  
    99  1.3)  Define and document GEMINI I&M tools, and Reference Experiments
    100    Task:  Find useful reference experiments, that are representative and that show usefulness of the tools.  (Jeanne)
    101  
    102  1.4)  Define and document operational services required by GEMINI tools:  Old global UNIS;  LAMP CA;  iRODS;  old GEMINI Portal
    103  
    104  1.5)  Define and document reference use cases
    105 
    106  
    107 2)  GEMINI v1.0 software modules and scripts  (IU, UK and BBN)  (due 5/16)
    108 
    109  2.1)  Establish development and integration team:  Guilherme Fernandes, Matt Jaffe, Ahmed El-Hassany, Hussam Nasir, Charles Carpenter, Jeanne Ohren
    110  
    111  2.2)  Establish code repositories:  at IU, github;  at UK?  or use the IU github?
    112  
    113  2.3)  Establish software development process  (IU, UK)
    114  
    115  2.4)  Establish bug tracking process:  trac  at BBN (Jeanne)
    116  
    117  2.5)  Compile list of all modules and scripts, with ownership and status  (IU and UK)
    118  
    119  
    120 3)  GEMINI v1.0 required operational services  (due 5/23)
    121 
    122  3.1)  Maintain readiness of old global UNIS  (IU)
    123   Task:  move from Delaware to IU
    124  
    125  3.2)  Maintain readiness of LAMP CA  (IU)
    126   Task:  move from Delaware to IU
    127  
    128  3.3)  Maintain readiness of iRODS at UK  (Hussam)
    129    
    130  3.4)  Maintain readiness of old GEMINI Portal at UK  (Charles)
    131   Issue:  may need to modify, to include LAMP tools
    132  
    133  
    134 4)  GEMINI v1.0 integration of LAMP modules, for active network measurements  (IU)  (due 6/6)
    135 
    136  4.1)  Take LAMP modules, assemble into packages, load into target aggregates (cases 1 - n)
    137   Task:  separate entry to presentation GUI.
    138  
    139  4.2)  Build installation script for LAMP modules, with ability to specify target hosts, and verify installation into target aggregates (cases 1 - n)
    140   Issue:  how to specify target hosts?  add to request_rspec, then pull from returned manifest_rspec?
    141   Task:  how to specify rspecs, with adders for I&M
    142   Issue:  how many options for each host?  perhaps passive host;  active network;  common node
    143   Task:  provide script to push manifest_rspec to old global UNIS
    144   Issue:  Use script provided by UK to pull manifest_rspec from UNIS, and then install desired modules.
    145  
    146  4.3)  Verify ability to configure and run tools via GUI (separate from presentation GUI)
    147   Task:  add ability to verify config;  add ability to start/stop/restart tools
    148  
    149  4.4)  Verify ability to present results via GUI (separate from configuration GUI)
    150  
    151  4.5)  Use old GEMINI Portal to access configuration and presentation GUIs
    152  
    153  4.6)  Verify entire reference use case, including:  getting keys/certificates/credentials;  formulating desired topology;  formulating desired request_rspec;  specifying installation on desired hosts;  getting resources;  using installation script to install on desired hosts;  configuring tools;  running tools;  presenting results.
    154   Task:  identify issues, and resolve.
    155   Task:  repeat for target aggregates (cases 1 - n)
    156  
    157  4.7)  Repeat reference use case, but include reference experiments
    158    Task:  identify issues, and resolve.
    159    Task:  repeat for target aggregates (cases 1 - n)
    160 
    161    
    162 5)  GEMINI v1.0 integration of INSTOOLS modules, for passive host measurements  (UK)  (due 6/6)
    163 
    164  5.1)  Take INSTOOLS modules, assemble into packages, load into target aggregates (cases 1 - n)
    165  
    166  5.2)  Build installation script for INSTOOLS modules, with ability to specify target hosts, and verify installation into target aggregates (cases 1 - n)
    167   Issue:  how to specify target hosts?  add to request_rspec, then pull from returned manifest_rspec?
    168  Task:  how to specify rspecs, with adders for I&M
    169   Issue:  how many options for each host?  perhaps passive host;  active network;  common node
    170   Task:  provide script to pull manifest_rspec from UNIS, and then install all desired modules, LAMP and INSTOOLS. 
    171  
    172  5.3)  Verify ability to configure and run tools via ?
    173   Task:  add ability to verify config
    174  
    175  5.4)  Verify ability to present results via GUI, available via GEMINI Portal
    176  
    177  5.5)  Verify ability to push results from GEMINI Potal to IRODS archive service, and retrieve
    178  
    179  5.6)  Verify entire reference use case, including:  getting keys/certificates/credentials;  formulating desired topology;  formulating desired request_rspec;  specifying installation on desired hosts;  getting resources;  using isntallation script to install on desired hosts;  configuring tools;  running tools;  presenting results;  pushing to archive service, and retrieving
    180   Task:  identify issues, and resolve.
    181   Task:  repeat for target aggregates (cases 1 - n)
    182  
    183  5.7)  Repeat reference use case, but include reference experiments
    184    Task:  identify issues, and resolve.
    185    Task:  repeat for target aggregates (cases 1 - n)
    186  
    187  
    188 6)  GEMINI v1.0 integration of both INSTOOLS and LAMP modules, for both passive host measurements and active network measurements  (IU, UK and BBN)  (due 6/20)
    189 
    190  6.1)  Take INSTOOLS and LAMP modules modules, assemble into packages, load into target aggregates (cases 1 - n)
    191  
    192  6.2)  Build installation script for INSTOOLS and LAMP modules modules, with ability to specify target hosts, and verify installation into target aggregates (cases 1 - n)
    193  
    194  6.3)  Verify ability to configure and run tools via ? and GUI
    195   Task:  verify ability to verify config;  add verify ability to start/stop/restart tools
    196  
    197  6.4)  Verify ability to present all results via GUIs, available via GEMINI Portal
    198  
    199  6.5)  Verify ability to push some results from GEMINI Portal to IRODS archive service, and retrieve
    200  
    201  6.6)  Verify entire reference use case, including:  getting keys/certificates/credentials;  formulating desired topology;  formulating desired request_rspec;  specifying installation on desired hosts;  getting resources;  using isntallation script to install on desired hosts;  configuring tools;  running tools;  presenting results;  pushing to archive service, and retrieving
    202   Task:  identify issues, and resolve.
    203   Task:  repeat for target aggregates (cases 1 - n)
    204  
    205  6.7)  Repeat reference use case, but include reference experiments
    206    Task:  identify issues, and resolve.
    207    Task:  repeat for target aggregates (cases 1 - n)
    208 
    209    
    210 7)  GEMINI v1.1 acceptance tests (BBN)  (due 6/20)
    211 
    212  7.1)  Define acceptance test plan, and provide tabular view of capabilites
    213  
    214  7.2)  Execute acceptance test plan
    215   Task: identify issues, and get development team to resolve, then retest
    216  
    217  7.3)  Recommend capabilites and features that are ready for use by experimenters
    218  
    219  
    220 8)  GEMINI v1.0  tutorial at GEC14  (IU, UK and BBN)  (due 7/4)
    221 
    222  8.1)  Define reference uses cases and reference experiments to be included
    223    Issue:  Coordinate with earlier tutorial, that shows how to setup an experiment, and that leaves experiment setup, ready for instrumentation
    224  
    225  8.2)  Write detailed procedure
    226   Task:  practice, identify issues, resolve issues, and refine
    227  
    228  8.3)  Prepare materials for tutorial