Changes between Version 17 and Version 18 of TestTutorialExperimentWorkflow


Ignore:
Timestamp:
01/08/13 17:24:35 (11 years ago)
Author:
hmussman@bbn.com
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • TestTutorialExperimentWorkflow

    v17 v18  
    33== Basic Experiment Workflow ==
    44
    5 0)  Overview of experiment
    6 
    7 1)  Design experiment
    8 
    9 2)  Establish experiment management environment
    10 
    11 3)  Obtain slice of GENI resources, and then install I&M and experiment software
    12 
    13 4)  Configure and initialize I&M and experiment services
    14 
    15 5)  Run and orchestrate I&M and experiment services, to complete run of experiment
    16 
    17 6)  Analyze experiment results, and decide on next step(s) 
    18 
    19 7)  When no longer needed, release all experiment resources 
    20 
    21 8)  Optionally, archive selected measurement and/or experiment artifacts 
     5Version 0.9, January 8, 2013
    226
    237
     
    39231.1)  Establish experiment goals and strategy for results
    4024
    41 1.2)  Design configuration of experiment to meet goals, including topology, desired resources, desired tools and desired services;  consider previous, or reference, experiments as guides
     251.2)  Design configuration of experiment to meet goals, including topology, desired resources, desired tools and desired persistent services;  consider previous, or reference, experiments as guides
    4226
    43271.3)  Map desired resources to aggregates that are likely to be available
    4428
    45 1.4)  Map desired tools to tools that are available, and identify necessary operational services.
    46 
    47 1.5)  Map desired services to software that is likely to be available.
    48 
    49 1.6)  Find, or design and code, software images/packages/applications, rspecs and/or scripts necessary to realize experiment, and put into storage service
     291.4)  Map desired tools to tools that are available, and identify necessary persistent services.
     30
     311.5)  Map desired in-slice services to software that is likely to be available.
     32
     331.6)  Find, or design and code, software images/packages/applications, rspecs and/or scripts necessary to realize experiment, identifying repositories and/or gathering into storage service
    5034
    51351.7)  Outline process for the experiment, and capture in a high-level flowchart
     
    53371.8)  Optionally, prototype the experiment using "GENI-in-a-box"
    5438
    55 Tools used:
    56 
    57  - Gap:  workflow description (or even execution) tool  (consider GRID Generic Workflow Execution Service)
    58 
    59  
    60 Operational services required: 
    61 
    62 
    63 Artifacts involved:
    64 
    65  - Gap:  Workflow description  (consider GRID Generic Workflow Description Language (GWorkflowDL)
    66 
    67  - Gap:  Summary of experiment resources, services, software, rspecs, scripts  (espec?)
    68 
    69  
    70 Status at completion:
    71 
    72 
     39Experiment management tools used:
     40
     41 - Gap:  workflow description creation tool;  option:  extend to workflow execution tool [Ref:  GRID Generic Workflow Execution Service]
     42 
     43 - Option:  "GENI-in-a-box"
     44
     45 
     46Persistent services required: 
     47
     48 - repositories for images/packages/software
     49
     50 - GENI Storage Service (admin OOB, web, API)
     51
     52Artifacts involved:
     53
     54 - Gap:  Workflow description  [Ref:  OEDL;  Ref: GRID Generic Workflow Description Language (GWorkflowDL) ]
     55
     56 - Gap:  List of all experiment resources, including services, software, rspecs, scripts, others?
     57
     58 - images/packages/software for GIMI, GEMINI, and/or experiment
     59 
     60Status at completion:
     61
     62 - experiment goals and strategy for results extablished
     63 
     64 - experiment configuration realized, and mapped into avaialble resources, etc.
     65 
     66 - Found or designed and coded software, rspecs and scripts necessary for experiment
     67
     68 - experiment process outlined
     69
     70 
    7371=== 2)  Establish experiment management environment ===
    7472
    75 2.1)  Establish experiment management (user workspace) service
     732.1)  Establish user workspace environment, as repository for artifacts and experiment management tools
    7674
    77752.2)  Gather necessary keys, passwords, certificates and credentials
    7876
    79 2.3)  Verify availability of desired resources in aggregates, including nodes and networking resources, by querying aggregates and/or GMOC;  optionally, reserve scarce resources
    80 
    81 2.4)  Verify availability of necessary operational services, and access to those services
    82 
    83 2.5)  Verify availability of desired software images/packages
    84 
    85 2.6)  Verify availability of desired software applications, rspecs and scripts
    86 
    87 
    88 
    89 Tools used:
    90 
    91  - User Workspace (on VM)
    92 
    93  - Option:  extend to using GNOME environment, and customized windows?
    94  
    95  - Option:  use GENI CH Portal
    96  
    97  - Gap:  Availability verification tool(s)
    98  
    99 
    100 Operational services required: 
     772.3)  Verify availability of necessary persistent services, and access to those services
     78
     792.4)  Verify availability of desired resources in aggregates, including nodes and networking resources, by querying aggregates and/or GMOC;  optionally, reserve scarce resources
     80
     81Experiment management tools used:
     82
     83 - User Workspace environment, including linux with multiple windows, for browsers and command lines
     84
     85 - Option:  use GENI CH Portal to obtain certificates, etc.
     86 
     87 - Gap:  Persistent services availability verification tool
     88 
     89 - Gap:  Aggregate resources availabilityy verification tool(s)
     90 
     91
     92Persistent services required: 
    10193
    10294 - GENI CA (or ?)
     
    117109Artifacts involved:
    118110
    119  - Gap:  Summary of experiment resources, services, software, rspecs, scripts  (espec?)
     111 - Gap:  List of all experiment resources, including services, software, rspecs, scripts, others?
    120112 
    121113 - Experimenter usernames/passwords, certificates, keys, credentials
     
    123115Status at completion:
    124116
    125 
     117 - established user workspace environment, as repository for artifacts and experiment management tools
     118 
     119 - gathered necessary keys, passwords, certificates and credentials
     120
     121 - verified availability of necessary persistent services, and access to those services
     122
     123 - verified availability of desired resources in aggregates
     124 
     125 - optionally, reserved scarce resources
    126126
    127127
     
    142142 
    143143 
    144 Tools used:
     144Experiment management tools used:
    145145
    146146 - InstaGENI:  FLACK with OMNI
     
    148148 - ExoGENI:  Flukes
    149149 
    150  - Common:  FLACK with OMNI
     150 - Towards one tool for both InstaGENI and ExoGENI:  FLACK with OMNI
    151151 
    152152 - Option:  GENI CH Portal, plus FLACK with OMNI
    153153
    154  - Gap:  Topology and installation verification tool(s)
    155  
    156 
    157 Operational services required: 
     154 - Gap:  Topology and installation verification tool(s)  [Note:  some provided in FLACK, and some in GUSH]
     155 
     156
     157Persistent services required: 
    158158
    159159 - repositories for images/packages/software
     
    166166Artifacts involved:
    167167
    168  - Gap:  Summary of experiment resources, services, software, rspecs, scripts   (espec?)
     168 - Gap:  List of all experiment resources, including services, software, rspecs, scripts, others?
    169169 
    170170 - images/packages/software for GIMI, GEMINI, and/or experiment
     
    203203
    204204 
    205 Tools used:
    206 
    207  - GEMINI:  hand edit rspec, then instrumentize script
    208  
    209  - GIMI:  post-boot scripts, then ?
     205Experiment management tools used:
     206
     207 - GEMINI:  include configuration in request rspec (p/o Step 3), then run instrumentize script
     208 
     209 - GIMI:  p/o configuration done in post-boot scripts (p/o Step 3), then completed using OMF EC with ruby scripts
    210210 
    211211 - Gap:  Experiment configuration tool/scripts
    212212
    213213
    214 Operational services required: 
     214Persistent services required: 
    215215
    216216
     
    272272
    273273
    274 Tools used:
     274Experiment management tools used:
    275275
    276276 - User workspace, scripts and browser
     
    285285
    286286
    287 Services required: 
     287Persistent services required: 
    288288
    289289 - GENI Messaging Service  (API)
     
    339339
    340340
    341 Tools used:
     341Experiment management tools used:
    342342
    343343 - User workspace, scripts and browser
     
    350350
    351351
    352 Services required: 
     352Persistent services required: 
    353353
    354354 - GENI Storage Service (admin OOB, web, API)
     
    388388 
    389389 
    390 Tools used:
     390Experiment management tools used:
    391391
    392392 - User workspace, scripts and browser
     
    402402 - Gap:  Topology and installation verification tool(s)
    403403
    404 Services required: 
    405 
    406 Artifacts involved:
    407 
    408 
    409 Status at completion:
    410 
    411  - all experiment resouerces have been released, so that they can be used by others
     404Persistent services required: 
     405
     406Artifacts involved:
     407
     408
     409Status at completion:
     410
     411 - all experiment resources have been released, so that they can be used by others
    412412 
    413413 - entries in operational services that are no longer needed, have been erased
     
    431431
    432432
    433 Tools used:
     433Experiment management tools used:
    434434
    435435 - User workspace, scripts and browser
    436436
    437437
    438 Services required: 
     438Persistent services required: 
    439439
    440440 - GENI Storage Service (admin OOB, web, API)