Changes between Version 17 and Version 18 of TestTutorialExperimentWorkflow
- Timestamp:
- 01/08/13 17:24:35 (11 years ago)
Legend:
- Unmodified
- Added
- Removed
- Modified
-
TestTutorialExperimentWorkflow
v17 v18 3 3 == Basic Experiment Workflow == 4 4 5 0) Overview of experiment 6 7 1) Design experiment 8 9 2) Establish experiment management environment 10 11 3) Obtain slice of GENI resources, and then install I&M and experiment software 12 13 4) Configure and initialize I&M and experiment services 14 15 5) Run and orchestrate I&M and experiment services, to complete run of experiment 16 17 6) Analyze experiment results, and decide on next step(s) 18 19 7) When no longer needed, release all experiment resources 20 21 8) Optionally, archive selected measurement and/or experiment artifacts 5 Version 0.9, January 8, 2013 22 6 23 7 … … 39 23 1.1) Establish experiment goals and strategy for results 40 24 41 1.2) Design configuration of experiment to meet goals, including topology, desired resources, desired tools and desired services; consider previous, or reference, experiments as guides25 1.2) Design configuration of experiment to meet goals, including topology, desired resources, desired tools and desired persistent services; consider previous, or reference, experiments as guides 42 26 43 27 1.3) Map desired resources to aggregates that are likely to be available 44 28 45 1.4) Map desired tools to tools that are available, and identify necessary operationalservices.46 47 1.5) Map desired services to software that is likely to be available.48 49 1.6) Find, or design and code, software images/packages/applications, rspecs and/or scripts necessary to realize experiment, and putinto storage service29 1.4) Map desired tools to tools that are available, and identify necessary persistent services. 30 31 1.5) Map desired in-slice services to software that is likely to be available. 32 33 1.6) Find, or design and code, software images/packages/applications, rspecs and/or scripts necessary to realize experiment, identifying repositories and/or gathering into storage service 50 34 51 35 1.7) Outline process for the experiment, and capture in a high-level flowchart … … 53 37 1.8) Optionally, prototype the experiment using "GENI-in-a-box" 54 38 55 Tools used: 56 57 - Gap: workflow description (or even execution) tool (consider GRID Generic Workflow Execution Service) 58 59 60 Operational services required: 61 62 63 Artifacts involved: 64 65 - Gap: Workflow description (consider GRID Generic Workflow Description Language (GWorkflowDL) 66 67 - Gap: Summary of experiment resources, services, software, rspecs, scripts (espec?) 68 69 70 Status at completion: 71 72 39 Experiment management tools used: 40 41 - Gap: workflow description creation tool; option: extend to workflow execution tool [Ref: GRID Generic Workflow Execution Service] 42 43 - Option: "GENI-in-a-box" 44 45 46 Persistent services required: 47 48 - repositories for images/packages/software 49 50 - GENI Storage Service (admin OOB, web, API) 51 52 Artifacts involved: 53 54 - Gap: Workflow description [Ref: OEDL; Ref: GRID Generic Workflow Description Language (GWorkflowDL) ] 55 56 - Gap: List of all experiment resources, including services, software, rspecs, scripts, others? 57 58 - images/packages/software for GIMI, GEMINI, and/or experiment 59 60 Status at completion: 61 62 - experiment goals and strategy for results extablished 63 64 - experiment configuration realized, and mapped into avaialble resources, etc. 65 66 - Found or designed and coded software, rspecs and scripts necessary for experiment 67 68 - experiment process outlined 69 70 73 71 === 2) Establish experiment management environment === 74 72 75 2.1) Establish experiment management (user workspace) service73 2.1) Establish user workspace environment, as repository for artifacts and experiment management tools 76 74 77 75 2.2) Gather necessary keys, passwords, certificates and credentials 78 76 79 2.3) Verify availability of desired resources in aggregates, including nodes and networking resources, by querying aggregates and/or GMOC; optionally, reserve scarce resources 80 81 2.4) Verify availability of necessary operational services, and access to those services 82 83 2.5) Verify availability of desired software images/packages 84 85 2.6) Verify availability of desired software applications, rspecs and scripts 86 87 88 89 Tools used: 90 91 - User Workspace (on VM) 92 93 - Option: extend to using GNOME environment, and customized windows? 94 95 - Option: use GENI CH Portal 96 97 - Gap: Availability verification tool(s) 98 99 100 Operational services required: 77 2.3) Verify availability of necessary persistent services, and access to those services 78 79 2.4) Verify availability of desired resources in aggregates, including nodes and networking resources, by querying aggregates and/or GMOC; optionally, reserve scarce resources 80 81 Experiment management tools used: 82 83 - User Workspace environment, including linux with multiple windows, for browsers and command lines 84 85 - Option: use GENI CH Portal to obtain certificates, etc. 86 87 - Gap: Persistent services availability verification tool 88 89 - Gap: Aggregate resources availabilityy verification tool(s) 90 91 92 Persistent services required: 101 93 102 94 - GENI CA (or ?) … … 117 109 Artifacts involved: 118 110 119 - Gap: Summary of experiment resources, services, software, rspecs, scripts (espec?)111 - Gap: List of all experiment resources, including services, software, rspecs, scripts, others? 120 112 121 113 - Experimenter usernames/passwords, certificates, keys, credentials … … 123 115 Status at completion: 124 116 125 117 - established user workspace environment, as repository for artifacts and experiment management tools 118 119 - gathered necessary keys, passwords, certificates and credentials 120 121 - verified availability of necessary persistent services, and access to those services 122 123 - verified availability of desired resources in aggregates 124 125 - optionally, reserved scarce resources 126 126 127 127 … … 142 142 143 143 144 Tools used:144 Experiment management tools used: 145 145 146 146 - InstaGENI: FLACK with OMNI … … 148 148 - ExoGENI: Flukes 149 149 150 - Common: FLACK with OMNI150 - Towards one tool for both InstaGENI and ExoGENI: FLACK with OMNI 151 151 152 152 - Option: GENI CH Portal, plus FLACK with OMNI 153 153 154 - Gap: Topology and installation verification tool(s) 155 156 157 Operationalservices required:154 - Gap: Topology and installation verification tool(s) [Note: some provided in FLACK, and some in GUSH] 155 156 157 Persistent services required: 158 158 159 159 - repositories for images/packages/software … … 166 166 Artifacts involved: 167 167 168 - Gap: Summary of experiment resources, services, software, rspecs, scripts (espec?)168 - Gap: List of all experiment resources, including services, software, rspecs, scripts, others? 169 169 170 170 - images/packages/software for GIMI, GEMINI, and/or experiment … … 203 203 204 204 205 Tools used:206 207 - GEMINI: hand edit rspec, then instrumentize script208 209 - GIMI: p ost-boot scripts, then ?205 Experiment management tools used: 206 207 - GEMINI: include configuration in request rspec (p/o Step 3), then run instrumentize script 208 209 - GIMI: p/o configuration done in post-boot scripts (p/o Step 3), then completed using OMF EC with ruby scripts 210 210 211 211 - Gap: Experiment configuration tool/scripts 212 212 213 213 214 Operationalservices required:214 Persistent services required: 215 215 216 216 … … 272 272 273 273 274 Tools used:274 Experiment management tools used: 275 275 276 276 - User workspace, scripts and browser … … 285 285 286 286 287 Services required:287 Persistent services required: 288 288 289 289 - GENI Messaging Service (API) … … 339 339 340 340 341 Tools used:341 Experiment management tools used: 342 342 343 343 - User workspace, scripts and browser … … 350 350 351 351 352 Services required:352 Persistent services required: 353 353 354 354 - GENI Storage Service (admin OOB, web, API) … … 388 388 389 389 390 Tools used:390 Experiment management tools used: 391 391 392 392 - User workspace, scripts and browser … … 402 402 - Gap: Topology and installation verification tool(s) 403 403 404 Services required:405 406 Artifacts involved: 407 408 409 Status at completion: 410 411 - all experiment resou erces have been released, so that they can be used by others404 Persistent services required: 405 406 Artifacts involved: 407 408 409 Status at completion: 410 411 - all experiment resources have been released, so that they can be used by others 412 412 413 413 - entries in operational services that are no longer needed, have been erased … … 431 431 432 432 433 Tools used:433 Experiment management tools used: 434 434 435 435 - User workspace, scripts and browser 436 436 437 437 438 Services required:438 Persistent services required: 439 439 440 440 - GENI Storage Service (admin OOB, web, API)