TestTutorialExperimentWorkflow: 112612b_I&M_TestTutorialExperiment_Workflow.2.txt

File 112612b_I&M_TestTutorialExperiment_Workflow.2.txt, 6.6 KB (added by hmussman@bbn.com, 7 years ago)
Line 
1[[PageOutline]]
2
3== I&M Tools: Basic Test/Tutorial/Experiment Workflow ==
4
50)  Overview of experiment
6
71)  Design experiment
8
92)  Establish experiment environment
10
113)  Obtain slice of GENI resources; install I&M and experiment software
12
134)  Configure and initialize I&M and experiment services
14
155)  Run and orchestrate I&M and experiment services, to complete run of experiment; move selected measurements and other artifacts to storage service
16
176)  Analyze and visualize measurement results
18
197)  Release experiment resources
20
218)  Move selected measurements and other artifacts from storage service to long-term archive service
22
23
24
25
26=== 0)  Overview of experiment ===
27
280.1)  Title and abstract
29
300.2)  Goals
31
320.3)  Configuration
33
340.4)   Process  (flow chart)
35
36=== 1)  Design experiment ===
37
381.1)  Establish experiment goals and overall plan
39
401.2)  Design configuration of experiment, including topology, desired resources, desired tools and desired services;  consider previous, or reference, experiments as guides
41
421.3)  Map desired resources to aggregates that are likely to be available
43
441.4)  Map desired tools to tools that are available, and identify necessary operational services.
45
461.5)  Map desired services to software that is likely to be available.
47
481.6)  Find, or design and code, software images/packages/applications, rspecs and/or scripts necessary to realize experiment, and put into storage service
49
50
51=== 2)  Establish experiment environment ===
52
532.1)  Establish experiment managment (user workspace) service
54
552.2)  Gather necessary keys, passwords, certificates and credentials
56
572.3)  Verify availability of desired resources in aggregates
58
592.4)  Verify availability of necessary operational services, and access to those services
60
612.5)  Verify availability of desired software images/packages
62
632.6)  Verify availability of desired software applications, rspecs and scripts
64
65
66=== 3)  Obtain slice of GENI resources; install I&M and experiment software ===
67
683.1)  Select target aggregates
69
703.2)  Select desired software images/packages for I&M and experiment services
71
723.3)  Formulate slice topology for experiment, and build request rspec
73
743.4)  Acquire resources and load images/packages for I&M and experiment services
75
763.5)  Confirm at completion:  slice with installed images/packages for I&M and experiment services
77
78
79=== 4) Configure and initialize I&M and experiment services ===
80
814.1)   Configure selected I&M services
82
83 - objectives:
84   - binds services together, e.g., between each MP and the MC
85   - configures baseline services
86   - initializes them, and verifies that they are ready to run
87 
88 - at completion:    configured I&M services, ready to run and collect data
89 
90
914.2)  Configure selected experiment services
92
93 - objectives:
94   - binds services together to realize overall reference/actual experiment
95   - configures baseline services
96   - initializes them, and verifies that they are ready to run   
97   
98 - at completion:    configured experiment services, ready to run and process data, which can be observed by I&M services
99 
100 
101=== 5)  Run and orchestrate I&M and experiment services, to complete run of experiment; move selected measurements and other artifacts to storage service  ===
102
103
1045.1)  Initial setup:  start basic host measurements and basic ping active network measurements
105
106 - objectives:
107   - verify functionality of hosts
108   - verify topology of slice
109
110 - observe measurements with a real-time presentation service
111 
112 - continue measurements throughout duration of the test/tutorial/experiment
113 
114 - at completion:
115   - functionality of hosts and topology of slice has been verified throughout duration of the experiment
116 
117 
1185.2)  Continuity test:  for a limited time, run iperf active network measurements
119
120 - objectives:
121   - verify ability of slice to carry traffic expected from experiment
122
123 - observe measurements with a real-time presentation service
124 
125 - once satisfactory measurements have been observed, stop continuity test
126 
127 - at completion:
128   - capability of slice to carry traffic expected from experiment has been verified
129
130   
1315.3)  Instrument and run experiment: 
132
133 - objectives:
134   - gather measurements during experiment that allow experiment goals to be met
135   
136 - include desired measurement points within hosts and/or experiment services to instrument test/tutorial/experiment
137 
138 - begin to run and orchestrate measurement services
139 
140 - begin to run and orchestrate experiment services
141 
142 - observe measurements with a real-time presentation service, to verify expected operation of experiment
143 
144 - collect all measurements for duration of experiment
145 
146 - stop experiment services, when this run of the experiment has been completed
147 
148 - stop measurement services
149 
150 - at completion:
151   - one run of experiment has been completed
152   - real-time look at measurements has verfied expected operation of experiment
153   - a full set of measurements has been collected, for later analysis and presentation
154   - collected measurments have been transfered to storage service, so that slice resources can be released (if desired)
155   
1565.4)  Store collected measurements and other artifacts from test/tutorial/experiment in storage service
157
158 - at completion:
159   - collected measurements and other artifacts have been transfered to storage service
160   - collected measurements and other artifacts are available for later analysis
161   - slice resources can then be released at any time, without loss of any measurements or artifacts
162   
163=== 6)  Analyze and visualize measurement results  ===
164
165 - as necessary, retrieve measurement results from storage service
166 
167 - analyze and format results as desired, for visualization with presentation service
168 
169 - as appropriate, move analyzed results and/or visualization to storage service
170 
171
172=== 7)  Release experiment resources  ===
173
174 - as soon as possible, to free up resources for use by others
175 
176 - but, after the experimenter is reasonably certain that they do not need to do another run of the experiment
177
178=== 8)  Move selected collected measurements and other artifacts from storage service to long-term archive service ===
179
180 - identify object to be archived with a peristent identifier (handle)
181 
182 - within storage service, gather components into bundle to form object to be archived, and move this object into long-term archive service
183 
184 - include policy for sharing with others  (e.g., share with all others, or share with no one)
185 
186 - allow retrieval for further analysis and visualization, or for use as a reference
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215