TestTutorialExperimentWorkflow: 112612_I&M_TestTutorialExperiment_Workflow.txt

File 112612_I&M_TestTutorialExperiment_Workflow.txt, 6.2 KB (added by hmussman@bbn.com, 7 years ago)
Line 
1[[PageOutline]]
2
3== I&M Tools: Basic Test/Tutorial/Experiment Workflow ==
4
50)  Overview of experiment
6
71)  Design experiment
8
92)  Establish experiment environment
10
113)  Obtain slice of GENI resources; install I&M and experiment software
12
134)  Configure and initialize I&M and experiment services
14
155)  Run and orchestrate I&M and experiment services, to complete run of experiment; move selected measurements and other artifacts to storage service
16
176)  Analyze and visualize measurement results
18
197)  Move selected measurements and other artifacts from storage service to long-term archive service
20
218)  Release experiment resources
22
23
24=== 0)  Overview of experiment ===
25
260.1)  Title and abstract
27
280.2)  Goals
29
300.3)  Configuration
31
320.4)   Process  (flow chart)
33
34=== 1)  Design experiment ===
35
361.1)  Establish experiment goals and overall plan
37
381.2)  Design configuration of experiment, including topology, desired resources, desired tools and desired services;  consider previous, or reference, experiments as guides
39
401.3)  Map desired resources to aggrergates that are likely to be available
41
421.4)  Map desired tools to tools that are likely to be available
43
441.5)  Map desired services to software that is likely to be available
45
461.6)  Find, or design and code, software images/packages/applications, rspecs and/or scripts necessary to realize experiment, and place into storage service
47
48
49=== 2)  Establish experiment environment ===
50
512.1)  Establish experiment managment (user workspace) service
52
532.2)  Gather necessary keys, passwords, certificates and credentials
54
552.3)  Verify availability of desired resources in aggregates
56
572.4)  Verify availability of necessary operational services, and access to those services
58
592.5)  Verify availability of desired software images/packages
60
612.6)  Verify availability of desired software applications, rspecs and scripts
62
63
64=== 3)  Obtain slice of GENI resources; install I&M and experiment software ===
65
663.1)  Select target aggregates
67
683.2)  Select desired software images/packages for I&M and experiment services
69
703.3)  Formulate slice topology for experiment, and build request rspec
71
723.4)  Acquire resources and load images/packages for I&M and experiment services
73
743.5)  Confirm at completion:  slice with installed images/packages for I&M and experiment services
75
76
77=== 4) Configure and initialize I&M and experiment services ===
78
794.1)   Configure selected I&M services
80
81 - objectives:
82   - binds services together, e.g., between each MP and the MC
83   - configures baseline services
84   - initializes them, and verifies that they are ready to run
85 
86 - at completion:    configured I&M services, ready to run and collect data
87 
88
894.2)  Configure selected experiment services
90
91 - objectives:
92   - binds services together to realize overall reference/actual experiment
93   - configures baseline services
94   - initializes them, and verifies that they are ready to run   
95   
96 - at completion:    configured experiment services, ready to run and process data, which can be observed by I&M services
97 
98 
99=== 5)  Run and orchestrate I&M and experiment services, to complete run of experiment; move selected measurements and other artifacts to storage service  ===
100
101
1025.1)  Initial setup:  start basic host measurements and basic ping active network measurements
103
104 - objectives:
105   - verify functionality of hosts
106   - verify topology of slice
107
108 - observe measurements with a real-time presentation service
109 
110 - continue measurements throughout duration of the test/tutorial/experiment
111 
112 - at completion:
113   - functionality of hosts and topology of slice has been verified throughout duration of the experiment
114 
115 
1165.2)  Continuity test:  for a limited time, run iperf active network measurements
117
118 - objectives:
119   - verify ability of slice to carry traffic expected from experiment
120
121 - observe measurements with a real-time presentation service
122 
123 - once satisfactory measurements have been observed, stop continuity test
124 
125 - at completion:
126   - capability of slice to carry traffic expected from experiment has been verified
127
128   
1295.3)  Instrument and run experiment: 
130
131 - objectives:
132   - gather measurements during experiment that allow experiment goals to be met
133   
134 - include desired measurement points within hosts and/or experiment services to instrument test/tutorial/experiment
135 
136 - begin to run and orchestrate measurement services
137 
138 - begin to run and orchestrate experiment services
139 
140 - observe measurements with a real-time presentation service, to verify expected operation of experiment
141 
142 - collect all measurements for duration of experiment
143 
144 - stop experiment services, when this run of the experiment has been completed
145 
146 - stop measurement services
147 
148 - at completion:
149   - one run of experiment has been completed
150   - real-time look at measurements has verfied expected operation of experiment
151   - a full set of measurements has been collected, for later analysis and presentation
152   - collected measurments have been transfered to storage service, so that slice resources can be released (if desired)
153   
1545.4)  Store collected measurements and other artifacts from test/tutorial/experiment in storage service
155
156 - at completion:
157   - collected measurements and other artifacts have been transfered to storage service
158   - collected measurements and other artifacts are available for later analysis
159   - slice resources can then be released at any time, without loss of any measurements or artifacts
160   
161=== 6)  Analyze and visualize measurement results  ===
162
163 - if necessary, retrieve measurement results from storage service
164 
165 - analyze and format results as desired, for visualization with presentation service
166 
167 - as appropriate, move analyzed results and/or visualization to storage service
168 
169
170=== 7)  Move selected collected measurements and other artifacts from storage service to long-term archive service ===
171
172 - identify archived objects with peristent identifier
173 
174 - include policy for sharing with others
175 
176 - allow retrieval for further analysis and visualization
177
178
179=== 8)  Release experiment resources  ===
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206