TestTutorialExperimentWorkflow: 092112_I&M_TestTutorialExperiment_Workflow.txt

File 092112_I&M_TestTutorialExperiment_Workflow.txt, 5.4 KB (added by hmussman@bbn.com, 7 years ago)
Line 
1[[PageOutline]]
2
3== I&M Tools: Basic Test/Tutorial/Experiment Workflow ==
4
50)  Overview of experiment
6
71)  Establish experiment environment
8
92)  Obtain slice of GENI resources, install I&M tools and experiment services
10
113)  Configure I&M tools and experiment services
12
134)  Run and orchestrate I&M services and experiment services to complete run of experiment
14
155)  Analyze and visualize measurement results after completing run of experiment
16
176)  Move selected collected measurements and other artifacts from storage service to long-term archive service
18
197)  Release experiment resources
20
21
22=== 0)  Overview of experiment ===
23
240.1)  Title and abstract
25
260.2)  Goals
27
280.3)  Configuration
29
300.4   Process  (flow chart)
31
32
33=== 1)  Establish experiment environment ===
34
351.1)  Establish experiment managment (user workspace) service
36
371.2)  Gather necessary keys, certificates and credentials
38
391.3)  Verify availability of desired aggregates
40
411.4)  Verify availability of desired software images/packages
42
431.5)  Verify availability of necessary operational services, and access to those services
44
45
46=== 2)  Obtain slice of GENI resources, install I&M tools and experiment services ===
47
482.1)  Select target aggregates
49       
502.2)  Select desired software images/packages for I&M tools and experiment services
51
522.3)  Obtain certs, credentials, passwords and keys
53
542.4)  Formulate slice topology for experiment, and build request rspec
55
562.5)  Acquire resources and load images/packages for I&M tools and experiment services
57
582.6)  Start selected software processes
59
602.7)  Confirm slice with installed I&M tools and experiment services
61
62
63=== 3) Configure I&M tools and experiment services ===
64
653.1)   Configure selected I&M services
66
67 - objectives:
68   - binds services together, e.g., between each MP and the MC
69   - configures baseline services
70   - verifies that they are ready to run
71 
72 - at completion:    configured I&M services, ready to run and collect data
73 
74
753.2)  Configure selected experiment services
76
77 - objectives:
78   - binds services together to realize overall reference/actual experiment
79   - configures baseline services
80   - verifies that they are ready to run   
81   
82 - at completion:    configured experiment services, ready to run and process data, which can be observed by I&M services
83 
84 
85=== 4)  Run and orchestrate I&M services and experiment services to complete run of experiment ===
86
87
884.1)  Initial setup:  start basic host measurements and basic ping active network measurements
89
90 - objectives:
91   - verify functionality of hosts
92   - verify topology of slice
93
94 - observe measurements with a real-time presentation service
95 
96 - continue measurements throughout duration of the test/tutorial/experiment
97 
98 - at completion:
99   - functionality of hosts and topology of slice has been verified throughout duration of the experiment
100 
101 
1024.2)  Continuity test:  for a limited time, run iperf active network measurements
103
104 - objectives:
105   - verify ability of slice to carry traffic expected from experiment
106
107 - observe measurements with a real-time presentation service
108 
109 - once satisfactory measurements have been observed, stop continuity test
110 
111 - at completion:
112   - capability of slice to carry traffic expected from experiment has been verified
113
114   
1154.3)  Instrument and run experiment: 
116
117 - objectives:
118   - gather measurements during experiment that allow experiment goals to be met
119   
120 - include desired measurement points within hosts and/or experiment services to instrument test/tutorial/experiment
121 
122 - begin to run and orchestrate measurement services
123 
124 - begin to run and orchestrate experiment services
125 
126 - observe measurements with a real-time presentation service, to verify expected operation of experiment
127 
128 - collect all measurements for duration of experiment
129 
130 - stop experiment services, when this run of the experiment has been completed
131 
132 - stop measurement services
133 
134 - at completion:
135   - one run of experiment has been completed
136   - real-time look at measurements has verfied expected operation of experiment
137   - a full set of measurements has been collected, for later analysis and presentation
138   - collected measurments have been transfered to storage service, so that slice resources can be released (if desired)
139   
1404.4)  Store collected measurements and other artifacts from test/tutorial/experiment in storage service
141
142 - at completion:
143   - collected measurements and other artifacts have been transfered to storage service
144   - collected measurements and other artifacts are available for later analysis
145   - slice resources can then be released at any time, without loss of any measurements or artifacts
146   
147=== 5)  Analyze and visualize measurement results after completing run of experiment ===
148
149 - if necessary, retrieve measurement results from archive service
150 
151 - analyze and format results as desired, for visualization with presentation service
152 
153 - as appropriate, store analyzed results and/or visualization in storage service
154 
155
156=== 6)  Move selected collected measurements and other artifacts from storage service to long-term archive service ===
157
158 - identify archived objects with peristent identifier
159 
160 - include policy for sharing with others
161 
162 - allow retrieval for further analysis and visualization
163
164
165=== 7)  Release experiment resources  ===
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192