I&M Tools: Basic Test/Tutorial/Experiment Workflow

0) Overview of test/tutorial/experiment

1) Establish test/tutorial/experiment environment

2) Obtain slice of GENI resources, install I&M tools and experiment application

3) Configure I&M tools and experiment application

4) Run and orchestrate I&M services and experiment services to complete run of test/tutorial/experiment

5) Analyze and visualize measurement results after completing run of test/tutorial/experiment

6) Move selected collected measurements and other artifacts from storage service to long-term archive service

7) Release experiment resources

0) Overview of test/tutorial/experiment

0.1) Title and abstract

0.2) Goals

0.3) Configuration

0.4 Process (flow chart)

1) Establish test/tutorial/experiment environment

1.1) Establish experiment managment (user workspace) service

1.2) Gather necessary keys, certificates and credentials

1.3) Verify availability of desired aggregates

1.4) Verify availability of desired software images/packages

1.5) Verify availability of necessary operational services, and access to those services

2) Obtain slice of GENI resources, install I&M tools and experiment application

2.1) Select target aggregates 2.2) Select desired software images/packages for I&M tools and experiment application

2.3) Obtain certs, credentials, passwords and keys

2.4) Formulate slice topology for test/tutorial/experiment, and build request rspec

2.5) Acquire resources and load images/packages for I&M tools and experiment application

2.6) Start selected software processes

2.7) Confirm slice with installed I&M tools and experiment application

3) Configure I&M tools and experiment application

3.1) Configure selected I&M services

• objectives:
  • binds services together, e.g., between each MP and the MC
  • configures baseline services
  • verifies that they are ready to run

• at completion: configured I&M services, ready to run and collect data

3.2) Configure selected experiment services

• objectives:
  • binds services together to realize overall reference/actual experiment
  • configures baseline services
  • verifies that they are ready to run

• at completion: configured experiment services, ready to run and process data, which can be observed by I&M services

4) Run and orchestrate I&M services and experiment services to complete run of test/tutorial/experiment

4.1) Initial setup: start basic host measurements and basic ping active network measurements

• objectives:
  • verify functionality of hosts
  • verify topology of slice

• observe measurements with a real-time presentation service

• continue measurements throughout duration of the test/tutorial/experiment

• at completion:
  • functionality of hosts and topology of slice has been verified throughout duration of the test/tutorial/experiment

4.2) Continuity test: for a limited time, run iperf active network measurements

• objectives:
  • verify ability of slice to carry traffic expected from experiment

• observe measurements with a real-time presentation service

• once satisfactory measurements have been observed, stop continuity test

• at completion:
  • capability of slice to carry traffic expected from experiment has been verified

4.3) Instrument and run test/tutorial/experiment:

• objectives:
  • gather measurements during test/tutorial/experiment that allow test/tutorial/experiment goals to be met

• include desired measurement points within hosts and/or experiment services to instrument test/tutorial/experiment

• begin to run and orchestrate measurement services

• begin to run and orchestrate experiment services

• observe measurements with a real-time presentation service, to verify expected operation of test/tutorial/experiment

• collect all measurements for duration of test/tutorial/experiment

• stop experiment services, when this run of the test/tutorial/experiment has been completed

• stop measurement services

• at completion:
  • one run of test/tutorial/experiment has been completed
  • real-time look at measurements has verfied expected operation of test/tutorial/experiment
  • a full set of measurements has been collected, for later analysis and presentation
  • collected measurments have been transfered to storage service, so that slice resources can be released (if desired)

4.4) Store collected measurements and other artifacts from test/tutorial/experiment in storage service

• at completion:
  • collected measurements and other artifacts have been transfered to storage service
  • collected measurements and other artifacts are available for later analysis
  • slice resources can then be released at any time, without loss of any measurements or artifacts

5) Analyze and visualize measurement results after completing run of test/tutorial/experiment

• if necessary, retrieve measurement results from archive service

• analyze and format results as desired, for visualization with presentation service

• as appropriate, store analyzed results and/or visualization in storage service

6) Move selected collected measurements and other artifacts from storage service to long-term archive service

• identify archived objects with peristent identifier

• include policy for sharing with others

• allow retrieval for further analysis and visualization

7) Release test/tutorial/experiment resources