wiki:TestTutorialExperimentWorkflow

Version 1 (modified by hmussman@bbn.com, 7 years ago) (diff)

--

I&M Tools: Basic Test/Tutorial/Experiment Workflow

0) Overview of test/tutorial/experiment

1) Establish test/tutorial/experiment environment

2) Obtain slice of GENI resources, install I&M tools and experiment application

3) Configure I&M tools and experiment application

4) Run and orchestrate I&M services and experiment services to complete run of test/tutorial/experiment

5) Analyze and visualize measurement results after completing run of test/tutorial/experiment

6) Move selected collected measurements and other artifacts from storage service to long-term archive service

7) Release experiment resources

0) Overview of test/tutorial/experiment

0.1) Title and abstract

0.2) Goals

0.3) Configuration

0.4 Process (flow chart)

1) Establish test/tutorial/experiment environment

1.1) Establish experiment managment (user workspace) service

1.2) Gather necessary keys, certificates and credentials

1.3) Verify availability of desired aggregates

1.4) Verify availability of desired software images/packages

1.5) Verify availability of necessary operational services, and access to those services

2) Obtain slice of GENI resources, install I&M tools and experiment application

2.1) Select target aggregates 2.2) Select desired software images/packages for I&M tools and experiment application

2.3) Obtain certs, credentials, passwords and keys

2.4) Formulate slice topology for test/tutorial/experiment, and build request rspec

2.5) Acquire resources and load images/packages for I&M tools and experiment application

2.6) Start selected software processes

2.7) Confirm slice with installed I&M tools and experiment application

3) Configure I&M tools and experiment application

3.1) Configure selected I&M services

  • objectives:
    • binds services together, e.g., between each MP and the MC
    • configures baseline services
    • verifies that they are ready to run

  • at completion: configured I&M services, ready to run and collect data

3.2) Configure selected experiment services

  • objectives:
    • binds services together to realize overall reference/actual experiment
    • configures baseline services
    • verifies that they are ready to run

  • at completion: configured experiment services, ready to run and process data, which can be observed by I&M services

4) Run and orchestrate I&M services and experiment services to complete run of test/tutorial/experiment

4.1) Initial setup: start basic host measurements and basic ping active network measurements

  • objectives:
    • verify functionality of hosts
    • verify topology of slice
  • observe measurements with a real-time presentation service

  • continue measurements throughout duration of the test/tutorial/experiment

  • at completion:
    • functionality of hosts and topology of slice has been verified throughout duration of the test/tutorial/experiment

4.2) Continuity test: for a limited time, run iperf active network measurements

  • objectives:
    • verify ability of slice to carry traffic expected from experiment
  • observe measurements with a real-time presentation service

  • once satisfactory measurements have been observed, stop continuity test

  • at completion:
    • capability of slice to carry traffic expected from experiment has been verified

4.3) Instrument and run test/tutorial/experiment:

  • objectives:
    • gather measurements during test/tutorial/experiment that allow test/tutorial/experiment goals to be met

  • include desired measurement points within hosts and/or experiment services to instrument test/tutorial/experiment

  • begin to run and orchestrate measurement services

  • begin to run and orchestrate experiment services

  • observe measurements with a real-time presentation service, to verify expected operation of test/tutorial/experiment

  • collect all measurements for duration of test/tutorial/experiment

  • stop experiment services, when this run of the test/tutorial/experiment has been completed

  • stop measurement services

  • at completion:
    • one run of test/tutorial/experiment has been completed
    • real-time look at measurements has verfied expected operation of test/tutorial/experiment
    • a full set of measurements has been collected, for later analysis and presentation
    • collected measurments have been transfered to storage service, so that slice resources can be released (if desired)

4.4) Store collected measurements and other artifacts from test/tutorial/experiment in storage service

  • at completion:
    • collected measurements and other artifacts have been transfered to storage service
    • collected measurements and other artifacts are available for later analysis
    • slice resources can then be released at any time, without loss of any measurements or artifacts

5) Analyze and visualize measurement results after completing run of test/tutorial/experiment

  • if necessary, retrieve measurement results from archive service

  • analyze and format results as desired, for visualization with presentation service

  • as appropriate, store analyzed results and/or visualization in storage service

6) Move selected collected measurements and other artifacts from storage service to long-term archive service

  • identify archived objects with peristent identifier

  • include policy for sharing with others

  • allow retrieval for further analysis and visualization

7) Release test/tutorial/experiment resources

Attachments (10)

Download all attachments as: .zip