wiki:GIMIv1.1Tutorial

Version 11 (modified by zink@cs.umass.edu, 11 years ago) (diff)

--

GIMI Instrumentation and Measurement Tool: Tutorial Instructions

Prerequisites

  1. To prepare for the tutorial, each participant should install VirtualBox and the GENI User Workspace image on their computer. Instruction for this step can be found here: [TBA]
  1. It is recommended that you attend the [ExoGENI tutorial] given prior to the GIMI tutorial.
  1. Besides OMF/OML and ExoGENI, this tutorial will also make use of iRODS and IREEL and the interested participant can find further information at the links given for both tools.
  1. Account information for all tools will be handed out on paper to the participants at the beginning of the tutorial.

Tutorial Overview

  • What is the goal of the tutorial?
  • This tutorial will show how to reserve resources with Flukes tool, implement experiments on ExoGENI testbed via command line based OML/OMF or web based GIMI portal (IREEL).
  • In this tutorial, Users are expected to get familiar with GIMI portal service and command line based OML/OMF, in order to submit experiment scripts, run experiments, and get visualized results.
  • As GIMI I&M service example, users will get hands on experience on an realistic video streaming experiment.

Common Errors

  • Be careful cutting and pasting
    • Doesn’t work from Trac
    • Sometimes even txt file inserts hidden characters
    • Some lines require edits; don’t cut and paste the newline
    • Make terminal windows big
    • Sometimes terminal gets corrupted when pasting a line that runs to the next line (especially when backspacing)
    • Here you can find some shortcuts on cutting and pasting for tools that run in VirtualBox.

Getting Ready

Tutorial Outline

Introduction

A: Establish Environment

B: Obtain Slice

C: Orchestrate/Run Experiment

D: Observe Results

E: Push to iRODS

F: Analyze

G: Pull from iRODS

H: Clean Up

Support for Experimenters

  • What can be done after GEC15?
  • What resources are available?
  • Who do they contact with questions/problems?

I&M Tools: Basic Test/Tutorial/Experiment Workflow

0) Overview of experiment

1) Establish experiment environment

2) Obtain slice of GENI resources, install I&M tools and experiment services

3) Configure I&M tools and experiment services

4) Run and orchestrate I&M services and experiment services to complete run of experiment

5) Analyze and visualize measurement results after completing run of experiment

6) Move selected collected measurements and other artifacts from storage service to long-term archive service

7) Release experiment resources

1) Establish experiment environment

1.1) Establish experiment managment (user workspace) service

1.2) Gather necessary keys, certificates and credentials

1.3) Verify availability of desired aggregates

1.4) Verify availability of desired software images/packages

1.5) Verify availability of necessary operational services, and access to those services

2) Obtain slice of GENI resources, install I&M tools and experiment services

2.1) Select target aggregates 2.2) Select desired software images/packages for I&M tools and experiment services

2.3) Obtain certs, credentials, passwords and keys

2.4) Formulate slice topology for experiment, and build request rspec

2.5) Acquire resources and load images/packages for I&M tools and experiment services

2.6) Start selected software processes

2.7) Confirm slice with installed I&M tools and experiment services

3) Configure I&M tools and experiment services

3.1) Configure selected I&M services

  • objectives:
    • binds services together, e.g., between each MP and the MC
    • configures baseline services
    • verifies that they are ready to run

  • at completion: configured I&M services, ready to run and collect data

3.2) Configure selected experiment services

  • objectives:
    • binds services together to realize overall reference/actual experiment
    • configures baseline services
    • verifies that they are ready to run

  • at completion: configured experiment services, ready to run and process data, which can be observed by I&M services

4) Run and orchestrate I&M services and experiment services to complete run of experiment

4.1) Initial setup: start basic host measurements and basic ping active network measurements

  • objectives:
    • verify functionality of hosts
    • verify topology of slice
  • observe measurements with a real-time presentation service

  • continue measurements throughout duration of the test/tutorial/experiment

  • at completion:
    • functionality of hosts and topology of slice has been verified throughout duration of the experiment

4.2) Continuity test: for a limited time, run iperf active network measurements

  • objectives:
    • verify ability of slice to carry traffic expected from experiment
  • observe measurements with a real-time presentation service

  • once satisfactory measurements have been observed, stop continuity test

  • at completion:
    • capability of slice to carry traffic expected from experiment has been verified

4.3) Instrument and run experiment:

  • objectives:
    • gather measurements during experiment that allow experiment goals to be met

  • include desired measurement points within hosts and/or experiment services to instrument test/tutorial/experiment

  • begin to run and orchestrate measurement services

  • begin to run and orchestrate experiment services

  • observe measurements with a real-time presentation service, to verify expected operation of experiment

  • collect all measurements for duration of experiment

  • stop experiment services, when this run of the experiment has been completed

  • stop measurement services

  • at completion:
    • one run of experiment has been completed
    • real-time look at measurements has verfied expected operation of experiment
    • a full set of measurements has been collected, for later analysis and presentation
    • collected measurments have been transfered to storage service, so that slice resources can be released (if desired)

4.4) Store collected measurements and other artifacts from test/tutorial/experiment in storage service

  • at completion:
    • collected measurements and other artifacts have been transfered to storage service
    • collected measurements and other artifacts are available for later analysis
    • slice resources can then be released at any time, without loss of any measurements or artifacts

5) Analyze and visualize measurement results after completing run of experiment

  • if necessary, retrieve measurement results from archive service

  • analyze and format results as desired, for visualization with presentation service

  • as appropriate, store analyzed results and/or visualization in storage service

6) Move selected collected measurements and other artifacts from storage service to long-term archive service

  • identify archived objects with peristent identifier

  • include policy for sharing with others

  • allow retrieval for further analysis and visualization

7) Release experiment resources

Attachments (1)

Download all attachments as: .zip