A Tutorial on Systematic Experimental Design


This tutorial will guidance on how to conduct systematic experimentation in GENI by providing a step by step case study. We will setup a layer-3 virtual network environment for routing experiments through this tutorial by using a systematic workflow to simplify experiments and reduce overhead as the experiment scales up.

Systematic Experimental Design Workflow

The workflow diagram below shows general steps:

  • Installing desired software and creating a custom image to capture the installation.
    • Start with smallest network, usually single node.
  • Configure and run experiments on smallest reasonable network.
    • Automate Experimental Configuration
    • End-to-End Validation
    • Automate Measurement
  • Scaling Up the Experiments
    • Increasing the number of aggregates
    • Increasing the number of nodes with one aggregate
    • Increasing both aggregates and nodes.

Objective of the Case Study

In this case study, we will create a layer-3 virtual network that is composed of virtual routers running the OSPF protocol. We aim to observe the OSPF routing table updates under both link and node failures. We will go through every step in the workflow diagram above to illustrate how to deploy this experiment systematically using GENI testbed, in particular by using InstaGENI aggregates.

  • I: Turn a VM into a virtual router (i.e., software router running Quagga)

  • II: Configure and run experiments in a four-router topology

  • III: Scaling Up

Increase the number of aggregates

Increase the number of nodes in one aggregates

Increase both the number of nodes and aggregates


Step by Step Instruction

  • Step III: Scaling Up
    • Increase the number of aggregates
    • Increase the number of nodes in one aggregate
    • Increase the number of both nodes and aggregates
Last modified 7 years ago Last modified on 05/26/17 16:11:44

Attachments (10)

Download all attachments as: .zip