A Tutorial on Systematic Experimental Design

Overview

This tutorial will guide you how to conduct systematic experimentation on GENI. We will setup a layer-3 virtual network environment for routing experiments through this tutorial. In this tutorial, you will learn how to conduct systematic experimentation step by step by a case study.

Systematic Experimental Design Flow

The flow diagram below shows general steps:

• Install Software
  • Start with smallest network, usually single node.
• Configure and run experiments on smallest reasonable network
  • Automate Experimental Configuration
  • End-to-End Validation
  • Automate Measurement
• Scaling Up the Experiments
  • Increasing the number of aggregates
  • Increasing the number of nodes with one aggregate
  • Increasing both aggregates and nodes.

Objective of the Case Study

In the case study, we will create a layer-3 virtual network that is composed of virtual routers running OSPF protocol. We aim to observe the OSPF routing table updates under both link and node failures. We will go through every step in the flow diagram above to illustrate how to deploy this experiment systematically using GENI testbed, in particular, using InstaGENI aggregates.

• I: Turn a VM into a virtual router (i.e., software router running XORP)

• II: Configure and run experiments in a four-router topology

• III: Scaling Up

Increase the number of aggregates

Increase the number of nodes in one aggregates

Increase both the number of nodes and aggregates

Prerequisite

• A GENI Portal account. If you don't have one, please sign up
• Familiar with reserving GENI resources using Flack. See Flack Tutorial
• Familiar with Omni tools. See ​Omni Tools
• Familiar with creating stitching links using stitcher tool. See Stitching Tutorial
• Familiar with the Linux/Unix command line

Step by Step Instruction

	Step I: Install Software Manually Installation Create Custom Image
	Step II: Configure and Run Experiments in Small Topology Automate Experiment Configuration End-to-End Validation Measurement Validation
	Step III: Scaling Up Increase the number of aggregates Increase the number of nodes in one aggregate Increase the number of both nodes and aggregates