Version 20 (modified by 13 years ago) (diff) | ,
---|
This page is still under construction, feel free to send corrections and suggestions to help@geni.net
Here's a description of a Hello GENI example that is using resources from Tango GENI. For this example, you would need an account on GPO's ProtoGENI cluster, look here for instructions.
For this example we are going to use Omni, which is a command line tool that allows you to reserve resources from any Aggregate Manager that supports the GENI Api. If you have never used Omni before, you should first download it and install it. For an example of how to use Omni with GPO's ProtoGENI cluster, you can refer to this example. You can stop after you have successfully run the list available resources step. For this example this config file is used.
Overview
This tutorial will walk you through an example of running an experiment in Tango GENI. For the purpose of this example we are going to use a simple setup, where we are going to have 2 hosts in two different sites :
- a ProtoGENI host at the GPO lab
- a myPLC host at Clemson
And we will use netcat to show that they can talk to each other.
Reserving necessary resources
Tango GENI has diverse compute resources that are connected over multiple OpenFlow switches. In order to be able to reserve all the needed resources, we should first draw a detailed topology of our experiment. Tango GENI has two backbone VLANs (3715, 3716) each providing a different topology. For this example we are going to use VLAN 3715.
So using the topology maps of Tango GENI, along with diagrams from NLR core, GPO lab and Clemson lab, we can draw this detailed topology for this simple example :
Looking at the topology, we see that we will need to reserve resources from different aggregates. In detail we need resources from :
- GPO's ProtoGENI Aggregate (pc11.gpolab.bbn.com, for the purpose of this example we are using tatooine (pc11), but it is better if you let ProtoGENI to choose a free node for you, all the nodes in the GPO's ProtoGENI cluster, are identically configured)
- GPO's OpenFlow Aggregate (switches habanero and poblano are part of GPO's lab)
- NLR's OpenFlow Aggregate (for the NLR switches)
- Clemson's OpenFlow Aggregate (for the Clemon switch)
- Clemson's myPLC Aggregate (for reserving planetlab5.clemson.edu)
Create a slice
It is always a good measure to create a slice per experiment, so before we start reserving resources, we would need to create a slice for this experiment. If you have already setup your omni_config file, then follow these instructions for creating and renewing a slice. By default slices that are created with a ProtoGENI Clearing House, have an expiration time of 4 hours, that is why you need to renew it to a time that is sensible for your experiment.
For the purpose of this example, using this omni_config file, created a slice named hellogeni_slice
> src/omni.py createslice hellogeni_slice > src/omni.py renewslice hellogeni_slice 20110630T18:00:00
Reserve an IP subnet
In Tango GENI, if an experiment is a layer 3 experiment, it would need it's own separate IP subnet so that it is able to control all traffic for this subnet without interfering with traffic from other experiments. GPO has set aside 10.42.0.0/16 as a pool of IP subnets for this. These subnets aren't provided by an aggregate, and thus can't be reserved via the GENI AM API. Please DO NOT use an IP subnet that you have not reserved, just request for one to assigned to you.
Email template for reserving IP subnet
Before continuing with the tutorial, please send an email to gpo-infra@geni.net to reserve an IP subnet. This is an example email :
To: gpo-infra@geni.net From: Geni User <geniuser@example.com> Subject: Reservation request for an IP subnet Hi, I am going through the Hello Geni example, and I would like an IP subnet assigned to me, so that I can complete the tutorial. user urn : URI:urn:publicid:IDN+pgeni.gpolab.bbn.com+user+inki, email:inki@pgeni.gpolab.bbn.com duration : until June 30th 2011 Thanks,
To determine your user urn see here for instructions.
For the purpose of this example we will assume that we got assigned IP subnet 10.42.130.0/24.
Create slivers
For each aggregate we would need to create a sliver that will contain the necessary resources. For all aggregates it is important to now the AM url for requesting the resources. The best place to get the information is at the Aggregate's wiki page. At TangoGENI there is also a list of URLs of active aggregates. If there is an aggregate whose URL you can't find, please email help@geni.net.
Clemson myPLC sliver
From this page?, we get this aggregate's URL and using this rspec file, we can reserve a sliver in planetlab5:
src/omni.py createsliver -n -a https://myplc.clemson.edu:12346 -n hellogeni_slice myplc-clemson-hellogeni.rspec
The output should look like this.
Use sliverstatus to figure out the login name :
>src/omni.py sliverstatus -n -a https://myplc.clemson.edu:12346 hellogeni_slice
Look for the attribute 'pl_login'. For this example the login name is : 'pgenigpolabbbncom_hellogenislice'.
For PlanetLab aggregates, the 'geni_status' field would say 'unknown'. The best way to test if your resources are ready is trial error.
ssh -i .ssh/gcf_id_rsa pgenigpolabbbncom_hellogenislice@planetlab5.clemson.edu
Your sliver should be ready within 1 min. If after 5 min you are not able to login to the host, delete your sliver and recreate it. If the problem persists email to the support email given in the aggregate page.
src/omni.py deletesliver -n -a https://myplc.clemson.edu:12346 hellogeni_slice
After you login to the node, you can see all the available interfaces. In order to better support multiple experiments, each myPLC host is already configured with multiple subinterfaces. There should be a subinterface in the IP subnet that you have reserved
[pgenigpolabbbncom_hellogenislice@planetlab5 ~]$ /sbin/ifconfig |grep 42.130 -A 2 -B 2 eth1.1750:42130 Link encap:Ethernet HWaddr 00:1B:21:43:A1:E4 inet addr:10.42.130.105 Bcast:10.42.130.255 Mask:255.255.255.0 UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
If you can't find an interface on the reserved subnet, please email help@geni.net.
GPO ProtoGENI sliver
From this page?, we get this aggregate's URL and using this rspec file, we can reserve pc11:
src/omni.py createsliver -n -a http://www.pgeni.gpolab.bbn.com/protogeni/xmlrpc/am hellogeni_slice pg-bbn-hellogeni.rspec
The output should look like this.
Then we can do sliverstatus to find out the status of the sliver
>src/omni.py sliverstatus -n -a http://www.pgeni.gpolab.bbn.com/protogeni/xmlrpc/am hellogeni_slice
Toward the end of the manifest there is an attribute 'geni_status', when this says ready we can login to the host
ssh -i ~/.ssh/gcf_id_rsa inki@pc11.pgeni.gpolab.bbn.com
Configuring OpenFlow interface on PG Host
In Tango GENI, to provide maximum flexibility to the experimenter, the port on the OpenFlow switch where the host is connected to, is configured as a trunk port that carries multiple VLANs. This allows the experimenter, using VLAN subinterfacing, to configure the host to be part of any of the configured VLANs. For this example we are going to use VLAN 1750 that will be cross-connected to 3715 (more details about this setup see XXX). For a list of all available VLANs see GPO's OpenFlow Aggregate Page. Before continuing we would need to configure eth3. The IP subnet assigned to us is 10.42.130.0. Although you can assign any IP address to your PG host that is not used in your experiment, the convention for the PG hosts of the GPO lab is that the last octet of the IP address is 200+pc number. Since we got pc 11, the IP address that should be assigned is 10.42.130.211.
Follow these steps to configure the host
- Add these lines in the end of /etc/network/interfaces, edit this file as sudo:
auto eth3.1750 iface eth3.1750 inet static address 10.42.130.211 netmask 255.255.255.0 mtu 1500
- Install the vlan package
sudo apt-get install vlan
- Reboot the machine
sudo init 6 && exit
It is important to configure the host before reserving the OpenFlow resources that are directly associated with this host.
OpenFlow Slivers
After we have reserved and configured all the compute resources we are ready to reserve the OpenFlow resources. This example spans three different OpenFlow aggregates, GPO, Clemson and NLR. The first thing we need to figure out, is where to run the OpenFlow controller. The OpenFlow controller is the software that decides how packets that belong to our sliver should be handled. The host running the OpenFlow controller listening on a TCP port, should be reachable by the OpenFlow resources at the sites (i.e. any firewalls in front of your controller must permit your TCP port).For the purpose of this example the controller will run at nineveh.gpolab.bbn.com on tcp port 1718.
Note that for some switches, the OpenFlow port is the physical port + 24, so in your rspec you would need to account for this when requesting the resources. This information should be specified in the Aggregate page, but the best way to find out is to invoke the list available resources on the appropriate Aggregate manager. If the ports listed in the response differ by 24 from the expected port numbers, then adjust your reservation rspec appropriately. For an example of how to invoke list resources look here.
GPO OpenFlow Sliver
Based on the topology diagram above, at the GPO aggregate we would like to reserve resources related to IP subnet 10.42.130.0/24 on the two GPO switches for ports 1, 47 of the first switch and ports 20 and 3 on the second. This is an rspec that requests these resources. From GPO's aggregate page we can also get the AM URL.
src/omni.py createsliver -a https://tulum.gpolab.bbn.com:1443/openflow/gapi/ -n hellogeni_slice openflow-bbn-hellogeni.rspec
The output of this command should look like this.
Clemson OpenFlow Sliver
Based on the topology diagram above, at the Clemson aggregate we would like to reserve resources related to IP subnet 10.42.130.0/24 on the two clemson switch for ports 43 and 36. This is an rspec that requests these resources. From Clemson's aggregate page we can also get the AM URL.
src/omni.py createsliver -a https://expedient.clemson.edu:1443/openflow/gapi/ hellogeni_slice openflow-clemson-hellogeni.rspec
The output of this command should look like this.
NLR OpenFlow Sliver
Based on the topology diagram above, at the Clemson aggregate we would like to reserve resources related to IP subnet 10.42.130.0/24 on the two NLR switch for ports 25 and 26 on both. This is an rspec that requests these resources. From NLR's aggregate page we can also get the AM URL.
src/omni.py createsliver -n -a https://ofc-testlab.grnoc.iu.edu:1443/openflow/gapi/ hellogeni_slice openflow-nlr-hellogeni.rspec
The output of this command should look like this.
Opt-in OpenFlow resources
After requesting all the OpenFlow resources, we need to contact the administrator at each of the OpenFlow aggregates to actually opt-in the traffic. You can get the email address from each aggregate's page.
For the email you will need the following info from your openflow rspec file
- <user_email> : from the user tag, the value of the email attribute
- <project_name> : from the the project tag, the value of the name attribute
- <slice_name> : from the the slice tag, the value of the name attribute
For these rspecs the values would be : <user_email> = nriga@bbn.com, <project_name> = hellogeni, <slice_name> = hellogeni. Also make sure to describe your intended topology.
Use the following template
To: <email@aggregate.geni> From: Geni User <geniuser@example.com> Subject: Opt-in traffic for slice <slice_name> Please opt-in the traffic for the slice with the following information : * name : <slice_name> * project : <project_name> * email : <user_email> I have reserved a sliver containing pc1.pgeni.gpolab.bbn.com and planetlab5.clemson.edu. I have reserved IP subnet 10.42.130.0/24 and I would like all traffic for this subnet that is of type IP or ARP to be forwarded to my controller. The traffic should flow over VLAN 3715. Thanks,
Once we receive a confirmation that our traffic has been opted in from all three aggregates we are ready to run our experiment!
Run the experiment
First of all we need to start the OpenFlow controller so that our traffic is being forwarded in the network
Run OpenFlow controller
There are multiple choices for OpenFlow controllers that you might want to consider. For this example we are going to use the Nox Controller. We are going to use a simple switch controller, that will switch traffic for our slice like a layer 2 switch. Start the controller
./nox_core -i ptcp:1718 switch
Install netcat on myPLC resources
MyPlc hosts have very few installed packages, so we need to install the necessary software. First we login to our host at clemson
ssh -i .ssh/gcf_id_rsa pgenigpolabbbncom_hellogenislice@planetlab5.clemson.edu
Once you've logged in, you can install the 'nc' package, to run netcat, which you'll use later:
sudo yum -y install nc
Say hello
First we login to our hosts from two different terminals :
ssh -i ~/.ssh/gcf_id_rsa inki@pc11.pgeni.gpolab.bbn.com ssh -i .ssh/gcf_id_rsa pgenigpolabbbncom_hellogenislice@planetlab5.clemson.ed
Run the listener on the myPLC host
[pgenigpolabbbncom_hellogenislice@planetlab5 ~]$ nc -lk 10.42.130.105 6256
Connect to the listener you just started from your ProtoGENI host :
node0:~> nc 10.42.130.105 6256
Make sure your OpenFlow controller is running. Type "Hello GENI" on the PG host and see it appear on the myPLC host. Try it with your controller running, and not running, to see.
Note that after stopping our controller, we need to wait five seconds without sending any traffic in order for the flowtable entries in the switches to time out -- if traffic is flowing continuously, it'll keep flowing even if the controller is not running. Once any existing flowtable entries time out, though, new ones won't be created (and traffic won't flow) while the controller is down.
Release resources
It is important after running an experiment to cleanup all the resources, since as long as the resources are reserved other experimenters can not use them. Although most of the reservations come with expiration times, we should be considerate and release our resources if our experiment has finished before that.
Release OpenFlow resources
It's important to release the OpenFlow resources before the slice expires. Currently the OpenFlow slivers are not tied with the slice's expiration time and they may have an expiration time that exceeds the expiration time of the slice, in which case you won't be able to access your resources through Omni.
For each aggregate delete the OpenFlow sliver :
src/omni.py deletesliver -a https://ofc-testlab.grnoc.iu.edu:1443/openflow/gapi/ hellogeni_slice src/omni.py deletesliver -a https://tulum.gpolab.bbn.com:1443/openflow/gapi/ hellogeni_slice src/omni.py deletesliver -a https://expedient.clemson.edu:1443/openflow/gapi/ hellogeni_slice
The output should look like this.
If your slice has already expired then only the Aggregate administrator can delete your OpenFlow sliver. In this case you would need to send an email :
To: <email@aggregate.geni> From: Geni User <geniuser@example.com> Subject: Delete OpenFlow slice <slice_name> Please delete the OpenFlow slice with the following information : * name : <slice_name> * project : <project_name> * email : <user_email> Thanks,
Release GPO's ProtoGENI and Clemson's myPLC
Invoke the delete sliver command
src/omni.py deletesliver -a http://www.pgeni.gpolab.bbn.com/protogeni/xmlrpc/am hellogeni_slice src/omni.py deletesliver -a https://myplc.clemson.edu:12346 hellogeni_slice
If the slice has expired, then these resources are released so there is no need to worry about this case.
Time to run your own experiment! Let us know if you need any help.
Attachments (10)
- pg-bbn-hellogeni.out (2.1 KB) - added by 13 years ago.
- myplc-clemson-hellogeni.out (1.8 KB) - added by 13 years ago.
- openflow-clemson-hellogeni.out (2.8 KB) - added by 13 years ago.
- delete-openflow-nlr-hellogeni.out (806 bytes) - added by 13 years ago.
- openflow-nlr-hellogeni.out (3.5 KB) - added by 13 years ago.
- hellogeni-topo.jpg (101.7 KB) - added by 13 years ago.
- openflow-bbn-hellogeni.out (3.3 KB) - added by 13 years ago.
-
rspec-pgeni-pc9.xml (672 bytes) - added by 13 years ago.
Latest pgeni rspec file which includes virtualization_type information
- rspec-pgeni-pc11.xml (673 bytes) - added by 13 years ago.
- rspec-foam-gpolab-bbn-com-3626-foam-gapi-1.xml (4.6 KB) - added by 13 years ago.
Download all attachments as: .zip