= EG-EXP-7: Click Router Experiment Acceptance Test = This page captures status for the test case EG-EXP-7, which verifies a click router scenario. This test has been executed for two topologies: - [wiki:GENIRacksHome/InstageniRacks/AcceptanceTestStatus/IG-EXP-7#Scenario1-GPORack Scenario 1 - GPO Rack]: All nodes in topology are in GPO InstaGENI rack. - [wiki:GENIRacksHome/InstageniRacks/AcceptanceTestStatus/IG-EXP-7#Scenario2-GPOandUtahIGRacks Scenario 2 - GPO and Utah Racks]: Resources hostA and 2 click routers in GPO rack;Resources hostB and 2 click routers are in Utah rack. Results for both test scenario are captured in this page. For overall status see the [wiki:GENIRacksHome/InstageniRacks/AcceptanceTestStatus InstaGENI Acceptance Test Status] page. ''Last update: 2013/04/10'' = Test Status = This section captures the status for each step in the acceptance test plan. || '''Step''' ||'''State/Scenario 2:'''||'''Notes '''||'''Tickets'''|| '''State/Scenario 1:''' ||'''Notes '''||'''Tickets'''|| || Step 1 || [[Color(green,Pass)]] || || || [[Color(green,Pass)]] || || || || Step 2 || [[Color(green,Pass)]] || || || [[Color(green,Pass)]] || || || || Step 3 || [[Color(green,Pass)]] || || || [[Color(green,Pass)]] || || || || Step 4 || [[Color(green,Pass)]] || || || [[Color(green,Pass)]] || || || || Step 5 || [[Color(green,Pass)]] || || || [[Color(green,Pass)]] || || || || Step 6 || [[Color(green,Pass)]] || || || [[Color(green,Pass)]] || || || || Step 7 || [[Color(green,Pass)]] || || || [[Color(green,Pass)]] || || || || Step 8 || [[Color(green,Pass)]] ||Setup issues|| || [[Color(green,Pass)]] || || || || Step 9 || || || || [[Color(green,Pass)]] || || || || Step 10 || || || || [[Color(green,Pass)]] || || || || Step 11 || || || || [[Color(green,Pass)]] || || || || Step 12 || || || || [[Color(green,Pass)]] || || || [[BR]] || '''State Legend''' || '''Description''' || || [[Color(green,Pass)]] || Test completed and met all criteria || || [[Color(#98FB98,Pass: most criteria)]] || Test completed and met most criteria. Exceptions documented || || [[Color(red,Fail)]] || Test completed and failed to meet criteria. || || [[Color(yellow,Complete)]] || Test completed but will require re-execution due to expected changes || || [[Color(orange,Blocked)]] || Blocked by ticketed issue(s). || || [[Color(#63B8FF,In Progress)]] || Currently under test. || [[BR]] = Test Plan Steps = The following aggregate manager nicknames are used in this test case: {{{ ig-utah=,https://utah.geniracks.net/protogeni/xmlrpc/am/2.0 ig-gpo=,https://instageni.gpolab.bbn.com/protogeni/xmlrpc/am/2.0 }}} = Scenario 1 - GPO Rack = == 1. As Experimenter1, request !ListResources from GPO InstaGENI == As user lnevers@bbn.com requested listresources from GPO and Utah InstaGENI aggregates: {{{ $ omni.py listresources -a ig-gpo -o }}} == 2. Review !ListResources == Reviews output file ''rspec-instageni-gpolab-bbn-com-protogeniv2.xml'' to determine available resources. == 3. Define a request RSpec for three VMs at GPO InstaGENI == The RSpec generated is [http://groups.geni.net/geni/browser/trunk/GENIRacks/InstaGENI/Spiral4/RSpecs/AcceptanceTests/IG-EXP-7/IG-EXP-7.rspec IG-EXP-7.rspec] requests a topology shown in here: [[Image(IG-EXP-7-gpo.jpg)]] == 4. Define a request RSpec for GPO InstaGENI == The RSpec generated is [http://groups.geni.net/geni/browser/trunk/GENIRacks/InstaGENI/Spiral4/RSpecs/AcceptanceTests/IG-EXP-7/IG-EXP-7-gpo.rspec IG-EXP-7-gpo.rspec]. == 5. Create slice == Created a slice: {{{ $ omni.py createslice IG-EXP-7 INFO:omni:Loading config file /home/lnevers/.gcf/omni_config INFO:omni:Using control framework pg INFO:omni:Created slice with Name IG-EXP-7, URN urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+IG-EXP-7, Expiration 2013-01-20 00:00:00+00:00 INFO:omni: ------------------------------------------------------------ INFO:omni: Completed createslice: Options as run: framework: pg Args: createslice IG-EXP-7 Result Summary: Created slice with Name IG-EXP-7, URN urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+IG-EXP-7, Expiration 2013-01-20 00:00:00+00:00 INFO:omni: ============================================================ }}} == 6. Create a sliver == In the slice IG-EXP-7 create a slivers at the GPO InstaGENI AM using the RSpecs [http://groups.geni.net/geni/browser/trunk/GENIRacks/InstaGENI/Spiral4/RSpecs/AcceptanceTests/IG-EXP-7/IG-EXP-7-gpo.rspec IG-EXP-7-gpo.rspec]. {{{ $ omni.py createsliver -a ig-gpo IG-EXP-7 IG-EXP-7-gpo.rspec INFO:omni:Loading config file /home/lnevers/.gcf/omni_config INFO:omni:Using control framework pg INFO:omni:Substituting AM nickname ig-gpo with URL http://instageni.gpolab.bbn.com/protogeni/xmlrpc/am/2.0, URN unspecified_AM_URN INFO:omni:Slice urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+IG-EXP-7 expires on 2013-01-20 00:00:00 UTC INFO:omni:Substituting AM nickname ig-gpo with URL http://instageni.gpolab.bbn.com/protogeni/xmlrpc/am/2.0, URN unspecified_AM_URN INFO:omni:Substituting AM nickname ig-gpo with URL http://instageni.gpolab.bbn.com/protogeni/xmlrpc/am/2.0, URN unspecified_AM_URN INFO:omni:Creating sliver(s) from rspec file IG-EXP-7-gpo.rspec for slice urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+IG-EXP-7 INFO:omni:Got return from CreateSliver for slice IG-EXP-7 at http://instageni.gpolab.bbn.com/protogeni/xmlrpc/am/2.0: INFO:omni: INFO:omni: INFO:omni: ------------------------------------------------------------ INFO:omni: Completed createsliver: Options as run: aggregate: ['ig-gpo'] framework: pg Args: createsliver IG-EXP-7 IG-EXP-7-gpo.rspec Result Summary: Got Reserved resources RSpec from instageni-gpolab-bbn-com-protogeniv2 INFO:omni: ============================================================ }}} == 7. Install Click router == The RSpec used defines the following services to install the click router: {{{ }}} The above services will get the ''click-example.tar.gz'' place it on ''/local'' on the 4 router nodes, unpack the tar.gz file which contains two files: * ''install-script.sh'' - installs click routes v.2.0.1 ran as part of the createsliver. * ''extractClickConfig.py'' - determines MAC and IP settings for the configuration, ran manually after sliver is ready. == 8. Determine Click router settings == The click router setting are determined by the ''extractClickConfig.py'' script. To run this script, determin login for each of the nodes in the experiment at each resource aggregate: {{{ $ readyToLogin.py -a ig-gpo IG-EXP-7 <...> hostA's geni_status is: ready (am_status:ready) User lnevers logins to hostA using: xterm -e ssh -p 30523 -i /home/lnevers/.ssh/id_rsa lnevers@pc2.instageni.gpolab.bbn.com & right's geni_status is: ready (am_status:ready) User lnevers logins to right using: xterm -e ssh -p 30526 -i /home/lnevers/.ssh/id_rsa lnevers@pc2.instageni.gpolab.bbn.com & left's geni_status is: changing (am_status:changing) User lnevers logins to left using: xterm -e ssh -p 30525 -i /home/lnevers/.ssh/id_rsa lnevers@pc2.instageni.gpolab.bbn.com & bottom's geni_status is: ready (am_status:ready) User lnevers logins to bottom using: xterm -e ssh -p 30522 -i /home/lnevers/.ssh/id_rsa lnevers@pc2.instageni.gpolab.bbn.com & top's geni_status is: ready (am_status:ready) User lnevers logins to top using: xterm -e ssh -p 30527 -i /home/lnevers/.ssh/id_rsa lnevers@pc2.instageni.gpolab.bbn.com & hostB's geni_status is: ready (am_status:ready) User lnevers logins to hostB using: xterm -e ssh -p 30524 -i /home/lnevers/.ssh/id_rsa lnevers@pc2.instageni.gpolab.bbn.com & }}} First logged into hostA to verify connection and that host can exchange traffic: {{{ [lnevers@hostA ~]$ ping hostB PING hostB-link-B (10.10.6.2) 56(84) bytes of data. 64 bytes from hostB-link-B (10.10.6.2): icmp_req=1 ttl=61 time=5.67 ms 64 bytes from hostB-link-B (10.10.6.2): icmp_req=2 ttl=61 time=0.104 ms }}} On hostB {{{ [lnevers@hostB ~]$ ping hostA PING hostA-link-A (10.10.1.1) 56(84) bytes of data. 64 bytes from hostA-link-A (10.10.1.1): icmp_req=1 ttl=61 time=0.085 ms 64 bytes from hostA-link-A (10.10.1.1): icmp_req=2 ttl=61 time=0.065 ms }}} ''Note: The pings are left running and will be referenced in later steps.'' Generated configuration on each click router by remotely executing the script provided for the click-example: On ''top'' router: {{{ $ ssh -A -p 30527 -i /home/lnevers/.ssh/id_rsa lnevers@pc2.instageni.gpolab.bbn.com "/local/click-example/extractClickConfig.py " Your host information: hostA: hostA.IG-EXP-7.pgeni-gpolab-bbn-com.instageni.gpolab.bbn.com pc2.instageni.gpolab.bbn.com top: top.IG-EXP-7.pgeni-gpolab-bbn-com.instageni.gpolab.bbn.com pc2.instageni.gpolab.bbn.com left: left.IG-EXP-7.pgeni-gpolab-bbn-com.instageni.gpolab.bbn.com pc2.instageni.gpolab.bbn.com right: right.IG-EXP-7.pgeni-gpolab-bbn-com.instageni.gpolab.bbn.com pc2.instageni.gpolab.bbn.com bottom: bottom.IG-EXP-7.pgeni-gpolab-bbn-com.instageni.gpolab.bbn.com pc2.instageni.gpolab.bbn.com hostB: hostB.IG-EXP-7.pgeni-gpolab-bbn-com.instageni.gpolab.bbn.com pc2.instageni.gpolab.bbn.com Done. }}} On ''left'' router: {{{ $ ssh -A -p 30525 -i /home/lnevers/.ssh/id_rsa lnevers@pc2.instageni.gpolab.bbn.com "/local/click-example/extractClickConfig.py " Warning: Permanently added '[pc2.instageni.gpolab.bbn.com]:30525,[192.1.242.141]:30525' (RSA) to the list of known hosts. Your host information: hostA: hostA.IG-EXP-7.pgeni-gpolab-bbn-com.instageni.gpolab.bbn.com pc2.instageni.gpolab.bbn.com top: top.IG-EXP-7.pgeni-gpolab-bbn-com.instageni.gpolab.bbn.com pc2.instageni.gpolab.bbn.com left: left.IG-EXP-7.pgeni-gpolab-bbn-com.instageni.gpolab.bbn.com pc2.instageni.gpolab.bbn.com right: right.IG-EXP-7.pgeni-gpolab-bbn-com.instageni.gpolab.bbn.com pc2.instageni.gpolab.bbn.com bottom: bottom.IG-EXP-7.pgeni-gpolab-bbn-com.instageni.gpolab.bbn.com pc2.instageni.gpolab.bbn.com hostB: hostB.IG-EXP-7.pgeni-gpolab-bbn-com.instageni.gpolab.bbn.com pc2.instageni.gpolab.bbn.com Done. }}} On ''right'' router: {{{ $ ssh -A -p 30526 -i /home/lnevers/.ssh/id_rsa lnevers@pc2.instageni.gpolab.bbn.com "/local/click-example/extractClickConfig.py " Warning: Permanently added '[pc2.instageni.gpolab.bbn.com]:30526,[192.1.242.141]:30526' (RSA) to the list of known hosts. Your host information: hostA: hostA.IG-EXP-7.pgeni-gpolab-bbn-com.instageni.gpolab.bbn.com pc2.instageni.gpolab.bbn.com top: top.IG-EXP-7.pgeni-gpolab-bbn-com.instageni.gpolab.bbn.com pc2.instageni.gpolab.bbn.com left: left.IG-EXP-7.pgeni-gpolab-bbn-com.instageni.gpolab.bbn.com pc2.instageni.gpolab.bbn.com right: right.IG-EXP-7.pgeni-gpolab-bbn-com.instageni.gpolab.bbn.com pc2.instageni.gpolab.bbn.com bottom: bottom.IG-EXP-7.pgeni-gpolab-bbn-com.instageni.gpolab.bbn.com pc2.instageni.gpolab.bbn.com hostB: hostB.IG-EXP-7.pgeni-gpolab-bbn-com.instageni.gpolab.bbn.com pc2.instageni.gpolab.bbn.com Done. }}} On ''bottom'' router: {{{ $ ssh -A -p 30522 -i /home/lnevers/.ssh/id_rsa lnevers@pc2.instageni.gpolab.bbn.com "/local/click-example/extractClickConfig.py " Your host information: hostA: hostA.IG-EXP-7.pgeni-gpolab-bbn-com.instageni.gpolab.bbn.com pc2.instageni.gpolab.bbn.com top: top.IG-EXP-7.pgeni-gpolab-bbn-com.instageni.gpolab.bbn.com pc2.instageni.gpolab.bbn.com left: left.IG-EXP-7.pgeni-gpolab-bbn-com.instageni.gpolab.bbn.com pc2.instageni.gpolab.bbn.com right: right.IG-EXP-7.pgeni-gpolab-bbn-com.instageni.gpolab.bbn.com pc2.instageni.gpolab.bbn.com bottom: bottom.IG-EXP-7.pgeni-gpolab-bbn-com.instageni.gpolab.bbn.com pc2.instageni.gpolab.bbn.com hostB: hostB.IG-EXP-7.pgeni-gpolab-bbn-com.instageni.gpolab.bbn.com pc2.instageni.gpolab.bbn.com Done. }}} The above operations generate an image of the topology. Which can be retrieved from each router: {{{ scp -P 30522 pc2.instageni.gpolab.bbn.com:myslice.png . }}} The file generated can be viewed as follows: {{{ eog myslice.png & }}} The image generated for this experimented showed the following: [[Image(myslice.jpg)]] == 9. Run the user-level Click router == First, checked to make sure that pings are still running between hostA and hostB and using IP. At this point stopped IP on each of the routers: {{{ # top router $ ssh -A -p 30527 pc2.instageni.gpolab.bbn.com "sh stopIP.sh " Disabling IP on interface mv10.5 Disabling IP on interface mv10.7 # left router $ ssh -A -p 30525 pc2.instageni.gpolab.bbn.com "sh stopIP.sh " Disabling IP on interface mv8.6 Disabling IP on interface mv8.9 # right router $ ssh -A -p 30526 pc2.instageni.gpolab.bbn.com "sh stopIP.sh " Disabling IP on interface mv9.8 Disabling IP on interface mv9.12 # bottom router $ ssh -A -p 30522 pc2.instageni.gpolab.bbn.com "sh stopIP.sh " Disabling IP on interface mv5.10 Disabling IP on interface mv5.11 }}} After verifying that pings are failing, started the user-level Click router by providing the print pings configuration file name. Leave terminal connection open: {{{ # top router $ ssh -A -p 30527 pc2.instageni.gpolab.bbn.com "sh ./startClick.sh" Stopping any running Click routers Starting Click router # left router $ ssh -A -p 30525 pc2.instageni.gpolab.bbn.com "sh ./startClick.sh" Stopping any running Click routers Starting Click router # right router $ ssh -A -p 30526 pc2.instageni.gpolab.bbn.com "sh ./startClick.sh" Stopping any running Click routers Starting Click router # bottom router $ ssh -A -p 30522 pc2.instageni.gpolab.bbn.com "sh ./startClick.sh" Stopping any running Click routers Starting Click router }}} == 10. Log in to Host1 and send traffic to host2 == Verified that pings, which had stopped when IP was disabled, do resume between hostA and hostB when click router is started. == 11. Review Click logs on each Click router == Each of the click routers generates a /tmp/click.log file. Below is an example from the bottom click router: {{{ $ ssh -A -p 30522 pc2.instageni.gpolab.bbn.com Last login: Wed Jan 16 14:43:36 2013 from arendia.gpolab.bbn.com [lnevers@bottom ~]$ more /tmp/click.log bottom.click:34: While initializing 'FromDevice@18 :: FromDevice': warning: mv5.10: no IPv4 address assigned bottom.click:35: While initializing 'FromDevice@21 :: FromDevice': warning: mv5.11: no IPv4 address assigned outL: 114 | 0285d930 84a002be cc48e782 7744426f 62576173 48657265 inR: 114 | 02a78ae6 971502aa 46be6629 7744416c 69636557 61734865 inL: 114 | 02becc48 e7820285 d93084a0 7744416c 69636557 61734865 outR: 114 | 02aa46be 662902a7 8ae69715 7744426f 62576173 48657265 outL: 114 | 0285d930 84a002be cc48e782 7744426f 62576173 48657265 inL: 114 | 02becc48 e7820285 d93084a0 7744416c 69636557 61734865 inL: 114 | 02becc48 e7820285 d93084a0 7744416c 69636557 61734865 outL: 114 | 0285d930 84a002be cc48e782 7744426f 62576173 48657265 outL: 114 | 0285d930 84a002be cc48e782 7744426f 62576173 48657265 inR: 114 | 02a78ae6 971502aa 46be6629 7744416c 69636557 61734865 inL: 114 | 02becc48 e7820285 d93084a0 7744416c 69636557 61734865 outR: 114 | 02aa46be 662902a7 8ae69715 7744426f 62576173 48657265 outL: 114 | 0285d930 84a002be cc48e782 7744426f 62576173 48657265 inL: 114 | 02becc48 e7820285 d93084a0 7744416c 69636557 61734865 inL: 114 | 02becc48 e7820285 d93084a0 7744416c 69636557 61734865 outL: 114 | 0285d930 84a002be cc48e782 7744426f 62576173 48657265 outL: 114 | 0285d930 84a002be cc48e782 7744426f 62576173 48657265 inR: 114 | 02a78ae6 971502aa 46be6629 7744416c 69636557 61734865 inL: 114 | 02becc48 e7820285 d93084a0 7744416c 69636557 61734865 outR: 114 | 02aa46be 662902a7 8ae69715 7744426f 62576173 48657265 }}} == 12. Delete slivers == Deleted the sliver at the GPO InstaGENI aggregate: {{{ $ omni.py deletesliver -a ig-gpo IG-EXP-7 INFO:omni:Loading config file /home/lnevers/.gcf/omni_config INFO:omni:Using control framework pg INFO:omni:Substituting AM nickname ig-gpo with URL http://instageni.gpolab.bbn.com/protogeni/xmlrpc/am/2.0, URN unspecified_AM_URN INFO:omni:Slice urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+IG-EXP-7 expires on 2013-01-20 00:00:00 UTC INFO:omni:Substituting AM nickname ig-gpo with URL http://instageni.gpolab.bbn.com/protogeni/xmlrpc/am/2.0, URN unspecified_AM_URN INFO:omni:Deleted sliver urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+IG-EXP-7 on unspecified_AM_URN at http://instageni.gpolab.bbn.com/protogeni/xmlrpc/am/2.0 INFO:omni: ------------------------------------------------------------ INFO:omni: Completed deletesliver: Options as run: aggregate: ['ig-gpo'] framework: pg Args: deletesliver IG-EXP-7 Result Summary: Deleted sliver urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+IG-EXP-7 on unspecified_AM_URN at http://instageni.gpolab.bbn.com/protogeni/xmlrpc/am/2.0 INFO:omni: ============================================================ }}} = Scenario 2 - GPO and Utah IG Racks = == 1. As Experimenter1, request !ListResources from GPO and Utah InstaGENI == As user lnevers@bbn.com requested listresources from GPO and Utah InstaGENI aggregates: {{{ $ omni.py listresources -a ig-gpo -o $ omni.py listresources -a ig-utah -o }}} == 2. Review !ListResources output from both AMs == Reviews output files ''rspec-instageni-gpolab-bbn-com-protogeniv2.xml'' and ''rspec-utah-geniracks-net-protogeniv2.xml'' to determine available resources. == 3. Define a request RSpec for three VMs at GPO InstaGENI == For InstaGENI aggregates, the RSpec for a sliver can include resources from multiple aggregates. The aggregate handling the request will only allocate its own resources, therefore one RSpec is used to capture the resource requests for both sites in this scenario. Defined an RSpec that requests one three VMs at the GPO rack and three VMs at the Utah rack. For each rack aggregate, one of the VMs will be an end-point host and the other two VMs will be click routers. The RSpec generated is [http://groups.geni.net/geni/browser/trunk/GENIRacks/InstaGENI/Spiral4/RSpecs/AcceptanceTests/IG-EXP-7/IG-EXP-7.rspec IG-EXP-7.rspec]. The topology and address scheme are shown below using client_ids defined in the RSpec:[[BR]] [[Image(IG-EXP-7.jpg)]] ''Note (*): link-0 and link-1 use shared Layer 2 VLANs.'' == 4. Define a request RSpec for three VMs at Utah InstaGENI == The RSpec generated for the GPO aggregate is also used for the Utah aggregate, the file is [http://groups.geni.net/geni/browser/trunk/GENIRacks/InstaGENI/Spiral4/RSpecs/AcceptanceTests/IG-EXP-7/IG-EXP-7-vlan.rspec IG-EXP-7vlan.rspec]. == 5. Create slice == Created a slice: {{{ $ omni.py createslice IG-EXP-7 INFO:omni:Loading config file /home/lnevers/.gcf/omni_config INFO:omni:Using control framework pg INFO:omni:Created slice with Name IG-EXP-7, URN urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+IG-EXP-7, Expiration 2013-04-11 12:37:49+00:00 INFO:omni: ------------------------------------------------------------ INFO:omni: Completed createslice: Options as run: framework: pg Args: createslice IG-EXP-7 Result Summary: Created slice with Name IG-EXP-7, URN urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+IG-EXP-7, Expiration 2013-04-11 12:37:49+00:00 INFO:omni: ============================================================ }}} == 6. Create slivers == For the slice IG-EXP-7 create a slivers at each AM, using the RSpecs [http://groups.geni.net/geni/browser/trunk/GENIRacks/InstaGENI/Spiral4/RSpecs/AcceptanceTests/IG-EXP-7/IG-EXP-7.rspec IG-EXP-7.rspec] defined above. First create a sliver at the GPO InstaGENI AM: {{{ $ omni.py createsliver -a ig-gpo IG-EXP-7 IG-EXP-7-vlan.rspec INFO:omni:Loading config file /home/lnevers/.gcf/omni_config INFO:omni:Using control framework pg INFO:omni:Substituting AM nickname ig-gpo with URL https://instageni.gpolab.bbn.com:12369/protogeni/xmlrpc/am/2.0, URN unspecified_AM_URN INFO:omni:Slice urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+IG-EXP-7 expires on 2013-04-15 00:00:00 UTC INFO:omni:Substituting AM nickname ig-gpo with URL https://instageni.gpolab.bbn.com:12369/protogeni/xmlrpc/am/2.0, URN unspecified_AM_URN INFO:omni:Substituting AM nickname ig-gpo with URL https://instageni.gpolab.bbn.com:12369/protogeni/xmlrpc/am/2.0, URN unspecified_AM_URN INFO:omni:Creating sliver(s) from rspec file IG-EXP-7-vlan.rspec for slice urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+IG-EXP-7 INFO:omni: (PG log url - look here for details on any failures: https://boss.instageni.gpolab.bbn.com/spewlogfile.php3?logfile=7ca88884c609685a24abe5dcdf14d135) INFO:omni:Got return from CreateSliver for slice IG-EXP-7 at https://instageni.gpolab.bbn.com:12369/protogeni/xmlrpc/am/2.0: INFO:omni: INFO:omni: INFO:omni: ------------------------------------------------------------ INFO:omni: Completed createsliver: Options as run: aggregate: ['ig-gpo'] framework: pg Args: createsliver IG-EXP-7 IG-EXP-7-vlan.rspec Result Summary: Got Reserved resources RSpec from instageni-gpolab-bbn-com-protogeniv2 INFO:omni: ============================================================ }}} Then create a sliver at the Utah InstaGENI AM: {{{ $ omni.py createsliver -a ig-utah IG-EXP-7 IG-EXP-7-vlan.rspec INFO:omni:Loading config file /home/lnevers/.gcf/omni_config INFO:omni:Using control framework pg INFO:omni:Substituting AM nickname ig-utah with URL https://utah.geniracks.net:12369/protogeni/xmlrpc/am/2.0, URN unspecified_AM_URN INFO:omni:Slice urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+IG-EXP-7 expires on 2013-04-15 00:00:00 UTC INFO:omni:Substituting AM nickname ig-utah with URL https://utah.geniracks.net:12369/protogeni/xmlrpc/am/2.0, URN unspecified_AM_URN INFO:omni:Substituting AM nickname ig-utah with URL https://utah.geniracks.net:12369/protogeni/xmlrpc/am/2.0, URN unspecified_AM_URN INFO:omni:Creating sliver(s) from rspec file IG-EXP-7-vlan.rspec for slice urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+IG-EXP-7 INFO:omni: (PG log url - look here for details on any failures: https://boss.utah.geniracks.net/spewlogfile.php3?logfile=b3218b871776dc05f8d799d6bc103a19) INFO:omni:Got return from CreateSliver for slice IG-EXP-7 at https://utah.geniracks.net:12369/protogeni/xmlrpc/am/2.0: INFO:omni: INFO:omni: INFO:omni: ------------------------------------------------------------ INFO:omni: Completed createsliver: Options as run: aggregate: ['ig-utah'] framework: pg Args: createsliver IG-EXP-7 IG-EXP-7-vlan.rspec Result Summary: Got Reserved resources RSpec from utah-geniracks-net-protogeniv2 INFO:omni: ============================================================ }}} "Workaround" - For this test run, the manifest RSpec from each Aggregate had to be combined into one manifest to set up the files expected by the current version of the Click Router Example. To create the combined Manifest and place it in the expected location, the following steps were executed: a. Get manifest from GPO InstaGENI ($ omni.py listresources -a ig-gpo IG-EXP-7 IG-EXP-7-vlan.rspec -o) output file is [IG-EXP-7-manifest-rspec-instageni-gpolab-bbn-com-protogeniv2.xml] b. Get manifest from Utah InstaGENI ($ omni.py listresources -a ig-utah IG-EXP-7 IG-EXP-7-vlan.rspec -o) output file is (IG-EXP-7-manifest-rspec-utah-geniracks-net-protogeniv2.xml) c. Combine the two steps above to produce one overall [combined-manifest.xml] file that captures the entire slice and place it on each router (top, bottom, letft, right) and then '' "$ sudo mv combined-manifest.xml /proj/pgeni-gpolab-bbn-com/exp/IG-EXP-7/tbdata/geni_manifest" ''. == 7. Install Click router == The Rspec used defines the following services to install the click router: {{{ }}} The above service will get the ''click-example.tar.gz'' place it on ''/local'' on the 4 router nodes, unpack the tar.gz file which contains two files: * ''install-script.sh'' - installs click routes v.2.0.1 ran as part of the createsliver. * ''extractClickConfig.py'' - determines MAC and IP settings for the configuration, ran manually after sliver is ready. == 8. Determine Click router settings == The click router setting are determined by the ''extractClickConfig.py'' script. To run this script, determin login for each of the nodes in the experiment at each resource aggregate: {{{ $ readyToLogin.py -a ig-gpo IG-EXP-7 <...> top's geni_status is: ready (am_status:ready) User lnevers logins to top using: xterm -e ssh -p 32828 -i /home/lnevers/.ssh/id_rsa lnevers@pc1.instageni.gpolab.bbn.com & left's geni_status is: ready (am_status:ready) User lnevers logins to left using: xterm -e ssh -p 32827 -i /home/lnevers/.ssh/id_rsa lnevers@pc1.instageni.gpolab.bbn.com & hostA's geni_status is: ready (am_status:ready) User lnevers logins to hostA using: xterm -e ssh -p 32826 -i /home/lnevers/.ssh/id_rsa lnevers@pc1.instageni.gpolab.bbn.com & $ readyToLogin.py -a ig-utah IG-EXP-7 <...> bottom's geni_status is: ready (am_status:ready) User lnevers logins to bottom using: xterm -e ssh -p 32058 -i /home/lnevers/.ssh/id_rsa lnevers@pc1.utah.geniracks.net & hostB's geni_status is: ready (am_status:ready) User lnevers logins to hostB using: xterm -e ssh -p 32059 -i /home/lnevers/.ssh/id_rsa lnevers@pc1.utah.geniracks.net & right's geni_status is: ready (am_status:ready) User lnevers logins to right using: xterm -e ssh -p 32060 -i /home/lnevers/.ssh/id_rsa lnevers@pc1.utah.geniracks.net & }}} Note: No routes are available to allow the hostA to hostB end-to-end connection, so routes had to be added to the following: On "top" router added route to hostB network: {{{ [lnevers@top ~]$ sudo /sbin/route add -net 10.42.19.0/24 gw 10.42.21.2 }}} On "bottom" router added route to hostA network: {{{ [lnevers@bottom ~]$ sudo /sbin/route add -net 10.42.18.0/24 gw 10.42.13.2 }}} Once the routes are added, started pings between hostA and hostB: First logged into hostA and hostB to verify connection are in place. From HostA pinged HostB: {{{ [lnevers@hostA ~]$ /sbin/ifconfig mv7.14 mv7.14 Link encap:Ethernet HWaddr 02:92:6E:C3:4C:7B inet addr:10.42.18.2 Bcast:10.42.18.255 Mask:255.255.255.0 UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:0 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:0 (0.0 b) TX bytes:0 (0.0 b) [lnevers@hostA ~]$ ping 10.42.19.2 PING 10.42.19.2 (10.42.19.2) 56(84) bytes of data. 64 bytes from 10.42.19.2: icmp_req=1 ttl=61 time=91.0 ms 64 bytes from 10.42.19.2: icmp_req=2 ttl=61 time=91.1 ms 64 bytes from 10.42.19.2: icmp_req=3 ttl=61 time=91.0 ms }}} From HostB pinged HostA: {{{ [lnevers@hostB ~]$ /sbin/ifconfig mv6.94 mv6.94 Link encap:Ethernet HWaddr 02:84:74:C3:F4:61 inet addr:10.42.19.2 Bcast:10.42.19.255 Mask:255.255.255.0 inet6 addr: fe80::84:74ff:fec3:f461/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:0 errors:0 dropped:6 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:0 (0.0 b) TX bytes:0 (0.0 b) [lnevers@hostB ~]$ ping 10.42.18.2 PING 10.42.18.2 (10.42.18.2) 56(84) bytes of data. 64 bytes from 10.42.18.2: icmp_req=1 ttl=61 time=91.0 ms 64 bytes from 10.42.18.2: icmp_req=2 ttl=61 time=90.9 ms 64 bytes from 10.42.18.2: icmp_req=3 ttl=61 time=91.0 ms }}} On ''top'' router: {{{ $ ssh -A -p 32828 -i /home/lnevers/.ssh/id_rsa lnevers@pc1.instageni.gpolab.bbn.com "/local/click-example/extractClickConfig.py" Your host information: hostA: hostA.IG-EXP-7.pgeni-gpolab-bbn-com.instageni.gpolab.bbn.com hostA.IG-EXP-7.pgeni-gpolab-bbn-com.instageni.gpolab.bbn.com top: top.IG-EXP-7.pgeni-gpolab-bbn-com.instageni.gpolab.bbn.com top.IG-EXP-7.pgeni-gpolab-bbn-com.instageni.gpolab.bbn.com left: left.IG-EXP-7.pgeni-gpolab-bbn-com.instageni.gpolab.bbn.com left.IG-EXP-7.pgeni-gpolab-bbn-com.instageni.gpolab.bbn.com right: right.IG-EXP-7.pgeni-gpolab-bbn-com.utah.geniracks.net right.IG-EXP-7.pgeni-gpolab-bbn-com.utah.geniracks.net bottom: bottom.IG-EXP-7.pgeni-gpolab-bbn-com.utah.geniracks.net bottom.IG-EXP-7.pgeni-gpolab-bbn-com.utah.geniracks.net hostB: hostB.IG-EXP-7.pgeni-gpolab-bbn-com.utah.geniracks.net hostB.IG-EXP-7.pgeni-gpolab-bbn-com.utah.geniracks.net Done. }}} On ''left'' router: {{{ $ ssh -A -p 32827 -i /home/lnevers/.ssh/id_rsa lnevers@pc1.instageni.gpolab.bbn.com "/local/click-example/extractClickConfig.py" Your host information: hostA: hostA.IG-EXP-7.pgeni-gpolab-bbn-com.instageni.gpolab.bbn.com hostA.IG-EXP-7.pgeni-gpolab-bbn-com.instageni.gpolab.bbn.com top: top.IG-EXP-7.pgeni-gpolab-bbn-com.instageni.gpolab.bbn.com top.IG-EXP-7.pgeni-gpolab-bbn-com.instageni.gpolab.bbn.com left: left.IG-EXP-7.pgeni-gpolab-bbn-com.instageni.gpolab.bbn.com left.IG-EXP-7.pgeni-gpolab-bbn-com.instageni.gpolab.bbn.com right: right.IG-EXP-7.pgeni-gpolab-bbn-com.utah.geniracks.net right.IG-EXP-7.pgeni-gpolab-bbn-com.utah.geniracks.net bottom: bottom.IG-EXP-7.pgeni-gpolab-bbn-com.utah.geniracks.net bottom.IG-EXP-7.pgeni-gpolab-bbn-com.utah.geniracks.net hostB: hostB.IG-EXP-7.pgeni-gpolab-bbn-com.utah.geniracks.net hostB.IG-EXP-7.pgeni-gpolab-bbn-com.utah.geniracks.net Done. }}} On ''bottom'' router: {{{ $ ssh -A -p 32058 -i /home/lnevers/.ssh/id_rsa lnevers@pc1.utah.geniracks.net "/local/click-example/extractClickConfig.py" Your host information: hostA: hostA.IG-EXP-7.pgeni-gpolab-bbn-com.instageni.gpolab.bbn.com hostA.IG-EXP-7.pgeni-gpolab-bbn-com.instageni.gpolab.bbn.com top: top.IG-EXP-7.pgeni-gpolab-bbn-com.instageni.gpolab.bbn.com top.IG-EXP-7.pgeni-gpolab-bbn-com.instageni.gpolab.bbn.com left: left.IG-EXP-7.pgeni-gpolab-bbn-com.instageni.gpolab.bbn.com left.IG-EXP-7.pgeni-gpolab-bbn-com.instageni.gpolab.bbn.com right: right.IG-EXP-7.pgeni-gpolab-bbn-com.utah.geniracks.net right.IG-EXP-7.pgeni-gpolab-bbn-com.utah.geniracks.net bottom: bottom.IG-EXP-7.pgeni-gpolab-bbn-com.utah.geniracks.net bottom.IG-EXP-7.pgeni-gpolab-bbn-com.utah.geniracks.net hostB: hostB.IG-EXP-7.pgeni-gpolab-bbn-com.utah.geniracks.net hostB.IG-EXP-7.pgeni-gpolab-bbn-com.utah.geniracks.net Done. }}} On ''right'' router: {{{ $ ssh -A -p 32060 -i /home/lnevers/.ssh/id_rsa lnevers@pc1.utah.geniracks.net "/local/click-example/extractClickConfig.py" Your host information: hostA: hostA.IG-EXP-7.pgeni-gpolab-bbn-com.instageni.gpolab.bbn.com hostA.IG-EXP-7.pgeni-gpolab-bbn-com.instageni.gpolab.bbn.com top: top.IG-EXP-7.pgeni-gpolab-bbn-com.instageni.gpolab.bbn.com top.IG-EXP-7.pgeni-gpolab-bbn-com.instageni.gpolab.bbn.com left: left.IG-EXP-7.pgeni-gpolab-bbn-com.instageni.gpolab.bbn.com left.IG-EXP-7.pgeni-gpolab-bbn-com.instageni.gpolab.bbn.com right: right.IG-EXP-7.pgeni-gpolab-bbn-com.utah.geniracks.net right.IG-EXP-7.pgeni-gpolab-bbn-com.utah.geniracks.net bottom: bottom.IG-EXP-7.pgeni-gpolab-bbn-com.utah.geniracks.net bottom.IG-EXP-7.pgeni-gpolab-bbn-com.utah.geniracks.net hostB: hostB.IG-EXP-7.pgeni-gpolab-bbn-com.utah.geniracks.net hostB.IG-EXP-7.pgeni-gpolab-bbn-com.utah.geniracks.net Done. }}} The above operations generate an image of the topology. Which can be retrieved from each router: {{{ $ scp -P 32827 pc1.instageni.gpolab.bbn.com:myslice.png . }}} The file generated can be viewed as follows: {{{ eog myslice.png & }}} The image generated for this experimented showed the following: [[Image(myslice2.jpg)]] == 9. Run the user-level Click router == First, checked to make sure that pings are still running between hostA and hostB and using IP. At this point stopped IP on each of the routers: {{{ # top router $ ssh -A -p 30527 pc2.instageni.gpolab.bbn.com "sh stopIP.sh " Disabling IP on interface mv9.12 Disabling IP on interface mv9.16 # left router $ ssh -A -p 30525 pc2.instageni.gpolab.bbn.com "sh stopIP.sh " Disabling IP on interface mv8.13 Disabling IP on interface mv8.17 # right router $ ssh -A -p 30526 pc2.instageni.gpolab.bbn.com "sh stopIP.sh " Disabling IP on interface mv5.96 Disabling IP on interface mv5.91 # bottom router $ ssh -A -p 30522 pc2.instageni.gpolab.bbn.com "sh stopIP.sh " Disabling IP on interface mv7.95 Disabling IP on interface mv7.92 }}} After verifying that pings are failing, started the user-level Click router by providing the print pings configuration file name. Leave terminal connection open: {{{ # top router $ ssh -A -p 30527 pc2.instageni.gpolab.bbn.com "sh ./startClick.sh" Stopping any running Click routers Starting Click router # left router $ ssh -A -p 30525 pc2.instageni.gpolab.bbn.com "sh ./startClick.sh" Stopping any running Click routers Starting Click router # right router $ ssh -A -p 30526 pc2.instageni.gpolab.bbn.com "sh ./startClick.sh" Stopping any running Click routers Starting Click router # bottom router $ ssh -A -p 30522 pc2.instageni.gpolab.bbn.com "sh ./startClick.sh" Stopping any running Click routers Starting Click router }}} == 10. Log in to Host1 and send traffic to host2 == Verified that existing pings, which had stopped when IP was disabled, do resume between hostA and hostB when click router is started. == 11. Review Click logs on each Click router == Each of the click routers generates a /tmp/click.log file. Below is an example from the bottom click router: {{{ $ sh -A -p 32058 -i /home/lnevers/.ssh/id_rsa lnevers@pc1.utah.geniracks.net Last login: Wed Apr 10 09:08:04 2013 from arendia.gpolab.bbn.com [lnevers@bottom ~]$ more /tmp/click.log bottom.click:34: While initializing 'FromDevice@18 :: FromDevice': warning: mv5.96: no IPv4 address assigned bottom.click:35: While initializing 'FromDevice@21 :: FromDevice': warning: mv5.91: no IPv4 address assigned outR: 114 | 02185315 7b2a02fc ee9d640c 7744426f 62576173 48657265 inR: 114 | 02fcee9d 640c0218 53157b2a 7744416c 69636557 61734865 inR: 114 | 02fcee9d 640c0218 53157b2a 7744416c 69636557 61734865 outL: 114 | 02e587e1 267a02fe ecbe360d 7744426f 62576173 48657265 outR: 114 | 02185315 7b2a02fc ee9d640c 7744426f 62576173 48657265 inL: 114 | 02feecbe 360d02e5 87e1267a 7744416c 69636557 61734865 inR: 114 | 02fcee9d 640c0218 53157b2a 7744416c 69636557 61734865 outR: 114 | 02185315 7b2a02fc ee9d640c 7744426f 62576173 48657265 outR: 114 | 02185315 7b2a02fc ee9d640c 7744426f 62576173 48657265 inR: 114 | 02fcee9d 640c0218 53157b2a 7744416c 69636557 61734865 inR: 114 | 02fcee9d 640c0218 53157b2a 7744416c 69636557 61734865 outL: 114 | 02e587e1 267a02fe ecbe360d 7744426f 62576173 48657265 outR: 114 | 02185315 7b2a02fc ee9d640c 7744426f 62576173 48657265 inL: 114 | 02feecbe 360d02e5 87e1267a 7744416c 69636557 61734865 inR: 114 | 02fcee9d 640c0218 53157b2a 7744416c 69636557 61734865 outR: 114 | 02185315 7b2a02fc ee9d640c 7744426f 62576173 48657265 outR: 114 | 02185315 7b2a02fc ee9d640c 7744426f 62576173 48657265 inR: 114 | 02fcee9d 640c0218 53157b2a 7744416c 69636557 61734865 inR: 114 | 02fcee9d 640c0218 53157b2a 7744416c 69636557 61734865 outL: 114 | 02e587e1 267a02fe ecbe360d 7744426f 62576173 48657265 outR: 114 | 02185315 7b2a02fc ee9d640c 7744426f 62576173 48657265 inL: 114 | 02feecbe 360d02e5 87e1267a 7744416c 69636557 61734865 inR: 114 | 02fcee9d 640c0218 53157b2a 7744416c 69636557 61734865 outR: 114 | 02185315 7b2a02fc ee9d640c 7744426f 62576173 48657265 outR: 114 | 02185315 7b2a02fc ee9d640c 7744426f 62576173 48657265 inR: 114 | 02fcee9d 640c0218 53157b2a 7744416c 69636557 61734865 inR: 114 | 02fcee9d 640c0218 53157b2a 7744416c 69636557 61734865 outL: 114 | 02e587e1 267a02fe ecbe360d 7744426f 62576173 48657265 outR: 114 | 02185315 7b2a02fc ee9d640c 7744426f 62576173 48657265 inL: 114 | 02feecbe 360d02e5 87e1267a 7744416c 69636557 61734865 inR: 114 | 02fcee9d 640c0218 53157b2a 7744416c 69636557 61734865 outR: 114 | 02185315 7b2a02fc ee9d640c 7744426f 62576173 48657265 outR: 114 | 02185315 7b2a02fc ee9d640c 7744426f 62576173 48657265 inR: 114 | 02fcee9d 640c0218 53157b2a 7744416c 69636557 61734865 inR: 114 | 02fcee9d 640c0218 53157b2a 7744416c 69636557 61734865 outL: 114 | 02e587e1 267a02fe ecbe360d 7744426f 62576173 48657265 outR: 114 | 02185315 7b2a02fc ee9d640c 7744426f 62576173 48657265 inL: 114 | 02feecbe 360d02e5 87e1267a 7744416c 69636557 61734865 inR: 114 | 02fcee9d 640c0218 53157b2a 7744416c 69636557 61734865 outR: 114 | 02185315 7b2a02fc ee9d640c 7744426f 62576173 48657265 }}} == 12. Delete slivers == Deleted slivers at both aggregates: {{{ $ omni.py deletesliver -a ig-gpo IG-EXP-7 $ omni.py deletesliver -a ig-utah IG-EXP-7 }}}