[[PageOutline]]
= Utah Stitching Aggregate Confirmation Tests =
This pages capture the detailed test logs for each test defined in the [wiki:GeniNetworkStitchingConfirmationTests New Site Stitching Confirmation Tests] page. For the sites status see the [wiki:GeniNetworkStitchingConfirmationTestStatus New Site Stitching Confirmation Tests Status] page.
''*** Note that the Utah Stitching Aggregate (aka utah-stitch) is part of the network path for all experiments on this page ***''
== IG-ST-1 New Site to GPO IG topology ==
The Utah Stitch aggregate site advertises the following stitching details:
{{{
protogenichainANDTreefalsefalse2015-06-03T18:48:37Z2015-06-03T18:48:37Z1000000100000010001urn:publicid:IDN+utah.geniracks.net+interface+procurve2:1.19101000000100000010001l2scethernet15002100-3499false1000000100000010001urn:publicid:IDN+emulab.net+interface+procurve1:7.2101000000100000010001l2scethernet15002100-3499false1000000100000010001urn:publicid:IDN+utahddc.geniracks.net+interface+procurve2:2.22101000000100000010001l2scethernet15002100-3499false1000000100000010001urn:publicid:IDN+utah.cloudlab.us+interface+bighp1:4.21101000000100000010001l2scethernet15002100-3499false1000000100000010001urn:publicid:IDN+al2s.internet2.edu+interface+sdn-sw.salt.net.internet2.edu:eth7/1:utah-stitch101000000100000010001l2scethernet15002100-3499false
}}}
Verified that Utah IG, Utah DDC IG, PG Utah and !CloudLab advertise the same VLAN range:
{{{
rspec-emulab-net.xml: 2100-3499
rspec-stitch-geniracks-net.xml: 2100-3499
rspec-stitch-geniracks-net.xml: 2100-3499
rspec-stitch-geniracks-net.xml: 2100-3499
rspec-stitch-geniracks-net.xml: 2100-3499
rspec-stitch-geniracks-net.xml: 2100-3499
rspec-utah-cloudlab-us.xml: 2100-3499
rspec-utah-geniracks-net.xml: 2100-3499
rspec-utahddc-geniracks-net.xml: 2100-3499
}}}
Created a slice and a sliver that connected '''Utah DDC IG to UTC IG''':
{{{
$ stitcher.py createsliver IG-ST-1 IG-ST-1-al2s.rspec -o
16:12:31 INFO : Configured logging from file /home/lnevers/gcf-2.9/src/gcf/stitcher_logging.conf
16:12:31 INFO : Reading slice IG-ST-1 credential...
16:12:32 INFO : Slice urn:publicid:IDN+ch.geni.net:ln-test+slice+IG-ST-1 expires on 2015-06-10 18:52:04 UTC
16:12:32 INFO : Calling SCS...
16:12:32 INFO : Multi-AM reservation will include resources from these aggregates:
16:12:32 INFO :
16:12:32 INFO :
16:12:32 INFO :
16:12:32 INFO :
16:12:32 INFO : Gathering currently available VLAN tags at ...
16:12:36 INFO : Stitcher doing createsliver at ...
16:12:53 INFO : ... Allocation at complete.
16:12:53 INFO : Stitcher doing createsliver at ...
16:13:11 INFO : ... Allocation at complete.
16:13:11 INFO : Stitcher doing createsliver at ...
16:13:16 INFO : ... Allocation at complete.
16:13:16 INFO : Stitcher doing createsliver at ...
16:13:35 INFO : ... Allocation at complete.
16:13:35 INFO : All aggregates are complete.
16:13:35 INFO : Your resources expire at 2015-06-08T20:02:36 (UTC).
16:13:35 INFO : Saved combined reservation RSpec at 4 AM(s) to file '/home/lnevers/gcf-test/stitch-test/Utah-stitch/IG-ST-1-manifest-rspec-multiam-combined.xml'
Success: Reserved resources in slice IG-ST-1 at 4 Aggregates (including 2 intermediate aggregate(s) not in the original request), creating 1 stitched link(s).
}}}
Determine login for endpoints:
{{{
$ readyToLogin --useSliceAggregates IG-ST-1
...
ig-utc's geni_status is: ready
User lnevers logs in to ig-utc using:
ssh -p 30010 -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@pc1.instageni.utc.edu
...
ddc's geni_status is: ready
User lnevers logs in to ddc using:
ssh -p 33594 -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@pc7.utahddc.geniracks.net
}}}
Verified ICMP, UDP and TCP connectivity from the Utah DDC IG to UTC IG:
{{{
lnevers@ddc:~$ ping -c 5 -q 192.168.1.1
PING 192.168.1.1 (192.168.1.1) 56(84) bytes of data.
--- 192.168.1.1 ping statistics ---
5 packets transmitted, 5 received, 0% packet loss, time 4007ms
rtt min/avg/max/mdev = 54.467/65.530/108.765/21.618 ms
lnevers@ddc:~$ iperf -c 192.168.1.1 -t 20
------------------------------------------------------------
Client connecting to 192.168.1.1, TCP port 5001
TCP window size: 23.5 KByte (default)
------------------------------------------------------------
[ 3] local 192.168.1.2 port 58644 connected with 192.168.1.1 port 5001
[ ID] Interval Transfer Bandwidth
[ 3] 0.0-20.1 sec 47.2 MBytes 19.7 Mbits/sec
lnevers@ddc:~$ iperf -c 192.168.1.1 -t 20 -u -b 1M
------------------------------------------------------------
Client connecting to 192.168.1.1, UDP port 5001
Sending 1470 byte datagrams
UDP buffer size: 224 KByte (default)
------------------------------------------------------------
[ 3] local 192.168.1.2 port 46988 connected with 192.168.1.1 port 5001
[ ID] Interval Transfer Bandwidth
[ 3] 0.0-20.0 sec 2.39 MBytes 1000 Kbits/sec
[ 3] Sent 1702 datagrams
[ 3] Server Report:
[ 3] 0.0-20.0 sec 2.39 MBytes 1.00 Mbits/sec 0.138 ms 0/ 1702 (0%)
lnevers@ddc:~$
}}}
== IG-ST-2 New Site to GPO IG Loop topology ==
Create a slice and then create the a sliver that connects two links between '''NPS IG and Utah IG''':
{{{
$ stitcher.py createsliver IG-ST-2 IG-ST-2.rspec -o
16:12:35 INFO : Configured logging from file /home/lnevers/gcf-2.9/src/gcf/stitcher_logging.conf
16:12:36 INFO : Reading slice IG-ST-2 credential...
16:12:36 INFO : Slice urn:publicid:IDN+ch.geni.net:ln-test+slice+IG-ST-2 expires on 2015-06-10 19:05:18 UTC
16:12:36 INFO : Calling SCS...
16:12:37 INFO : Multi-AM reservation will include resources from these aggregates:
16:12:37 INFO :
16:12:37 INFO :
16:12:37 INFO :
16:12:37 INFO :
16:12:37 INFO : Gathering currently available VLAN tags at ...
16:12:40 INFO : Stitcher doing createsliver at ...
16:13:00 INFO : ... Allocation at complete.
16:13:00 INFO : Stitcher doing createsliver at ...
16:13:20 INFO : ... Allocation at complete.
16:13:20 INFO : Stitcher doing createsliver at ...
16:13:22 ERROR : {'output': 'Exception: requested VLAN unavailable: sdn-sw.salt.net.internet2.edu,eth7/1 VLAN=3497', 'code': {'geni_code': 24}}
16:13:22 INFO : Deleting some reservations to retry, avoiding failed VLAN...
16:13:22 INFO : Doing deletesliver at ...
16:13:47 INFO : Will put back in the pool to allocate. Got: Retrying reservations at earlier AMs to avoid unavailable VLAN tag at ....
16:13:47 INFO : Pausing for 30 seconds for Aggregates to free up resources...
16:14:17 INFO : Checking that prior reservation at has been cleared up....
16:14:19 ERROR : {'output': 'No slice or aggregate here', 'code': {'protogeni_error_log': 'urn:publicid:IDN+stitch.geniracks.net+log+7ffe2c0afc29a12114a26e281fbcb059', 'am_type': 'protogeni', 'geni_code': 12, 'am_code': 12, 'protogeni_error_url': 'https://www.stitch.geniracks.net/spewlogfile.php3?logfile=7ffe2c0afc29a12114a26e281fbcb059'}, 'value': 0}
16:14:19 INFO : ... it is, so can try a new reservation.
16:14:19 INFO : Stitcher doing createsliver at ...
16:14:39 INFO : ... Allocation at complete.
16:14:39 INFO : Stitcher doing createsliver at ...
16:14:53 INFO : ... Allocation at complete.
16:14:53 INFO : Stitcher doing createsliver at ...
16:15:08 INFO : ... Allocation at complete.
16:15:08 INFO : All aggregates are complete.
16:15:08 INFO : Your resources expire at 2015-06-08T20:02:40 (UTC).
16:15:08 INFO : Saved combined reservation RSpec at 4 AM(s) to file '/home/lnevers/gcf-test/stitch-test/Utah-stitch/IG-ST-2-manifest-rspec-multiam-combined.xml'
Success: Reserved resources in slice IG-ST-2 at 4 Aggregates (including 2 intermediate aggregate(s) not in the original request), creating 2 stitched link(s).
}}}
Determined login information at each aggregate:
{{{
$ readyToLogin.py IG-ST-2 --useSliceAggregates
....
ig-nps's geni_status is: ready
User lnevers logs in to ig-nps using:
ssh -p 31802 -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@pc3.instageni.nps.edu
ig-utah's geni_status is: ready
User lnevers logs in to ig-utah using:
ssh -p 30010 -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@pc3.utah.geniracks.net
}}}
From NPS host ping the remote on each of the two interfaces. Below is the ping output for the GPO site:
{{{
$ remote-execute.py IG-ST-2 -a nps-ig -m "ping 10.10.4.2 -c 60 -q ;ping 192.168.4.2 -c 60 -q"
1. Find login Info for hosts in slice IG-ST-2
Key file [/home/lnevers/.ssh/lnevers-id_rsa] does NOT exist.
2. Send command 'ping 10.10.4.2 -c 60 -q ;ping 192.168.4.2 -c 60 -q' to ig-nps
PING 10.10.4.2 (10.10.4.2) 56(84) bytes of data.
--- 10.10.4.2 ping statistics ---
60 packets transmitted, 60 received, 0% packet loss, time 59099ms
rtt min/avg/max/mdev = 21.530/22.291/44.761/3.030 ms
PING 192.168.4.2 (192.168.4.2) 56(84) bytes of data.
--- 192.168.4.2 ping statistics ---
60 packets transmitted, 60 received, 0% packet loss, time 59103ms
rtt min/avg/max/mdev = 21.435/22.187/45.988/3.109 ms
... Done with command 'ping 10.10.4.2 -c 60 -q ;ping 192.168.4.2 -c 60 -q' at ig-nps
$
}}}
== IG-ST-3 IG-ST-3 New Site 3 node linear topology ==
Create a slice and then create slivers for the topology ''' Utah PG<->Utah DDC IG<-> Utah IG''':
{{{
$ stitcher.py createsliver IG-ST-3 IG-ST-3.rspec -o
16:15:04 INFO : Configured logging from file /home/lnevers/gcf-2.9/src/gcf/stitcher_logging.conf
16:15:05 INFO : Reading slice IG-ST-3 credential...
16:15:05 INFO : Slice urn:publicid:IDN+ch.geni.net:ln-test+slice+IG-ST-3 expires on 2015-06-10 19:23:31 UTC
16:15:05 INFO : Calling SCS...
16:15:06 INFO : Multi-AM reservation will include resources from these aggregates:
16:15:06 INFO :
16:15:06 INFO :
16:15:06 INFO :
16:15:06 INFO :
16:15:06 INFO : Gathering currently available VLAN tags at ...
16:15:27 INFO : Gathering currently available VLAN tags at ...
16:15:32 INFO : Gathering currently available VLAN tags at ...
16:15:34 INFO : Stitcher doing createsliver at ...
16:15:56 INFO : ... Allocation at complete.
16:15:56 INFO : Stitcher doing createsliver at ...
16:16:31 INFO : ... Allocation at complete.
16:16:31 INFO : Stitcher doing createsliver at ...
16:16:54 INFO : ... Allocation at complete.
16:16:54 INFO : Stitcher doing createsliver at ...
16:17:09 INFO : ... Allocation at complete.
16:17:09 INFO : All aggregates are complete.
16:17:09 INFO : Your resources expire at 2015-06-08T20:05:34 (UTC).
16:17:09 INFO : Saved combined reservation RSpec at 4 AM(s) to file '/home/lnevers/gcf-test/stitch-test/Utah-stitch/IG-ST-3-manifest-rspec-multiam-combined.xml'
Success: Reserved resources in slice IG-ST-3 at 4 Aggregates (including 1 intermediate aggregate(s) not in the original request), creating 2 stitched link(s).
}}}
Determined login information the each aggregate:
{{{
$ readyToLogin.py IG-ST-3 --useSliceAggregates
....
ddc's geni_status is: ready
User lnevers logs in to ddc using:
ssh -p 33850 -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@pc4.utahddc.geniracks.net
...
ig-utah's geni_status is: ready
User lnevers logs in to ig-utah using:
ssh -p 30522 -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@pc3.utah.geniracks.net
...
pg-utah's geni_status is: ready
User lnevers logs in to pg-utah using:
ssh -p 30778 -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@pc430.emulab.net
}}}
Login to the Utah DDC IG host and pinged each remote:
{{{
#ping Utah PG
lnevers@ddc:~$ ping 192.168.2.1 -c 20 -q
PING 192.168.2.1 (192.168.2.1) 56(84) bytes of data.
--- 192.168.2.1 ping statistics ---
20 packets transmitted, 20 received, 0% packet loss, time 19023ms
rtt min/avg/max/mdev = 0.899/1.191/2.267/0.259 ms
# Utah IG
lnevers@ddc:~$ ping 192.168.4.1 -c 20 -q
PING 192.168.4.1 (192.168.4.1) 56(84) bytes of data.
--- 192.168.4.1 ping statistics ---
20 packets transmitted, 20 received, 0% packet loss, time 19025ms
rtt min/avg/max/mdev = 0.982/1.108/1.847/0.175 ms
lnevers@ddc:~$
}}}
== IG-ST-4 New Site to GPO EG interoperability ==
Create a slice and then sliver to connect '''EG GPO to Utah IG'''
{{{
$ stitcher.py createsliver IG-ST-4 IG-ST-4.rspec -o
15:34:07 INFO : Configured logging from file /home/lnevers/gcf-2.9/src/gcf/stitcher_logging.conf
15:34:08 INFO : Reading slice IG-ST-4 credential...
15:34:08 INFO : Slice urn:publicid:IDN+ch.geni.net:ln-test+slice+IG-ST-4 expires on 2015-06-10 19:34:03 UTC
15:34:08 INFO : Calling SCS...
15:34:09 INFO : Multi-AM reservation will include resources from these aggregates:
15:34:09 INFO :
15:34:09 INFO :
15:34:09 INFO :
15:34:09 INFO :
15:34:09 INFO : Gathering currently available VLAN tags at ...
15:34:12 INFO : Stitcher doing createsliver at ...
15:34:32 INFO : ... Allocation at complete.
15:34:32 INFO : Stitcher doing createsliver at ...
15:34:42 INFO : ... Allocation at complete.
15:34:42 INFO : Stitcher doing createsliver at ...
15:34:44 ERROR : {'output': 'Exception: requested VLAN unavailable: sdn-sw.salt.net.internet2.edu,eth7/1 VLAN=2754', 'code': {'geni_code': 24}}
15:34:44 INFO : Deleting some reservations to retry, avoiding failed VLAN...
15:34:44 INFO : Doing deletesliver at ...
15:35:09 INFO : Will put back in the pool to allocate. Got: Retrying reservations at earlier AMs to avoid unavailable VLAN tag at ....
15:35:09 INFO : Pausing for 30 seconds for Aggregates to free up resources...
15:35:39 INFO : Checking that prior reservation at has been cleared up....
15:35:41 ERROR : {'output': 'No slice or aggregate here', 'code': {'protogeni_error_log': 'urn:publicid:IDN+stitch.geniracks.net+log+9877b4a4ae8e49358df28c56b8ec89ef', 'am_type': 'protogeni', 'geni_code': 12, 'am_code': 12, 'protogeni_error_url': 'https://www.stitch.geniracks.net/spewlogfile.php3?logfile=9877b4a4ae8e49358df28c56b8ec89ef'}, 'value': 0}
15:35:41 INFO : ... it is, so can try a new reservation.
15:35:41 INFO : Stitcher doing createsliver at ...
15:36:01 INFO : ... Allocation at complete.
15:36:01 INFO : Stitcher doing createsliver at ...
15:36:05 INFO : ... Allocation at complete.
15:36:05 INFO : Stitcher doing createsliver at ...
15:36:20 INFO : ... Allocation at complete.
15:36:20 INFO : All aggregates are complete.
15:36:20 INFO : Your resources expire at 2015-06-08T19:24:12 (UTC).
15:36:20 INFO : Saved combined reservation RSpec at 4 AM(s) to file '/home/lnevers/gcf-test/stitch-test/Utah-stitch/IG-ST-4-manifest-rspec-multiam-combined.xml'
Success: Reserved resources in slice IG-ST-4 at 4 Aggregates (including 2 intermediate aggregate(s) not in the original request), creating 1 stitched link(s).
}}}
Determined login information at each VirginiaTech and GPO aggregate:
{{{
$ readyToLogin.py IG-ST-4 --useSliceAggregates
....
eg-gpo's geni_status is: ready
User lnevers logs in to eg-gpo using:
ssh -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@192.1.242.31
...
ig-utah's geni_status is: ready
User lnevers logs in to ig-utah using:
ssh -p 31290 -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@pc3.utah.geniracks.net
}}}
Verify the sites can exchange ICMP, TCP and UDP traffic:
{{{
lnevers@eg-gpo:~$ ping 192.168.1.2 -c 5 -q
PING 192.168.1.2 (192.168.1.2) 56(84) bytes of data.
--- 192.168.1.2 ping statistics ---
5 packets transmitted, 5 received, 0% packet loss, time 4007ms
rtt min/avg/max/mdev = 59.579/59.779/59.891/0.194 ms
lnevers@eg-gpo:~$
lnevers@eg-gpo:~$ iperf -c 192.168.1.2 -t 20
------------------------------------------------------------
Client connecting to 192.168.1.2, TCP port 5001
TCP window size: 85.0 KByte (default)
------------------------------------------------------------
[ 3] local 192.168.1.1 port 36274 connected with 192.168.1.2 port 5001
[ ID] Interval Transfer Bandwidth
[ 3] 0.0-20.0 sec 46.9 MBytes 19.7 Mbits/sec
lnevers@eg-gpo:~$ iperf -c 192.168.1.2 -t 20 -u -b 1M
------------------------------------------------------------
Client connecting to 192.168.1.2, UDP port 5001
Sending 1470 byte datagrams
UDP buffer size: 208 KByte (default)
------------------------------------------------------------
[ 3] local 192.168.1.1 port 59077 connected with 192.168.1.2 port 5001
[ ID] Interval Transfer Bandwidth
[ 3] 0.0-20.0 sec 2.39 MBytes 1000 Kbits/sec
[ 3] Sent 1702 datagrams
[ 3] Server Report:
[ 3] 0.0-20.0 sec 2.39 MBytes 1.00 Mbits/sec 0.132 ms 0/ 1702 (0%)
lnevers@eg-gpo:~$
}}}
== IG-ST-5 Site Information ==
Various pages include stitching information for a site. Each of the following were verified for this site:
1. Verified that stitching VLANs and Device URN information exists in the [http://groups.geni.net/geni/wiki/GeniAggregate/UtahStitch#GENINetworkStitching Utah Stitching Aggregate] page.
2. Verified that Delegated GENI Stitching VLANs for site are documented at the [https://wiki.maxgigapop.net/twiki/bin/view/GENI/StaticNetworksView Delegated GENI Stitching VLANs].