[[PageOutline]] = Utah Stitching Aggregate Confirmation Tests = This pages capture the detailed test logs for each test defined in the [wiki:GeniNetworkStitchingConfirmationTests New Site Stitching Confirmation Tests] page. For the sites status see the [wiki:GeniNetworkStitchingConfirmationTestStatus New Site Stitching Confirmation Tests Status] page. ''*** Note that the Utah Stitching Aggregate (aka utah-stitch) is part of the network path for all experiments on this page ***'' == IG-ST-1 New Site to GPO IG topology == The Utah Stitch aggregate site advertises the following stitching details: {{{ protogeni chainANDTree false false 2015-06-03T18:48:37Z 2015-06-03T18:48:37Z 1000000 1000000 1000 1 urn:publicid:IDN+utah.geniracks.net+interface+procurve2:1.19 10 1000000 1000000 1000 1 l2sc ethernet 1500 2100-3499 false 1000000 1000000 1000 1 urn:publicid:IDN+emulab.net+interface+procurve1:7.2 10 1000000 1000000 1000 1 l2sc ethernet 1500 2100-3499 false 1000000 1000000 1000 1 urn:publicid:IDN+utahddc.geniracks.net+interface+procurve2:2.22 10 1000000 1000000 1000 1 l2sc ethernet 1500 2100-3499 false 1000000 1000000 1000 1 urn:publicid:IDN+utah.cloudlab.us+interface+bighp1:4.21 10 1000000 1000000 1000 1 l2sc ethernet 1500 2100-3499 false 1000000 1000000 1000 1 urn:publicid:IDN+al2s.internet2.edu+interface+sdn-sw.salt.net.internet2.edu:eth7/1:utah-stitch 10 1000000 1000000 1000 1 l2sc ethernet 1500 2100-3499 false }}} Verified that Utah IG, Utah DDC IG, PG Utah and !CloudLab advertise the same VLAN range: {{{ rspec-emulab-net.xml: 2100-3499 rspec-stitch-geniracks-net.xml: 2100-3499 rspec-stitch-geniracks-net.xml: 2100-3499 rspec-stitch-geniracks-net.xml: 2100-3499 rspec-stitch-geniracks-net.xml: 2100-3499 rspec-stitch-geniracks-net.xml: 2100-3499 rspec-utah-cloudlab-us.xml: 2100-3499 rspec-utah-geniracks-net.xml: 2100-3499 rspec-utahddc-geniracks-net.xml: 2100-3499 }}} Created a slice and a sliver that connected '''Utah DDC IG to UTC IG''': {{{ $ stitcher.py createsliver IG-ST-1 IG-ST-1-al2s.rspec -o 16:12:31 INFO : Configured logging from file /home/lnevers/gcf-2.9/src/gcf/stitcher_logging.conf 16:12:31 INFO : Reading slice IG-ST-1 credential... 16:12:32 INFO : Slice urn:publicid:IDN+ch.geni.net:ln-test+slice+IG-ST-1 expires on 2015-06-10 18:52:04 UTC 16:12:32 INFO : Calling SCS... 16:12:32 INFO : Multi-AM reservation will include resources from these aggregates: 16:12:32 INFO : 16:12:32 INFO : 16:12:32 INFO : 16:12:32 INFO : 16:12:32 INFO : Gathering currently available VLAN tags at ... 16:12:36 INFO : Stitcher doing createsliver at ... 16:12:53 INFO : ... Allocation at complete. 16:12:53 INFO : Stitcher doing createsliver at ... 16:13:11 INFO : ... Allocation at complete. 16:13:11 INFO : Stitcher doing createsliver at ... 16:13:16 INFO : ... Allocation at complete. 16:13:16 INFO : Stitcher doing createsliver at ... 16:13:35 INFO : ... Allocation at complete. 16:13:35 INFO : All aggregates are complete. 16:13:35 INFO : Your resources expire at 2015-06-08T20:02:36 (UTC). 16:13:35 INFO : Saved combined reservation RSpec at 4 AM(s) to file '/home/lnevers/gcf-test/stitch-test/Utah-stitch/IG-ST-1-manifest-rspec-multiam-combined.xml' Success: Reserved resources in slice IG-ST-1 at 4 Aggregates (including 2 intermediate aggregate(s) not in the original request), creating 1 stitched link(s). }}} Determine login for endpoints: {{{ $ readyToLogin --useSliceAggregates IG-ST-1 ... ig-utc's geni_status is: ready User lnevers logs in to ig-utc using: ssh -p 30010 -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@pc1.instageni.utc.edu ... ddc's geni_status is: ready User lnevers logs in to ddc using: ssh -p 33594 -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@pc7.utahddc.geniracks.net }}} Verified ICMP, UDP and TCP connectivity from the Utah DDC IG to UTC IG: {{{ lnevers@ddc:~$ ping -c 5 -q 192.168.1.1 PING 192.168.1.1 (192.168.1.1) 56(84) bytes of data. --- 192.168.1.1 ping statistics --- 5 packets transmitted, 5 received, 0% packet loss, time 4007ms rtt min/avg/max/mdev = 54.467/65.530/108.765/21.618 ms lnevers@ddc:~$ iperf -c 192.168.1.1 -t 20 ------------------------------------------------------------ Client connecting to 192.168.1.1, TCP port 5001 TCP window size: 23.5 KByte (default) ------------------------------------------------------------ [ 3] local 192.168.1.2 port 58644 connected with 192.168.1.1 port 5001 [ ID] Interval Transfer Bandwidth [ 3] 0.0-20.1 sec 47.2 MBytes 19.7 Mbits/sec lnevers@ddc:~$ iperf -c 192.168.1.1 -t 20 -u -b 1M ------------------------------------------------------------ Client connecting to 192.168.1.1, UDP port 5001 Sending 1470 byte datagrams UDP buffer size: 224 KByte (default) ------------------------------------------------------------ [ 3] local 192.168.1.2 port 46988 connected with 192.168.1.1 port 5001 [ ID] Interval Transfer Bandwidth [ 3] 0.0-20.0 sec 2.39 MBytes 1000 Kbits/sec [ 3] Sent 1702 datagrams [ 3] Server Report: [ 3] 0.0-20.0 sec 2.39 MBytes 1.00 Mbits/sec 0.138 ms 0/ 1702 (0%) lnevers@ddc:~$ }}} == IG-ST-2 New Site to GPO IG Loop topology == Create a slice and then create the a sliver that connects two links between '''NPS IG and Utah IG''': {{{ $ stitcher.py createsliver IG-ST-2 IG-ST-2.rspec -o 16:12:35 INFO : Configured logging from file /home/lnevers/gcf-2.9/src/gcf/stitcher_logging.conf 16:12:36 INFO : Reading slice IG-ST-2 credential... 16:12:36 INFO : Slice urn:publicid:IDN+ch.geni.net:ln-test+slice+IG-ST-2 expires on 2015-06-10 19:05:18 UTC 16:12:36 INFO : Calling SCS... 16:12:37 INFO : Multi-AM reservation will include resources from these aggregates: 16:12:37 INFO : 16:12:37 INFO : 16:12:37 INFO : 16:12:37 INFO : 16:12:37 INFO : Gathering currently available VLAN tags at ... 16:12:40 INFO : Stitcher doing createsliver at ... 16:13:00 INFO : ... Allocation at complete. 16:13:00 INFO : Stitcher doing createsliver at ... 16:13:20 INFO : ... Allocation at complete. 16:13:20 INFO : Stitcher doing createsliver at ... 16:13:22 ERROR : {'output': 'Exception: requested VLAN unavailable: sdn-sw.salt.net.internet2.edu,eth7/1 VLAN=3497', 'code': {'geni_code': 24}} 16:13:22 INFO : Deleting some reservations to retry, avoiding failed VLAN... 16:13:22 INFO : Doing deletesliver at ... 16:13:47 INFO : Will put back in the pool to allocate. Got: Retrying reservations at earlier AMs to avoid unavailable VLAN tag at .... 16:13:47 INFO : Pausing for 30 seconds for Aggregates to free up resources... 16:14:17 INFO : Checking that prior reservation at has been cleared up.... 16:14:19 ERROR : {'output': 'No slice or aggregate here', 'code': {'protogeni_error_log': 'urn:publicid:IDN+stitch.geniracks.net+log+7ffe2c0afc29a12114a26e281fbcb059', 'am_type': 'protogeni', 'geni_code': 12, 'am_code': 12, 'protogeni_error_url': 'https://www.stitch.geniracks.net/spewlogfile.php3?logfile=7ffe2c0afc29a12114a26e281fbcb059'}, 'value': 0} 16:14:19 INFO : ... it is, so can try a new reservation. 16:14:19 INFO : Stitcher doing createsliver at ... 16:14:39 INFO : ... Allocation at complete. 16:14:39 INFO : Stitcher doing createsliver at ... 16:14:53 INFO : ... Allocation at complete. 16:14:53 INFO : Stitcher doing createsliver at ... 16:15:08 INFO : ... Allocation at complete. 16:15:08 INFO : All aggregates are complete. 16:15:08 INFO : Your resources expire at 2015-06-08T20:02:40 (UTC). 16:15:08 INFO : Saved combined reservation RSpec at 4 AM(s) to file '/home/lnevers/gcf-test/stitch-test/Utah-stitch/IG-ST-2-manifest-rspec-multiam-combined.xml' Success: Reserved resources in slice IG-ST-2 at 4 Aggregates (including 2 intermediate aggregate(s) not in the original request), creating 2 stitched link(s). }}} Determined login information at each aggregate: {{{ $ readyToLogin.py IG-ST-2 --useSliceAggregates .... ig-nps's geni_status is: ready User lnevers logs in to ig-nps using: ssh -p 31802 -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@pc3.instageni.nps.edu ig-utah's geni_status is: ready User lnevers logs in to ig-utah using: ssh -p 30010 -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@pc3.utah.geniracks.net }}} From NPS host ping the remote on each of the two interfaces. Below is the ping output for the GPO site: {{{ remote-execute.py IG-ST-2 -a nps-ig -m "ping 10.10.4.2 -c 60 -q ;ping 192.168.4.2 -c 60 -q" }}} == IG-ST-3 IG-ST-3 New Site 3 node linear topology == Create a slice and then create slivers for the topology ''' Utah PC<->Utah DDC IG<-> Utah IG''': {{{ $ stitcher.py createsliver IG-ST-3 IG-ST-3.rspec -o 16:15:04 INFO : Configured logging from file /home/lnevers/gcf-2.9/src/gcf/stitcher_logging.conf 16:15:05 INFO : Reading slice IG-ST-3 credential... 16:15:05 INFO : Slice urn:publicid:IDN+ch.geni.net:ln-test+slice+IG-ST-3 expires on 2015-06-10 19:23:31 UTC 16:15:05 INFO : Calling SCS... 16:15:06 INFO : Multi-AM reservation will include resources from these aggregates: 16:15:06 INFO : 16:15:06 INFO : 16:15:06 INFO : 16:15:06 INFO : 16:15:06 INFO : Gathering currently available VLAN tags at ... 16:15:27 INFO : Gathering currently available VLAN tags at ... 16:15:32 INFO : Gathering currently available VLAN tags at ... 16:15:34 INFO : Stitcher doing createsliver at ... 16:15:56 INFO : ... Allocation at complete. 16:15:56 INFO : Stitcher doing createsliver at ... 16:16:31 INFO : ... Allocation at complete. 16:16:31 INFO : Stitcher doing createsliver at ... 16:16:54 INFO : ... Allocation at complete. 16:16:54 INFO : Stitcher doing createsliver at ... 16:17:09 INFO : ... Allocation at complete. 16:17:09 INFO : All aggregates are complete. 16:17:09 INFO : Your resources expire at 2015-06-08T20:05:34 (UTC). 16:17:09 INFO : Saved combined reservation RSpec at 4 AM(s) to file '/home/lnevers/gcf-test/stitch-test/Utah-stitch/IG-ST-3-manifest-rspec-multiam-combined.xml' Success: Reserved resources in slice IG-ST-3 at 4 Aggregates (including 1 intermediate aggregate(s) not in the original request), creating 2 stitched link(s). }}} Determined login information the each aggregate: {{{ $ readyToLogin.py IG-ST-3 --useSliceAggregates .... }}} Login to the Utah DDC IG host and pinged each remote: {{{ #ping GPO IG ping 192.168.2.1 -c 60 -q # Utah IG ping 192.168.4.1 -c 60 -q }}} == IG-ST-4 New Site to GPO EG interoperability == Create a slice and then sliver to connect '''EG GPO to Utah IG''' {{{ $ stitcher.py createsliver IG-ST-4 IG-ST-4.rspec -o 15:34:07 INFO : Configured logging from file /home/lnevers/gcf-2.9/src/gcf/stitcher_logging.conf 15:34:08 INFO : Reading slice IG-ST-4 credential... 15:34:08 INFO : Slice urn:publicid:IDN+ch.geni.net:ln-test+slice+IG-ST-4 expires on 2015-06-10 19:34:03 UTC 15:34:08 INFO : Calling SCS... 15:34:09 INFO : Multi-AM reservation will include resources from these aggregates: 15:34:09 INFO : 15:34:09 INFO : 15:34:09 INFO : 15:34:09 INFO : 15:34:09 INFO : Gathering currently available VLAN tags at ... 15:34:12 INFO : Stitcher doing createsliver at ... 15:34:32 INFO : ... Allocation at complete. 15:34:32 INFO : Stitcher doing createsliver at ... 15:34:42 INFO : ... Allocation at complete. 15:34:42 INFO : Stitcher doing createsliver at ... 15:34:44 ERROR : {'output': 'Exception: requested VLAN unavailable: sdn-sw.salt.net.internet2.edu,eth7/1 VLAN=2754', 'code': {'geni_code': 24}} 15:34:44 INFO : Deleting some reservations to retry, avoiding failed VLAN... 15:34:44 INFO : Doing deletesliver at ... 15:35:09 INFO : Will put back in the pool to allocate. Got: Retrying reservations at earlier AMs to avoid unavailable VLAN tag at .... 15:35:09 INFO : Pausing for 30 seconds for Aggregates to free up resources... 15:35:39 INFO : Checking that prior reservation at has been cleared up.... 15:35:41 ERROR : {'output': 'No slice or aggregate here', 'code': {'protogeni_error_log': 'urn:publicid:IDN+stitch.geniracks.net+log+9877b4a4ae8e49358df28c56b8ec89ef', 'am_type': 'protogeni', 'geni_code': 12, 'am_code': 12, 'protogeni_error_url': 'https://www.stitch.geniracks.net/spewlogfile.php3?logfile=9877b4a4ae8e49358df28c56b8ec89ef'}, 'value': 0} 15:35:41 INFO : ... it is, so can try a new reservation. 15:35:41 INFO : Stitcher doing createsliver at ... 15:36:01 INFO : ... Allocation at complete. 15:36:01 INFO : Stitcher doing createsliver at ... 15:36:05 INFO : ... Allocation at complete. 15:36:05 INFO : Stitcher doing createsliver at ... 15:36:20 INFO : ... Allocation at complete. 15:36:20 INFO : All aggregates are complete. 15:36:20 INFO : Your resources expire at 2015-06-08T19:24:12 (UTC). 15:36:20 INFO : Saved combined reservation RSpec at 4 AM(s) to file '/home/lnevers/gcf-test/stitch-test/Utah-stitch/IG-ST-4-manifest-rspec-multiam-combined.xml' Success: Reserved resources in slice IG-ST-4 at 4 Aggregates (including 2 intermediate aggregate(s) not in the original request), creating 1 stitched link(s). }}} Determined login information at each VirginiaTech and GPO aggregate: {{{ $ readyToLogin.py IG-ST-4 --useSliceAggregates .... eg-gpo's geni_status is: ready User lnevers logs in to eg-gpo using: ssh -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@192.1.242.31 ... ig-utah's geni_status is: ready User lnevers logs in to ig-utah using: ssh -p 31290 -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@pc3.utah.geniracks.net }}} Verify the sites can exchange ICMP, TCP and UDP traffic: {{{ lnevers@eg-gpo:~$ ping 192.168.1.2 -c 5 -q PING 192.168.1.2 (192.168.1.2) 56(84) bytes of data. --- 192.168.1.2 ping statistics --- 5 packets transmitted, 5 received, 0% packet loss, time 4007ms rtt min/avg/max/mdev = 59.579/59.779/59.891/0.194 ms lnevers@eg-gpo:~$ lnevers@eg-gpo:~$ iperf -c 192.168.1.2 -t 20 ------------------------------------------------------------ Client connecting to 192.168.1.2, TCP port 5001 TCP window size: 85.0 KByte (default) ------------------------------------------------------------ [ 3] local 192.168.1.1 port 36274 connected with 192.168.1.2 port 5001 [ ID] Interval Transfer Bandwidth [ 3] 0.0-20.0 sec 46.9 MBytes 19.7 Mbits/sec lnevers@eg-gpo:~$ iperf -c 192.168.1.2 -t 20 -u -b 1M ------------------------------------------------------------ Client connecting to 192.168.1.2, UDP port 5001 Sending 1470 byte datagrams UDP buffer size: 208 KByte (default) ------------------------------------------------------------ [ 3] local 192.168.1.1 port 59077 connected with 192.168.1.2 port 5001 [ ID] Interval Transfer Bandwidth [ 3] 0.0-20.0 sec 2.39 MBytes 1000 Kbits/sec [ 3] Sent 1702 datagrams [ 3] Server Report: [ 3] 0.0-20.0 sec 2.39 MBytes 1.00 Mbits/sec 0.132 ms 0/ 1702 (0%) lnevers@eg-gpo:~$ }}}