[[PageOutline]] = George Washington University Stitching Confirmation Tests = This pages capture the detailed test logs for each test defined in the [wiki:GeniNetworkStitchingConfirmationTests New Site Stitching Confirmation Tests] page. For the sites status see the [wiki:GeniNetworkStitchingConfirmationTestStatus New Site Stitching Confirmation Tests Status] page. == EG-ST-1 New Site to GPO IG topology == The GWU site advertises the following stitching details for the connection to AL2S. {{{ orca tree true false 1000000kbps 1000000kbps urn:publicid:IDN+al2s.internet2.edu+interface+rtsw.wash.net.internet2.edu:et-4/3/0.0:gwu-eg 10 1000000kbps 1000000kbps l2sc ethernet consumer 720-734 false }}} Experimenter may not need any of this data, but it is helpful to reference when trying to determine how many VLANs are delegated for stitching at the site or how much bandwidth can be requested. Create a slice and then create the stitched slivers with the RSpec [http://groups.geni.net/geni/browser/trunk/stitch-examples/GWU/EG-ST-1.rspec EG-ST-1.rspec]: {{{ $ stitcher createsliver EG-ST-1 ./EG-ST-1.rspec --scsURL https://nutshell.maxgigapop.net:8443/geni/xmlrpc 09:23:33 INFO : Configured logging from file /home/lnevers/geni-tools-2.10/src/gcf/stitcher_logging.conf 09:23:33 INFO : Reading slice EG-ST-1 credential... 09:23:33 INFO : Slice urn:publicid:IDN+ch.geni.net:ln-test+slice+EG-ST-1 expires on 2017-04-07 12:42:50 UTC 09:23:33 INFO : Using SCS at https://nutshell.maxgigapop.net:8443/geni/xmlrpc 09:23:33 INFO : Calling SCS... 09:23:34 INFO : Multi-AM reservation will include resources from these aggregates: 09:23:34 INFO : 09:23:34 INFO : 09:23:34 INFO : 09:23:34 INFO : Stitcher doing createsliver at ... 09:23:41 INFO : ... Allocation at complete. 09:23:41 INFO : Stitcher doing createsliver at ... 09:23:58 INFO : ... Allocation at complete. 09:23:58 INFO : Stitcher doing createsliver at ... 09:24:05 INFO : ... Allocation at complete. 09:24:05 INFO : All aggregates are complete. 09:24:05 INFO : Your resources expire at 2017-04-06T13:13:34 (UTC). 09:24:05 INFO : Saved combined reservation RSpec at 3 AM(s) to file '/home/lnevers/gcf-test/stitch-test/GWU/EG-ST-1-manifest-rspec-multiam-combined.xml' Success: Reserved resources in slice EG-ST-1 at 3 Aggregates (including 1 intermediate aggregate(s) not in the original request), creating 1 stitched link(s). }}} Determined login information at each GWU EG and GPO IG aggregate: {{{ $ readyToLogin.py EG-ST-1 --useSliceAggregates .... ig-gpo's geni_status is: changing User lnevers logs in to ig-gpo using: ssh -p 31546 -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@pc5.instageni.gpolab.bbn.com eg-gwu's geni_status is: ready User lnevers logs in to eg-gwu using: ssh -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@162.250.136.38 }}} === Measurements === '''Iperf InstaGENI GPO VM to ExoGENI GWU VM (TCP) - TCP window size: 85.0 KByte (default)''' ''Collected: 2017-04-03'' __One Client__ {{{ [ ID] Interval Transfer Bandwidth [ 3] 0.0-60.1 sec 707 MBytes 98.8 Mbits/sec }}} __Five Clients__ {{{ [ ID] Interval Transfer Bandwidth [ 3] 0.0-60.0 sec 144 MBytes 20.1 Mbits/sec [ 5] 0.0-60.1 sec 134 MBytes 18.7 Mbits/sec [ 6] 0.0-60.1 sec 133 MBytes 18.6 Mbits/sec [ 4] 0.0-60.1 sec 142 MBytes 19.8 Mbits/sec [ 7] 0.0-60.1 sec 140 MBytes 19.6 Mbits/sec [SUM] 0.0-60.1 sec 692 MBytes 96.6 Mbits/sec }}} __Ten Clients__ {{{ [ ID] Interval Transfer Bandwidth [ 11] 0.0-60.1 sec 72.0 MBytes 10.1 Mbits/sec [ 4] 0.0-60.1 sec 69.8 MBytes 9.74 Mbits/sec [ 12] 0.0-60.1 sec 67.8 MBytes 9.46 Mbits/sec [ 6] 0.0-60.1 sec 66.8 MBytes 9.31 Mbits/sec [ 3] 0.0-60.1 sec 68.1 MBytes 9.50 Mbits/sec [ 7] 0.0-60.2 sec 67.1 MBytes 9.36 Mbits/sec [ 5] 0.0-60.2 sec 71.4 MBytes 9.95 Mbits/sec [ 10] 0.0-60.2 sec 69.2 MBytes 9.65 Mbits/sec [ 9] 0.0-60.2 sec 71.8 MBytes 9.99 Mbits/sec [ 8] 0.0-60.3 sec 72.9 MBytes 10.1 Mbits/sec [SUM] 0.0-60.3 sec 697 MBytes 96.9 Mbits/sec }}} '''Iperf InstaGENI GPO VM to ExoGENI GWU VM (UDP) - UDP buffer size: 208 KByte (default) ''' {{{ [ 3] Server Report: [ 3] 0.0-60.0 sec 687 MBytes 96.1 Mbits/sec 0.115 ms 22541/512795 (4.4%) [ 3] 0.0-60.0 sec 1 datagrams received out-of-order }}} '''Ping from InstaGENI GPO VM to the ExoGENI GWU VM ''' {{{ 60 packets transmitted, 60 received, 0% packet loss, time 59090ms rtt min/avg/max/mdev = 11.140/11.342/12.442/0.252 ms }}} '''Iperf ExoGENI GWU VM to GPO InstaGENI VM (TCP) - TCP window size: 85.0 KByte (default)''' ''Collected: 2017-04-03'' __One Client_ {{{ [ ID] Interval Transfer Bandwidth [ 3] 0.0-60.0 sec 697 MBytes 97.4 Mbits/sec }}} __Five Clients__ {{{ [ ID] Interval Transfer Bandwidth [ 4] 0.0-60.0 sec 133 MBytes 18.6 Mbits/sec [ 7] 0.0-60.1 sec 132 MBytes 18.4 Mbits/sec [ 6] 0.0-60.1 sec 144 MBytes 20.2 Mbits/sec [ 5] 0.0-60.1 sec 139 MBytes 19.4 Mbits/sec [ 3] 0.0-60.2 sec 149 MBytes 20.7 Mbits/sec [SUM] 0.0-60.2 sec 697 MBytes 97.2 Mbits/sec }}} __Ten Clients__ {{{ [ ID] Interval Transfer Bandwidth [ 11] 0.0-60.1 sec 70.5 MBytes 9.84 Mbits/sec [ 4] 0.0-60.1 sec 71.8 MBytes 10.0 Mbits/sec [ 7] 0.0-60.1 sec 69.9 MBytes 9.75 Mbits/sec [ 12] 0.0-60.1 sec 70.1 MBytes 9.78 Mbits/sec [ 5] 0.0-60.2 sec 67.1 MBytes 9.36 Mbits/sec [ 10] 0.0-60.2 sec 69.5 MBytes 9.69 Mbits/sec [ 6] 0.0-60.2 sec 69.9 MBytes 9.74 Mbits/sec [ 9] 0.0-60.2 sec 69.6 MBytes 9.71 Mbits/sec [ 8] 0.0-60.3 sec 65.8 MBytes 9.15 Mbits/sec [ 3] 0.0-60.3 sec 66.5 MBytes 9.26 Mbits/sec [SUM] 0.0-60.3 sec 691 MBytes 96.1 Mbits/sec }}} '''Iperf ExoGENI GWU VM to GPO InstaGENI VM (UDP) - UDP buffer size: 208 KByte (default) ''' {{{ [ 3] Server Report: [ 3] 0.0-60.1 sec 693 MBytes 96.6 Mbits/sec 0.085 ms 18757/512820 (3.7%) [ 3] 0.0-60.1 sec 1 datagrams received out-of-order }}} '''Ping from ExoGENI GWU VM to GPO InstaGENI VM ''' {{{ 60 packets transmitted, 60 received, 0% packet loss, time 59088ms rtt min/avg/max/mdev = 11.117/11.388/12.689/0.217 ms }}} == EG-ST-4 New Site to GPO EG interoperability == Create a slice and then create the stitched slivers with the RSpec [http://groups.geni.net/geni/browser/trunk/stitch-examples/GWU/EG-ST-4.rspec EG-ST-4.rspec], which specifies a 100 Mbps link capacity. This was done to get around the mismatch in link capacity units that exists between IG and EG. {{{ $ stitcher createsliver EG-ST-4 ./EG-ST-4.rspec --scsURL https://nutshell.maxgigapop.net:8443/geni/xmlrpc --noExoSM 11:43:02 INFO : Configured logging from file /home/lnevers/geni-tools-2.10/src/gcf/stitcher_logging.conf 11:43:02 INFO : Requested to use GENI stitching instead of ExoGENI stitching 11:43:02 INFO : Reading slice EG-ST-4 credential... 11:43:02 INFO : Slice urn:publicid:IDN+ch.geni.net:ln-test+slice+EG-ST-4 expires on 2017-04-10 15:30:49 UTC 11:43:02 INFO : Using SCS at https://nutshell.maxgigapop.net:8443/geni/xmlrpc 11:43:02 INFO : Calling SCS... 11:43:03 INFO : Multi-AM reservation will include resources from these aggregates: 11:43:03 INFO : 11:43:03 INFO : 11:43:03 INFO : 11:43:03 INFO : Stitcher doing createsliver at ... 11:43:10 INFO : ... Allocation at complete. 11:43:10 INFO : Stitcher doing createsliver at ... 11:43:21 INFO : ... Allocation at complete. 11:43:21 INFO : Stitcher doing createsliver at ... 11:43:23 ERROR : {'output': 'Exception: requested VLAN unavailable: rtsw.newy32aoa.net.internet2.edu,et-7/3/0.0 VLAN=3739', 'code': {'geni_code': 24}} 11:43:23 WARNING : Stitching failed but will retry: Circuit reservation failed at . Try again from the SCS. (Error: Topology too complex for local redo - ask Stitching Service to find a VLAN tag (AMAPIError: Error from Aggregate: code 24: Exception: requested VLAN unavailable: rtsw.newy32aoa.net.internet2.edu,et-7/3/0.0 VLAN=3739.)) 11:43:23 INFO : Deleting existing reservations... 11:43:23 INFO : Doing deletesliver at ... 11:43:26 INFO : Deleted reservation at . 11:43:26 INFO : Doing deletesliver at ... 11:43:29 INFO : Deleted reservation at . 11:43:29 INFO : Calling SCS for the 2nd time... 11:43:30 INFO : Pausing for 30 seconds for Aggregates to free up resources... 11:44:00 INFO : Multi-AM reservation will include resources from these aggregates: 11:44:00 INFO : 11:44:00 INFO : 11:44:00 INFO : 11:44:00 INFO : Stitcher doing createsliver at ... 11:44:06 ERROR : {'output': 'ERROR: Embedding workflow ERROR: 1:Error in building the dependency tree, probably not available vlan path OR trying to reuse a stitching tag:http://geni-orca.renci.org/owl/fc07fcb4-de6f-414f-98be-fe0668de1783#/f8de90aa-f195-4989-94a9-2be940d917fe.\n Please see https://geni-orca.renci.org/trac/wiki/orca-errors for possible solutions.', 'code': {'geni_code': 2}} 11:44:06 INFO : Got an error reserving resources in EG-ST-4 at 11:44:07 WARNING : Failed to delete sliver urn:publicid:IDN+ch.geni.net:ln-test+slice+EG-ST-4 at gwu-eg (got result 'None'). Error from Aggregate: code 12: ERROR: unable to find slice urn:publicid:IDN+ch.geni.net:ln-test+slice+EG-ST-4 among active slices. 11:44:07 INFO : Will put back in the pool to allocate. Got: VLAN was unavailable. Retry 2nd time with new suggested VLANs 11:44:07 INFO : Pausing for 30 seconds for Aggregates to free up resources... 11:44:37 INFO : Stitcher doing createsliver at ... 11:44:44 INFO : ... Allocation at complete. 11:44:44 INFO : Stitcher doing createsliver at ... 11:44:55 INFO : ... Allocation at complete. 11:44:55 INFO : Stitcher doing createsliver at ... 11:44:57 ERROR : {'output': 'Exception: requested VLAN unavailable: rtsw.newy32aoa.net.internet2.edu,et-7/3/0.0 VLAN=3741', 'code': {'geni_code': 24}} 11:44:57 WARNING : Stitching failed but will retry: Circuit reservation failed at . Try again from the SCS. (Error: Topology too complex for local redo - ask Stitching Service to find a VLAN tag (AMAPIError: Error from Aggregate: code 24: Exception: requested VLAN unavailable: rtsw.newy32aoa.net.internet2.edu,et-7/3/0.0 VLAN=3741.)) 11:44:57 INFO : Deleting existing reservations... 11:44:57 INFO : Doing deletesliver at ... 11:44:59 INFO : Deleted reservation at . 11:44:59 INFO : Doing deletesliver at ... 11:45:03 INFO : Deleted reservation at . 11:45:03 INFO : Calling SCS for the 3rd time... 11:45:03 INFO : Pausing for 30 seconds for Aggregates to free up resources... 11:45:33 INFO : Multi-AM reservation will include resources from these aggregates: 11:45:33 INFO : 11:45:33 INFO : 11:45:33 INFO : 11:45:33 INFO : Stitcher doing createsliver at ... 11:45:40 INFO : ... Allocation at complete. 11:45:40 INFO : Stitcher doing createsliver at ... 11:45:50 INFO : ... Allocation at complete. 11:45:50 INFO : Stitcher doing createsliver at ... 11:45:52 ERROR : {'output': 'Exception: requested VLAN unavailable: rtsw.newy32aoa.net.internet2.edu,et-7/3/0.0 VLAN=3738', 'code': {'geni_code': 24}} 11:45:52 WARNING : Stitching failed but will retry: Circuit reservation failed at . Try again from the SCS. (Error: Topology too complex for local redo - ask Stitching Service to find a VLAN tag (AMAPIError: Error from Aggregate: code 24: Exception: requested VLAN unavailable: rtsw.newy32aoa.net.internet2.edu,et-7/3/0.0 VLAN=3738.)) 11:45:52 INFO : Deleting existing reservations... 11:45:52 INFO : Doing deletesliver at ... 11:45:54 INFO : Deleted reservation at . 11:45:54 INFO : Doing deletesliver at ... 11:45:58 INFO : Deleted reservation at . 11:45:58 INFO : Calling SCS for the 4th time... 11:45:58 INFO : Pausing for 30 seconds for Aggregates to free up resources... 11:46:29 INFO : Multi-AM reservation will include resources from these aggregates: 11:46:29 INFO : 11:46:29 INFO : 11:46:29 INFO : 11:46:29 INFO : Stitcher doing createsliver at ... 11:46:35 INFO : ... Allocation at complete. 11:46:36 INFO : Stitcher doing createsliver at ... 11:46:46 INFO : ... Allocation at complete. 11:46:46 INFO : Stitcher doing createsliver at ... 11:46:54 INFO : ... Allocation at complete. 11:46:54 INFO : All aggregates are complete. 11:46:55 INFO : Your resources expire at 2017-04-09T15:36:29 (UTC). 11:46:55 INFO : Saved combined reservation RSpec at 3 AM(s) to file '/home/lnevers/gcf-test/stitch-test/GWU/EG-ST-4-manifest-rspec-multiam-combined.xml' Success: Reserved resources in slice EG-ST-4 at 3 Aggregates (including 1 intermediate aggregate(s) not in the original request), creating 1 stitched link(s). }}} Determined login information at each GWU and GPO aggregate: {{{ $ readyToLogin.py EG-ST-4 --useSliceAggregates eg-gpo's geni_status is: ready User lnevers logs in to eg-gpo using: ssh -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@192.1.242.12 eg-gwu's geni_status is: ready User lnevers logs in to eg-gwu using: ssh -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@162.250.136.38 }}} === Measurements === '''Iperf ExoGENI GPO VM to ExoGENI GWU VM (TCP) - TCP window size: 85.0 KByte (default)''' ''Collected: 2017-04-03'' __One Client_ {{{ [ ID] Interval Transfer Bandwidth [ 3] 0.0-60.0 sec 716 MBytes 100 Mbits/sec }}} __Five Clients__ {{{ [ ID] Interval Transfer Bandwidth [ 6] 0.0-60.0 sec 131 MBytes 18.3 Mbits/sec [ 7] 0.0-60.1 sec 129 MBytes 18.0 Mbits/sec [ 5] 0.0-60.1 sec 155 MBytes 21.6 Mbits/sec [ 3] 0.0-60.1 sec 121 MBytes 16.9 Mbits/sec [ 4] 0.0-60.3 sec 158 MBytes 22.0 Mbits/sec [SUM] 0.0-60.3 sec 694 MBytes 96.6 Mbits/sec }}} __Ten Clients__ {{{ [ ID] Interval Transfer Bandwidth [ 10] 0.0-60.0 sec 77.1 MBytes 10.8 Mbits/sec [ 11] 0.0-60.0 sec 76.9 MBytes 10.7 Mbits/sec [ 8] 0.0-60.1 sec 69.6 MBytes 9.72 Mbits/sec [ 4] 0.0-60.1 sec 62.4 MBytes 8.70 Mbits/sec [ 6] 0.0-60.1 sec 62.0 MBytes 8.65 Mbits/sec [ 7] 0.0-60.2 sec 71.4 MBytes 9.95 Mbits/sec [ 5] 0.0-60.3 sec 76.6 MBytes 10.7 Mbits/sec [ 3] 0.0-60.3 sec 64.9 MBytes 9.02 Mbits/sec [ 12] 0.0-60.4 sec 63.1 MBytes 8.77 Mbits/sec [ 9] 0.0-60.4 sec 72.2 MBytes 10.0 Mbits/sec [SUM] 0.0-60.4 sec 696 MBytes 96.7 Mbits/sec }}} '''Iperf ExoGENI GPO VM to ExoGENI GWU VM (UDP) - UDP buffer size: 208 KByte (default) ''' {{{ [ 3] Server Report: [ 3] 0.0-60.2 sec 701 MBytes 97.6 Mbits/sec 15.666 ms 12978/512820 (2.5%) [ 3] 0.0-60.2 sec 1 datagrams received out-of-order }}} '''Ping from ExoGENI GPO VM to the ExoGENI GWU VM ''' {{{ 60 packets transmitted, 60 received, 0% packet loss, time 59078ms rtt min/avg/max/mdev = 11.034/11.249/12.613/0.224 ms }}} '''Iperf ExoGENI GWU VM to ExoGENI GPO VM (TCP) - TCP window size: 85.0 KByte (default)''' ''Collected: 2017-04-03'' __One Client_ {{{ [ ID] Interval Transfer Bandwidth [ 3] 0.0-60.0 sec 716 MBytes 100 Mbits/sec }}} __Five Clients__ {{{ [ ID] Interval Transfer Bandwidth [ 4] 0.0-60.0 sec 123 MBytes 17.2 Mbits/sec [ 5] 0.0-60.0 sec 159 MBytes 22.2 Mbits/sec [ 7] 0.0-60.1 sec 156 MBytes 21.8 Mbits/sec [ 6] 0.0-60.2 sec 135 MBytes 18.8 Mbits/sec [ 3] 0.0-60.3 sec 122 MBytes 16.9 Mbits/sec [SUM] 0.0-60.3 sec 694 MBytes 96.6 Mbits/sec }}} __Ten Clients__ {{{ [ ID] Interval Transfer Bandwidth [ 6] 0.0-60.0 sec 72.1 MBytes 10.1 Mbits/sec [ 11] 0.0-60.1 sec 56.2 MBytes 7.85 Mbits/sec [ 9] 0.0-60.1 sec 63.0 MBytes 8.79 Mbits/sec [ 4] 0.0-60.1 sec 71.4 MBytes 9.96 Mbits/sec [ 5] 0.0-60.2 sec 73.4 MBytes 10.2 Mbits/sec [ 12] 0.0-60.2 sec 74.6 MBytes 10.4 Mbits/sec [ 7] 0.0-60.3 sec 72.5 MBytes 10.1 Mbits/sec [ 8] 0.0-60.3 sec 61.5 MBytes 8.56 Mbits/sec [ 10] 0.0-60.4 sec 72.4 MBytes 10.0 Mbits/sec [ 3] 0.0-60.5 sec 79.8 MBytes 11.1 Mbits/sec [SUM] 0.0-60.5 sec 697 MBytes 96.7 Mbits/sec }}} '''Iperf ExoGENI GWU VM to ExoGENI GPO VM (UDP) - UDP buffer size: 208 KByte (default) ''' {{{ [ 3] Server Report: [ 3] 0.0-60.0 sec 701 MBytes 98.0 Mbits/sec 0.050 ms 12645/512810 (2.5%) [ 3] 0.0-60.0 sec 1 datagrams received out-of-order }}} '''Ping from ExoGENI GWU VM to ExoGENI GPO VM ''' {{{ 60 packets transmitted, 60 received, 0% packet loss, time 59080ms rtt min/avg/max/mdev = 11.045/11.284/12.739/0.277 ms }}} == EG-ST-2 New Site to GPO IG Loop topology == Create a slice and then create the stitched slivers with the RSpec [http://groups.geni.net/geni/browser/trunk/stitch-examples/GWU/EG-ST-2.rspec EG-ST-2.rspec]: {{{ $ stitcher createsliver EG-ST-2b ./EG-ST-2.rspec -o --scsURL https://nutshell.maxgigapop.net:8443/geni/xmlrpc 12:04:48 INFO : Configured logging from file /home/lnevers/geni-tools-2.10/src/gcf/stitcher_logging.conf 12:04:48 INFO : Reading slice EG-ST-2b credential... 12:04:49 INFO : Slice urn:publicid:IDN+ch.geni.net:ln-test+slice+EG-ST-2b expires on 2017-05-29 15:06:04 UTC 12:04:49 INFO : Using SCS at https://nutshell.maxgigapop.net:8443/geni/xmlrpc 12:04:49 INFO : Calling SCS... 12:04:50 INFO : Multi-AM reservation will include resources from these aggregates: 12:04:50 INFO : 12:04:50 INFO : 12:04:50 INFO : 12:04:50 INFO : Stitcher doing createsliver at ... 12:04:58 INFO : ... Allocation at complete. 12:04:58 INFO : Stitcher doing createsliver at ... 12:05:16 INFO : ... Allocation at complete. 12:05:16 INFO : Stitcher doing createsliver at ... 12:05:30 INFO : ... Allocation at complete. 12:05:30 INFO : All aggregates are complete. 12:05:30 INFO : Your resources expire at 2017-05-28T15:54:50 (UTC). 12:05:30 INFO : Saved combined reservation RSpec at 3 AM(s) to file '/home/lnevers/gcf-test/stitch-test/GWU/EG-ST-2b-manifest-rspec-multiam-combined.xml' Success: Reserved resources in slice EG-ST-2b at 3 Aggregates (including 1 intermediate aggregate(s) not in the original request), creating 2 stitched link(s). }}} Determined login information at each GWU and GPO aggregate: {{{ $ readyToLogin.py EG-ST-2b --useSliceAggregates .... ig-gpo's geni_status is: ready User lnevers logs in to ig-gpo using: ssh -p 25170 -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@pc5.instageni.gpolab.bbn.com eg-gwu's geni_status is: ready User lnevers logs in to eg-gwu using: ssh -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@162.250.136.28 }}} Login to GPO host and ping the remote on each of the two interfaces. Below is the ping output for the GPO site: {{{ lnevers@ig-gpo:~$ ping 10.10.4.2 -c 60 -q PING 10.10.4.2 (10.10.4.2) 56(84) bytes of data. --- 10.10.4.2 ping statistics --- 60 packets transmitted, 60 received, 0% packet loss, time 59084ms rtt min/avg/max/mdev = 11.182/11.541/23.160/1.541 ms lnevers@ig-gpo:~$ ping 192.168.4.2 -c 60 -q PING 192.168.4.2 (192.168.4.2) 56(84) bytes of data. --- 192.168.4.2 ping statistics --- 60 packets transmitted, 60 received, 0% packet loss, time 59076ms rtt min/avg/max/mdev = 11.191/11.504/22.450/1.433 ms lnevers@ig-gpo:~$ }}} == EG-ST-3 EG-ST-3 New Site 3 node linear topology == Create a slice and then create the stitched slivers with the RSpec [http://groups.geni.net/geni/browser/trunk/stitch-examples/GWU/EG-ST-3.rspec EG-ST-3.rspec]: {{{ $ stitcher.py createsliver EG-ST-3a EG-ST-3.rspec -o --scsURL https://nutshell.maxgigapop.net:8443/geni/xmlrpc 12:16:44 INFO : Configured logging from file /home/lnevers/geni-tools-2.10/src/gcf/stitcher_logging.conf 12:16:44 INFO : Reading slice EG-ST-3a credential... 12:16:44 INFO : Slice urn:publicid:IDN+ch.geni.net:ln-test+slice+EG-ST-3a expires on 2017-05-29 14:40:23 UTC 12:16:44 INFO : Using SCS at https://nutshell.maxgigapop.net:8443/geni/xmlrpc 12:16:44 INFO : Calling SCS... 12:16:45 INFO : Multi-AM reservation will include resources from these aggregates: 12:16:45 INFO : 12:16:45 INFO : 12:16:45 INFO : 12:16:45 INFO : 12:16:45 INFO : Stitcher doing createsliver at ... 12:17:16 INFO : ... Allocation at complete. 12:17:16 INFO : Stitcher doing createsliver at ... 12:17:32 INFO : ... Allocation at complete. 12:17:33 INFO : Stitcher doing createsliver at ... 12:17:42 INFO : ... Allocation at complete. 12:17:42 INFO : Stitcher doing createsliver at ... 12:17:51 ERROR : {'output': 'Exception: requested VLAN unavailable: rtsw.newy32aoa.net.internet2.edu,et-7/3/0.0 VLAN=3731', 'code': {'geni_code': 24}} 12:17:51 INFO : Deleting some reservations to retry, avoiding failed VLAN... 12:17:51 INFO : Doing deletesliver at ... 12:19:18 ERROR : {'output': 'start/restart in progress; try again later', 'code': {'protogeni_error_log': 'urn:publicid:IDN+instageni.gpolab.bbn.com+log+c5c64d275b57e0391ba35c382c5b5106', 'am_type': 'protogeni', 'geni_code': 14, 'am_code': 14, 'protogeni_error_url': 'https://boss.instageni.gpolab.bbn.com/spewlogfile.php3?logfile=c5c64d275b57e0391ba35c382c5b5106'}, 'value': 0} 12:19:28 INFO : ... aggregate was busy, will retry ... 12:20:13 INFO : ... done. 12:20:13 INFO : Will put back in the pool to allocate. Got: Retrying reservations at earlier AMs to avoid unavailable VLAN tag at .... 12:20:13 INFO : Pausing for 30 seconds for Aggregates to free up resources... 12:20:43 INFO : Checking that prior reservation at has been cleared up.... 12:20:44 ERROR : {'output': 'No slice or aggregate here', 'code': {'protogeni_error_log': 'urn:publicid:IDN+instageni.gpolab.bbn.com+log+845fe5dd67c7d880af6501f41ae65491', 'am_type': 'protogeni', 'geni_code': 12, 'am_code': 12, 'protogeni_error_url': 'https://boss.instageni.gpolab.bbn.com/spewlogfile.php3?logfile=845fe5dd67c7d880af6501f41ae65491'}, 'value': 0} 12:20:44 INFO : ... it is, so can try a new reservation. 12:20:44 INFO : Stitcher doing createsliver at ... 12:21:22 INFO : ... Allocation at complete. 12:21:22 INFO : Stitcher doing createsliver at ... 12:21:30 ERROR : {'output': 'Exception: requested VLAN unavailable: rtsw.newy32aoa.net.internet2.edu,et-7/3/0.0 VLAN=3748', 'code': {'geni_code': 24}} 12:21:30 INFO : Deleting some reservations to retry, avoiding failed VLAN... 12:21:30 INFO : Doing deletesliver at ... 12:22:57 ERROR : {'output': 'start/restart in progress; try again later', 'code': {'protogeni_error_log': 'urn:publicid:IDN+instageni.gpolab.bbn.com+log+fd8ad0fc21dc1516bb56a8183889336f', 'am_type': 'protogeni', 'geni_code': 14, 'am_code': 14, 'protogeni_error_url': 'https://boss.instageni.gpolab.bbn.com/spewlogfile.php3?logfile=fd8ad0fc21dc1516bb56a8183889336f'}, 'value': 0} 12:23:07 INFO : ... aggregate was busy, will retry ... 12:24:38 INFO : ... done. 12:24:38 INFO : Will put back in the pool to allocate. Got: Retrying reservations at earlier AMs to avoid unavailable VLAN tag at .... 12:24:38 INFO : Pausing for 30 seconds for Aggregates to free up resources... 12:25:08 INFO : Checking that prior reservation at has been cleared up.... 12:25:09 ERROR : {'output': 'No slice or aggregate here', 'code': {'protogeni_error_log': 'urn:publicid:IDN+instageni.gpolab.bbn.com+log+e9731b146f8a07be4f4c359f96fa0642', 'am_type': 'protogeni', 'geni_code': 12, 'am_code': 12, 'protogeni_error_url': 'https://boss.instageni.gpolab.bbn.com/spewlogfile.php3?logfile=e9731b146f8a07be4f4c359f96fa0642'}, 'value': 0} 12:25:09 INFO : ... it is, so can try a new reservation. 12:25:09 INFO : Stitcher doing createsliver at ... 12:25:48 INFO : ... Allocation at complete. 12:25:48 INFO : Stitcher doing createsliver at ... 12:26:01 INFO : ... Allocation at complete. 12:26:01 INFO : All aggregates are complete. 12:26:01 INFO : Your resources expire at 2017-05-28T16:06:45 (UTC). 12:26:01 INFO : Saved combined reservation RSpec at 4 AM(s) to file '/home/lnevers/gcf-test/stitch-test/GWU/EG-ST-3a-manifest-rspec-multiam-combined.xml' Success: Reserved resources in slice EG-ST-3a at 4 Aggregates (including 1 intermediate aggregate(s) not in the original request), creating 2 stitched link(s). }}} Determined login information the GWU host: {{{ $ readyToLogin.py EG-ST-3a --useSliceAggregates .... ig-gpo's geni_status is: ready User lnevers logs in to ig-gpo using: ssh -p 25106 -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@pc2.instageni.gpolab.bbn.com ig-sox's geni_status is: ready User lnevers logs in to ig-sox using: ssh -p 25042 -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@pc2.instageni.sox.net eg-gwu's geni_status is: ready User lnevers logs in to eg-gwu using: ssh -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@162.250.136.28 }}} Login to the GWU host and ping each remote: {{{ lnevers@eg-gwu:~$ ping 192.168.2.1 -c 60 -q PING 192.168.2.1 (192.168.2.1) 56(84) bytes of data. --- 192.168.2.1 ping statistics --- 60 packets transmitted, 60 received, 0% packet loss, time 59076ms rtt min/avg/max/mdev = 11.027/11.349/22.841/1.507 ms lnevers@eg-gwu:~$ # Sox IG lnevers@eg-gwu:~$ ping 192.168.4.1 -c 60 -q PING 192.168.4.1 (192.168.4.1) 56(84) bytes of data. --- 192.168.4.1 ping statistics --- 60 packets transmitted, 60 received, 0% packet loss, time 59085ms rtt min/avg/max/mdev = 14.201/14.517/28.881/1.877 ms lnevers@eg-gwu:~$ }}} == EG-ST-4 New Site to GPO EG interoperability == Create a slice and then create the stitched slivers with the RSpec [http://groups.geni.net/geni/browser/trunk/stitch-examples/GWU/EG-ST-4.rspec EG-ST-4.rspec], which specifies a 100 Mbps link capacity. This was done to get around the mismatch in link capacity units that exists between IG and EG. {{{ $ stitcher.py createsliver EG-ST-4a EG-ST-4.rspec -o --noExoSM --scsURL https://nutshell.maxgigapop.net:8443/geni/xmlrpc 12:43:59 INFO : Configured logging from file /home/lnevers/geni-tools-2.10/src/gcf/stitcher_logging.conf 12:43:59 INFO : Requested to use GENI stitching instead of ExoGENI stitching 12:43:59 INFO : Reading slice EG-ST-4a credential... 12:43:59 INFO : Slice urn:publicid:IDN+ch.geni.net:ln-test+slice+EG-ST-4a expires on 2017-05-29 16:43:59 UTC 12:43:59 INFO : Using SCS at https://nutshell.maxgigapop.net:8443/geni/xmlrpc 12:43:59 INFO : Calling SCS... 12:44:00 INFO : Multi-AM reservation will include resources from these aggregates: 12:44:00 INFO : 12:44:00 INFO : 12:44:00 INFO : 12:44:00 INFO : Stitcher doing createsliver at ... 12:44:07 INFO : ... Allocation at complete. 12:44:07 INFO : Stitcher doing createsliver at ... 12:44:15 INFO : ... Allocation at complete. 12:44:15 INFO : Stitcher doing createsliver at ... 12:44:17 ERROR : {'output': 'Exception: requested VLAN unavailable: rtsw.newy32aoa.net.internet2.edu,et-7/3/0.0 VLAN=3741', 'code': {'geni_code': 24}} 12:44:17 WARNING : Stitching failed but will retry: Circuit reservation failed at . Try again from the SCS. (Error: Topology too complex for local redo - ask Stitching Service to find a VLAN tag (AMAPIError: Error from Aggregate: code 24: Exception: requested VLAN unavailable: rtsw.newy32aoa.net.internet2.edu,et-7/3/0.0 VLAN=3741.)) 12:44:17 INFO : Deleting existing reservations... 12:44:17 INFO : Doing deletesliver at ... 12:44:19 INFO : Deleted reservation at . 12:44:19 INFO : Doing deletesliver at ... 12:44:22 INFO : Deleted reservation at . 12:44:22 INFO : Calling SCS for the 2nd time... 12:44:22 INFO : Pausing for 30 seconds for Aggregates to free up resources... 12:44:52 INFO : Multi-AM reservation will include resources from these aggregates: 12:44:52 INFO : 12:44:52 INFO : 12:44:52 INFO : 12:44:52 INFO : Stitcher doing createsliver at ... 12:45:00 INFO : ... Allocation at complete. 12:45:00 INFO : Stitcher doing createsliver at ... 12:45:09 INFO : ... Allocation at complete. 12:45:09 INFO : Stitcher doing createsliver at ... 12:45:11 ERROR : {'output': 'Exception: requested VLAN unavailable: rtsw.newy32aoa.net.internet2.edu,et-7/3/0.0 VLAN=3739', 'code': {'geni_code': 24}} 12:45:11 WARNING : Stitching failed but will retry: Circuit reservation failed at . Try again from the SCS. (Error: Topology too complex for local redo - ask Stitching Service to find a VLAN tag (AMAPIError: Error from Aggregate: code 24: Exception: requested VLAN unavailable: rtsw.newy32aoa.net.internet2.edu,et-7/3/0.0 VLAN=3739.)) 12:45:11 INFO : Deleting existing reservations... 12:45:11 INFO : Doing deletesliver at ... 12:45:14 INFO : Deleted reservation at . 12:45:14 INFO : Doing deletesliver at ... 12:45:18 INFO : Deleted reservation at . 12:45:18 INFO : Calling SCS for the 3rd time... 12:45:19 INFO : Pausing for 30 seconds for Aggregates to free up resources... 12:45:49 INFO : Multi-AM reservation will include resources from these aggregates: 12:45:49 INFO : 12:45:49 INFO : 12:45:49 INFO : 12:45:49 INFO : Stitcher doing createsliver at ... 12:45:55 INFO : ... Allocation at complete. 12:45:55 INFO : Stitcher doing createsliver at ... 12:46:59 ERROR : Call for Lookup slice urn:publicid:IDN+ch.geni.net:ln-test+slice+EG-ST-4a on GENI Clearinghouse https://ch.geni.net/SA failed.: Unknown socket error: [Errno 110] Connection timed out 12:46:59 ERROR : Server Error looking up slice urn:publicid:IDN+ch.geni.net:ln-test+slice+EG-ST-4a. Unknown socket error: [Errno 110] Connection timed out 12:47:07 INFO : ... Allocation at complete. 12:47:07 INFO : Stitcher doing createsliver at ... 12:47:15 INFO : ... Allocation at complete. 12:47:15 INFO : All aggregates are complete. 12:47:15 INFO : Your resources expire at 2017-05-28T16:35:49 (UTC). 12:47:15 INFO : Saved combined reservation RSpec at 3 AM(s) to file '/home/lnevers/gcf-test/stitch-test/GWU/EG-ST-4a-manifest-rspec-multiam-combined.xml' Success: Reserved resources in slice EG-ST-4a at 3 Aggregates (including 1 intermediate aggregate(s) not in the original request), creating 1 stitched link(s). }}} Determined login information at each GWU and GPO aggregate: {{{ $ readyToLogin.py EG-ST-4a --useSliceAggregates .... eg-gpo's geni_status is: ready User lnevers logs in to eg-gpo using: ssh -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@192.1.242.5 eg-gwu's geni_status is: ready User lnevers logs in to eg-gwu using: ssh -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@162.250.136.28 }}} === Measurements === '''Iperf ExoGENI GPO VM to ExoGENI GWU VM (TCP) - TCP window size: 85.0 KByte (default)''' ''Collected: 2017-05-22'' __One Client_ {{{ [ ID] Interval Transfer Bandwidth [ 3] 0.0-60.0 sec 715 MBytes 100 Mbits/sec }}} __Five Clients__ {{{ [ ID] Interval Transfer Bandwidth [ 6] 0.0-60.0 sec 187 MBytes 26.1 Mbits/sec [ 3] 0.0-60.0 sec 111 MBytes 15.5 Mbits/sec [ 5] 0.0-60.1 sec 167 MBytes 23.3 Mbits/sec [ 4] 0.0-60.1 sec 106 MBytes 14.8 Mbits/sec [ 7] 0.0-60.3 sec 124 MBytes 17.2 Mbits/sec [SUM] 0.0-60.3 sec 694 MBytes 96.6 Mbits/sec }}} __Ten Clients__ {{{ [ ID] Interval Transfer Bandwidth [ 7] 0.0-60.0 sec 68.1 MBytes 9.52 Mbits/sec [ 6] 0.0-60.0 sec 66.9 MBytes 9.34 Mbits/sec [ 12] 0.0-60.1 sec 80.6 MBytes 11.3 Mbits/sec [ 8] 0.0-60.1 sec 80.0 MBytes 11.2 Mbits/sec [ 9] 0.0-60.1 sec 70.6 MBytes 9.85 Mbits/sec [ 10] 0.0-60.2 sec 57.9 MBytes 8.07 Mbits/sec [ 11] 0.0-60.2 sec 60.2 MBytes 8.39 Mbits/sec [ 3] 0.0-60.4 sec 79.1 MBytes 11.0 Mbits/sec [ 5] 0.0-60.5 sec 64.6 MBytes 8.96 Mbits/sec [ 4] 0.0-60.6 sec 68.2 MBytes 9.45 Mbits/sec [SUM] 0.0-60.6 sec 696 MBytes 96.4 Mbits/sec }}} '''Iperf ExoGENI GPO VM to ExoGENI GWU VM (UDP) - UDP buffer size: 208 KByte (default) ''' {{{ [ ID] Interval Transfer Bandwidth [ 3] 0.0-60.0 sec 719 MBytes 101 Mbits/sec [ 3] Sent 512821 datagrams [ 3] Server Report: [ 3] 0.0-60.0 sec 702 MBytes 98.2 Mbits/sec 0.003 ms 12007/512820 (2.3%) [ 3] 0.0-60.0 sec 1 datagrams received out-of-order }}} '''Ping from ExoGENI GPO VM to the ExoGENI GWU VM ''' {{{ 60 packets transmitted, 60 received, 0% packet loss, time 59081ms rtt min/avg/max/mdev = 11.094/11.375/16.026/0.818 ms }}} '''Iperf ExoGENI GWU VM to ExoGENI GPO VM (TCP) - TCP window size: 85.0 KByte (default)''' ''Collected: 2017-05-22'' __One Client_ {{{ [ ID] Interval Transfer Bandwidth [ 3] 0.0-60.0 sec 712 MBytes 99.6 Mbits/sec }}} __Five Clients__ {{{ [ ID] Interval Transfer Bandwidth [ 3] 0.0-60.0 sec 135 MBytes 18.9 Mbits/sec [ 5] 0.0-60.0 sec 138 MBytes 19.2 Mbits/sec [ 7] 0.0-60.1 sec 149 MBytes 20.8 Mbits/sec [ 4] 0.0-60.1 sec 135 MBytes 18.9 Mbits/sec [ 6] 0.0-60.4 sec 137 MBytes 19.0 Mbits/sec [SUM] 0.0-60.4 sec 694 MBytes 96.5 Mbits/sec }}} __Ten Clients__ {{{ [ ID] Interval Transfer Bandwidth [ 5] 0.0-60.0 sec 77.6 MBytes 10.8 Mbits/sec [ 4] 0.0-60.1 sec 73.8 MBytes 10.3 Mbits/sec [ 10] 0.0-60.1 sec 63.8 MBytes 8.90 Mbits/sec [ 6] 0.0-60.1 sec 71.6 MBytes 10.0 Mbits/sec [ 9] 0.0-60.1 sec 70.2 MBytes 9.80 Mbits/sec [ 11] 0.0-60.1 sec 60.8 MBytes 8.47 Mbits/sec [ 7] 0.0-60.2 sec 69.8 MBytes 9.73 Mbits/sec [ 12] 0.0-60.2 sec 66.0 MBytes 9.20 Mbits/sec [ 3] 0.0-60.2 sec 76.4 MBytes 10.6 Mbits/sec [ 8] 0.0-60.3 sec 67.1 MBytes 9.34 Mbits/sec [SUM] 0.0-60.3 sec 697 MBytes 97.0 Mbits/sec }}} '''Iperf ExoGENI GWU VM to ExoGENI GPO VM (UDP) - UDP buffer size: 208 KByte (default) ''' {{{ [ ID] Interval Transfer Bandwidth [ 3] 0.0-60.0 sec 719 MBytes 101 Mbits/sec [ 3] Sent 512819 datagrams [ 3] Server Report: [ 3] 0.0-60.0 sec 699 MBytes 97.8 Mbits/sec 0.028 ms 14034/512818 (2.7%) [ 3] 0.0-60.0 sec 1 datagrams received out-of-order }}} '''Ping from ExoGENI GWU VM to ExoGENI GPO VM ''' {{{ 60 packets transmitted, 60 received, 0% packet loss, time 59079ms rtt min/avg/max/mdev = 11.076/11.409/17.385/0.881 ms }}} == EG-ST-5 Site Information == Various pages include stitching information for a site. Each of the following were verified for this site: 1. Verified that stitching VLANs and Device URN information exists in the [http://groups.geni.net/geni/wiki/GeniAggregate/GeorgeWashingtonExoGENI#GENINetworkStitching GWU Aggregate] page. 2. To BE Verified that Delegated GENI Stitching VLANs for site are documented at the [https://wiki.maxgigapop.net/twiki/bin/view/GENI/StaticNetworksView Delegated GENI Stitching VLANs]. 3. No longer possible for Stitching Computation Service logs to be reviewed. 4. To BE Added site to the list of [wiki:GeniNetworkStitchingSites GENI Network Stitching Sites].