wiki:GeniNetworkStitchingConfirmationTestStatus/FIU

Version 11 (modified by lnevers@bbn.com, 2 years ago) (diff)

--

Florida International University Stitching Confirmation Tests

This pages capture the detailed test logs for each test defined in the New Site Stitching Confirmation Tests page. For the sites status see the New Site Stitching Confirmation Tests Status page.

EG-ST-1 New Site to GPO IG topology

The FIU site advertises the following stitching details for the connection to AL2S.

    <ns2:stitching lastUpdateTime="Mon Apr 03 10:18:40 EDT 2017">
        <ns2:aggregate id="urn:publicid:IDN+exogeni.net:fiuNet+authority+am" url="https://fiu-hn.exogeni.net:11443/orca/xmlrpc">
            <ns2:aggregatetype>orca</ns2:aggregatetype>
            <ns2:stitchingmode>tree</ns2:stitchingmode>
            <ns2:scheduledservices>true</ns2:scheduledservices>
            <ns2:negotiatedservices>false</ns2:negotiatedservices>
            <ns2:node id="urn:publicid:IDN+exogeni.net:fiuNet+node+orca-transit-net-vlan">
                <ns2:port id="urn:publicid:IDN+exogeni.net:fiuNet+stitchport+FiuNet:IBM:G8052:TenGigabitEthernet:1:4:ethernet">
                    <ns2:capacity>1000000kbps</ns2:capacity>
                    <ns2:maximumReservableCapacity>1000000kbps</ns2:maximumReservableCapacity>
                    <ns2:link id="urn:publicid:IDN+exogeni.net:fiuNet+interface+FiuNet:IBM:G8052:TenGigabitEthernet:1:4:ethernet">
                        <ns2:remoteLinkId>urn:publicid:IDN+al2s.internet2.edu+interface+sdn-sw.jack.net.internet2.edu:et-4/0/0.0:fiu-eg</ns2:remoteLinkId>
                        <ns2:trafficEngineeringMetric>10</ns2:trafficEngineeringMetric>
                        <ns2:capacity>1000000kbps</ns2:capacity>
                        <ns2:maximumReservableCapacity>1000000kbps</ns2:maximumReservableCapacity>
                        <ns2:switchingCapabilityDescriptor>
                            <ns2:switchingcapType>l2sc</ns2:switchingcapType>
                            <ns2:encodingType>ethernet</ns2:encodingType>
                            <ns2:switchingCapabilitySpecificInfo>
                                <ns2:switchingCapabilitySpecificInfo_L2sc>
                                    <ns2:capability>consumer</ns2:capability>
                                    <ns2:vlanRangeAvailability>1755-1759</ns2:vlanRangeAvailability>
                                    <ns2:vlanTranslation>false</ns2:vlanTranslation>
                                </ns2:switchingCapabilitySpecificInfo_L2sc>
                            </ns2:switchingCapabilitySpecificInfo>
                        </ns2:switchingCapabilityDescriptor>
                    </ns2:link>
                </ns2:port>
            </ns2:node>
        </ns2:aggregate>
    </ns2:stitching>

Experimenter may not need any of this data, but it is helpful to reference when trying to determine how many VLANs are delegated for stitching at the site or how much bandwidth can be requested.

Create a slice and then create the stitched slivers with the RSpec EG-ST-1.rspec:

$ stitcher createsliver EG-ST-1f ./EG-ST-1.rspec --scsURL https://nutshell.maxgigapop.net:8443/geni/xmlrpc
09:38:44 INFO    : Configured logging from file /home/lnevers/geni-tools-2.10/src/gcf/stitcher_logging.conf
09:38:44 INFO    : Reading slice EG-ST-1f credential...
09:38:44 INFO    : Slice urn:publicid:IDN+ch.geni.net:ln-test+slice+EG-ST-1f expires on 2017-04-10 13:38:43 UTC
09:38:44 INFO    : Using SCS at https://nutshell.maxgigapop.net:8443/geni/xmlrpc
09:38:44 INFO    : Calling SCS...
09:38:45 INFO    : Multi-AM reservation will include resources from these aggregates:
09:38:45 INFO    : 	<Aggregate gpo-ig>
09:38:45 INFO    : 	<Aggregate al2s>
09:38:45 INFO    : 	<Aggregate fiu-eg>
09:38:45 INFO    : Stitcher doing createsliver at <Aggregate gpo-ig>...
09:39:12 INFO    : ... Allocation at <Aggregate gpo-ig> complete.
09:39:12 INFO    : Stitcher doing createsliver at <Aggregate fiu-eg>...
09:39:22 INFO    : ... Allocation at <Aggregate fiu-eg> complete.
09:39:22 INFO    : Stitcher doing createsliver at <Aggregate al2s>...
09:39:29 INFO    : ... Allocation at <Aggregate al2s> complete.
09:39:29 INFO    : All aggregates are complete.
09:39:29 INFO    : Your resources expire at 2017-04-09T13:28:45 (UTC). 
09:39:29 INFO    : Saved combined reservation RSpec at 3 AM(s) to file '/home/lnevers/gcf-test/stitch-test/FIU/EG-ST-1f-manifest-rspec-multiam-combined.xml'
Success: Reserved resources in slice EG-ST-1f at 3 Aggregates (including 1 intermediate aggregate(s) not in the original request), creating 1 stitched link(s).

Determined login information at each FIU EG and GPO IG aggregate:

$ readyToLogin.py EG-ST-1f --useSliceAggregates
  ....
ig-gpo's geni_status is: ready 
User lnevers logs in to ig-gpo using:
	ssh -p 35386  -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@pc5.instageni.gpolab.bbn.com

eg-fiu's geni_status is: ready 
User lnevers logs in to eg-fiu using:
	ssh -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@131.94.144.10

Measurements

Iperf InstaGENI GPO VM to ExoGENI FIU VM (TCP) - TCP window size: 85.0 KByte (default)

Collected: 2017-04-03

One Client_

[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-60.1 sec   625 MBytes  87.3 Mbits/sec

Five Clients

[ ID] Interval       Transfer     Bandwidth
[  5]  0.0-60.0 sec   151 MBytes  21.1 Mbits/sec
[  3]  0.0-60.0 sec   111 MBytes  15.5 Mbits/sec
[  6]  0.0-60.1 sec   107 MBytes  14.9 Mbits/sec
[  7]  0.0-60.1 sec   100 MBytes  14.0 Mbits/sec
[  4]  0.0-60.2 sec   207 MBytes  28.8 Mbits/sec
[SUM]  0.0-60.2 sec   676 MBytes  94.2 Mbits/sec

Ten Clients

[ ID] Interval       Transfer     Bandwidth
[ 11]  0.0-60.0 sec  68.6 MBytes  9.59 Mbits/sec
[  5]  0.0-60.1 sec  77.2 MBytes  10.8 Mbits/sec
[  7]  0.0-60.2 sec  80.8 MBytes  11.3 Mbits/sec
[  3]  0.0-60.2 sec  60.5 MBytes  8.43 Mbits/sec
[  6]  0.0-60.2 sec  73.0 MBytes  10.2 Mbits/sec
[  8]  0.0-60.2 sec  71.4 MBytes  9.94 Mbits/sec
[  9]  0.0-60.3 sec  58.4 MBytes  8.12 Mbits/sec
[  4]  0.0-60.4 sec  61.8 MBytes  8.58 Mbits/sec
[ 12]  0.0-60.4 sec  67.6 MBytes  9.39 Mbits/sec
[ 10]  0.0-60.5 sec  69.5 MBytes  9.64 Mbits/sec
[SUM]  0.0-60.5 sec   689 MBytes  95.5 Mbits/sec

Iperf InstaGENI GPO VM to ExoGENI FIU VM (UDP) - UDP buffer size: 208 KByte (default)

[  3] Server Report:
[  3]  0.0-60.0 sec   686 MBytes  95.9 Mbits/sec   0.080 ms 23373/512785 (4.6%)
[  3]  0.0-60.0 sec  1 datagrams received out-of-order

Ping from InstaGENI GPO VM to the ExoGENI FIU VM

60 packets transmitted, 60 received, 0% packet loss, time 59102ms
rtt min/avg/max/mdev = 37.470/40.369/54.841/5.369 ms

Iperf ExoGENI FIU VM to GPO InstaGENI VM (TCP) - TCP window size: 85.0 KByte (default)

Collected: 2017-04-03

One Client_

[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-60.1 sec   679 MBytes  94.8 Mbits/sec

Five Clients

[ ID] Interval       Transfer     Bandwidth
[  6]  0.0-60.1 sec   134 MBytes  18.8 Mbits/sec
[  3]  0.0-60.1 sec   109 MBytes  15.2 Mbits/sec
[  5]  0.0-60.2 sec   165 MBytes  23.0 Mbits/sec
[  4]  0.0-60.2 sec   200 MBytes  27.9 Mbits/sec
[  7]  0.0-60.3 sec   103 MBytes  14.3 Mbits/sec
[SUM]  0.0-60.3 sec   711 MBytes  98.8 Mbits/sec

Ten Clients

[ ID] Interval       Transfer     Bandwidth
[  5]  0.0-60.0 sec  85.1 MBytes  11.9 Mbits/sec
[  6]  0.0-60.0 sec  58.5 MBytes  8.18 Mbits/sec
[  9]  0.0-60.0 sec  79.0 MBytes  11.0 Mbits/sec
[  7]  0.0-60.1 sec  64.8 MBytes  9.04 Mbits/sec
[  4]  0.0-60.2 sec  69.1 MBytes  9.64 Mbits/sec
[ 11]  0.0-60.2 sec  68.2 MBytes  9.51 Mbits/sec
[  8]  0.0-60.2 sec  68.9 MBytes  9.59 Mbits/sec
[  3]  0.0-60.3 sec  74.6 MBytes  10.4 Mbits/sec
[ 10]  0.0-60.3 sec  63.2 MBytes  8.80 Mbits/sec
[ 12]  0.0-60.4 sec  59.5 MBytes  8.26 Mbits/sec
[SUM]  0.0-60.4 sec   691 MBytes  95.9 Mbits/sec

Iperf ExoGENI FIU VM to GPO InstaGENI VM (UDP) - UDP buffer size: 208 KByte (default)

[  3] Server Report:
[  3]  0.0-60.1 sec   693 MBytes  96.6 Mbits/sec   0.086 ms 18712/512820 (3.6%)
[  3]  0.0-60.1 sec  1 datagrams received out-of-order

Ping from ExoGENI FIU VM to GPO InstaGENI VM

60 packets transmitted, 60 received, 0% packet loss, time 59101ms
rtt min/avg/max/mdev = 37.527/37.905/40.278/0.503 ms

EG-ST-2 New Site to GPO IG Loop topology

Create a slice and then create the stitched slivers with the RSpec EG-ST-2.rspec:

$  stitcher createsliver EG-ST-2b ./EG-ST-2.rspec -o --scsURL https://nutshell.maxgigapop.net:8443/geni/xmlrpc
11:41:21 INFO    : Configured logging from file /home/lnevers/geni-tools-2.10/src/gcf/stitcher_logging.conf
11:41:21 INFO    : Reading slice EG-ST-2b credential...
11:41:22 INFO    : Slice urn:publicid:IDN+ch.geni.net:ln-test+slice+EG-ST-2b expires on 2017-05-29 15:06:04 UTC
11:41:22 INFO    : Using SCS at https://nutshell.maxgigapop.net:8443/geni/xmlrpc
11:41:22 INFO    : Calling SCS...
11:41:23 INFO    : Multi-AM reservation will include resources from these aggregates:
11:41:23 INFO    : 	<Aggregate gpo-ig>
11:41:23 INFO    : 	<Aggregate al2s>
11:41:23 INFO    : 	<Aggregate fiu-eg>
11:41:23 INFO    : Stitcher doing createsliver at <Aggregate gpo-ig>...
11:41:43 INFO    : ... Allocation at <Aggregate gpo-ig> complete.
11:41:43 WARNING : Stitching failed but will retry: SCS gave same suggested VLAN to 2 paths - retry at the SCS. <Aggregate fiu-eg> <Hop u'urn:publicid:IDN+exogeni.net:fiuNet+interface+FiuNet:IBM:G8052:TenGigabitEthernet:1:4:ethernet' on path u'link1'> has request tag 1756 that is already in use by <Hop u'urn:publicid:IDN+exogeni.net:fiuNet+interface+FiuNet:IBM:G8052:TenGigabitEthernet:1:4:ethernet' on path u'link'>
11:41:43 INFO    : Deleting existing reservations...
11:41:43 INFO    : Doing deletesliver at <Aggregate gpo-ig>...
11:43:11 ERROR   :  {'output': 'start/restart in progress; try again later', 'code': {'protogeni_error_log': 'urn:publicid:IDN+instageni.gpolab.bbn.com+log+65102f986a15e07794e75da2d9186f9f', 'am_type': 'protogeni', 'geni_code': 14, 'am_code': 14, 'protogeni_error_url': 'https://boss.instageni.gpolab.bbn.com/spewlogfile.php3?logfile=65102f986a15e07794e75da2d9186f9f'}, 'value': 0}
11:43:21 INFO    :  ... aggregate was busy, will retry ...
11:44:30 INFO    :  ... done.
11:44:30 INFO    : Deleted reservation at <Aggregate gpo-ig>.
11:44:30 INFO    : Calling SCS for the 2nd time...
11:44:31 INFO    : Pausing for 30 seconds for Aggregates to free up resources...


11:45:01 INFO    : Multi-AM reservation will include resources from these aggregates:
11:45:01 INFO    : 	<Aggregate gpo-ig>
11:45:01 INFO    : 	<Aggregate al2s>
11:45:01 INFO    : 	<Aggregate fiu-eg>
11:45:01 INFO    : Stitcher doing createsliver at <Aggregate gpo-ig>...
11:45:40 INFO    : ... Allocation at <Aggregate gpo-ig> complete.
11:45:40 INFO    : Stitcher doing createsliver at <Aggregate fiu-eg>...
11:45:50 INFO    : ... Allocation at <Aggregate fiu-eg> complete.
11:45:50 INFO    : Stitcher doing createsliver at <Aggregate al2s>...
11:46:04 INFO    : ... Allocation at <Aggregate al2s> complete.
11:46:04 INFO    : All aggregates are complete.
11:46:04 INFO    : Your resources expire at 2017-05-28T15:35:01 (UTC). 
11:46:04 INFO    : Saved combined reservation RSpec at 3 AM(s) to file '/home/lnevers/gcf-test/stitch-test/FIU/EG-ST-2b-manifest-rspec-multiam-combined.xml'
Success: Reserved resources in slice EG-ST-2b at 3 Aggregates (including 1 intermediate aggregate(s) not in the original request), creating 2 stitched link(s).

Determined login information at each FIU and GPO aggregate:

$ readyToLogin.py EG-ST-2b --useSliceAggregates
  ....
ig-gpo's geni_status is: ready 
User lnevers logs in to ig-gpo using:
	ssh -p 25138  -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@pc4.instageni.gpolab.bbn.com

eg-fiu's geni_status is: ready 
User lnevers logs in to eg-fiu using:
	ssh -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@131.94.144.12

Login to GPO host and ping the remote on each of the two interfaces. Below is the ping output for the GPO site:

lnevers@ig-gpo:~$ ping 10.10.4.2 -c 60 -q
PING 10.10.4.2 (10.10.4.2) 56(84) bytes of data.

--- 10.10.4.2 ping statistics ---
60 packets transmitted, 60 received, 0% packet loss, time 59088ms
rtt min/avg/max/mdev = 37.301/38.201/77.545/5.146 ms
lnevers@ig-gpo:~$ ping 192.168.4.2 -c 60 -q
PING 192.168.4.2 (192.168.4.2) 56(84) bytes of data.

--- 192.168.4.2 ping statistics ---
60 packets transmitted, 60 received, 0% packet loss, time 59088ms
rtt min/avg/max/mdev = 37.342/38.068/75.608/4.894 ms
lnevers@ig-gpo:~$ 

EG-ST-3 EG-ST-3 New Site 3 node linear topology

Create a slice and then create the stitched slivers with the RSpec EG-ST-3.rspec:

$ stitcher.py createsliver EG-ST-3e EG-ST-3.rspec -o --scsURL https://nutshell.maxgigapop.net:8443/geni/xmlrpc
12:00:04 INFO    : Configured logging from file /home/lnevers/geni-tools-2.10/src/gcf/stitcher_logging.conf
12:00:04 INFO    : Reading slice EG-ST-3e credential...
12:00:04 INFO    : Slice urn:publicid:IDN+ch.geni.net:ln-test+slice+EG-ST-3e expires on 2017-05-29 15:55:21 UTC
12:00:04 INFO    : Using SCS at https://nutshell.maxgigapop.net:8443/geni/xmlrpc
12:00:04 INFO    : Calling SCS...
12:00:05 INFO    : Multi-AM reservation will include resources from these aggregates:
12:00:05 INFO    : 	<Aggregate sox-ig>
12:00:05 INFO    : 	<Aggregate gpo-ig>
12:00:05 INFO    : 	<Aggregate al2s>
12:00:05 INFO    : 	<Aggregate fiu-eg>
12:00:05 INFO    : Stitcher doing createsliver at <Aggregate sox-ig>...
12:00:23 INFO    : ... Allocation at <Aggregate sox-ig> complete.
12:00:23 INFO    : Stitcher doing createsliver at <Aggregate gpo-ig>...
12:00:41 INFO    : ... Allocation at <Aggregate gpo-ig> complete.
12:00:41 INFO    : Stitcher doing createsliver at <Aggregate fiu-eg>...
12:00:50 INFO    : ... Allocation at <Aggregate fiu-eg> complete.
12:00:50 INFO    : Stitcher doing createsliver at <Aggregate al2s>...
12:01:04 INFO    : ... Allocation at <Aggregate al2s> complete.
12:01:04 INFO    : All aggregates are complete.
12:01:04 INFO    : Your resources expire at 2017-05-28T15:50:05 (UTC). 
12:01:04 INFO    : Saved combined reservation RSpec at 4 AM(s) to file '/home/lnevers/gcf-test/stitch-test/FIU/EG-ST-3e-manifest-rspec-multiam-combined.xml'
Success: Reserved resources in slice EG-ST-3e at 4 Aggregates (including 1 intermediate aggregate(s) not in the original request), creating 2 stitched link(s).

Determined login information the FIU host:

$ readyToLogin.py EG-ST-3e --useSliceAggregates
  ....
ig-gpo's geni_status is: changing 
User lnevers logs in to ig-gpo using:
	ssh -p 25138  -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@pc2.instageni.gpolab.bbn.com

ig-sox's geni_status is: ready 
User lnevers logs in to ig-sox using:
	ssh -p 25010  -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@pc3.instageni.sox.net

eg-fiu's geni_status is: ready 
User lnevers logs in to eg-fiu using:
	ssh -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@131.94.144.12

Login to the FIU host and ping each remote:

lnevers@eg-fiu:~$ #ping GPO IG 
lnevers@eg-fiu:~$ ping 192.168.2.1 -c 60 -q
PING 192.168.2.1 (192.168.2.1) 56(84) bytes of data.


--- 192.168.2.1 ping statistics ---
60 packets transmitted, 60 received, 0% packet loss, time 59089ms
rtt min/avg/max/mdev = 37.272/38.344/89.507/6.667 ms
lnevers@eg-fiu:~$ # Utah IG
lnevers@eg-fiu:~$ ping 192.168.4.1 -c 60 -q
PING 192.168.4.1 (192.168.4.1) 56(84) bytes of data.

--- 192.168.4.1 ping statistics ---
60 packets transmitted, 60 received, 0% packet loss, time 59087ms
rtt min/avg/max/mdev = 14.221/14.621/29.637/1.963 ms
lnevers@eg-fiu:~$ 

EG-ST-4 New Site to GPO EG interoperability

Create a slice and then create the stitched slivers with the RSpec EG-ST-4.rspec, which specifies a 100 Mbps link capacity. This was done to get around the mismatch in link capacity units that exists between IG and EG.

$ stitcher createslice EG-ST-4; stitcher createsliver EG-ST-4 EG-ST-4.rspec --scsURL https://nutshell.maxgigapop.net:8443/geni/xmlrpc --noExoSM
09:48:26 INFO    : Configured logging from file /home/lnevers/geni-tools-2.10/src/gcf/stitcher_logging.conf
09:48:26 INFO    : Reading slice EG-ST-4 aggregates from file /home/lnevers/.gcf/ch-geni-net-ln-test-EG-ST-4-amlist.txt
09:48:26 INFO    : Loading agg_nick_cache file '/home/lnevers/.gcf/agg_nick_cache'
09:48:26 INFO    : Loading config file '/home/lnevers/.gcf/omni_config'
09:48:26 INFO    : Using control framework portal
09:48:26 INFO    : Member Authority is https://ch.geni.net/MA (from config)
09:48:26 INFO    : Slice Authority is https://ch.geni.net/SA (from config)
09:48:26 INFO    : Created slice with Name EG-ST-4, URN urn:publicid:IDN+ch.geni.net:ln-test+slice+EG-ST-4, Expiration 2017-05-03 13:48:26+00:00
Created slice with Name EG-ST-4, URN urn:publicid:IDN+ch.geni.net:ln-test+slice+EG-ST-4, Expiration 2017-05-03 13:48:26+00:00

09:48:26 INFO    : Configured logging from file /home/lnevers/geni-tools-2.10/src/gcf/stitcher_logging.conf
09:48:27 INFO    : Requested to use GENI stitching instead of ExoGENI stitching
09:48:27 INFO    : Reading slice EG-ST-4 credential...
09:48:27 INFO    : Slice urn:publicid:IDN+ch.geni.net:ln-test+slice+EG-ST-4 expires on 2017-05-03 13:48:26 UTC
09:48:27 INFO    : Using SCS at https://nutshell.maxgigapop.net:8443/geni/xmlrpc
09:48:27 INFO    : Calling SCS...
09:48:28 INFO    : Multi-AM reservation will include resources from these aggregates:
09:48:28 INFO    : 	<Aggregate fiu-eg>
09:48:28 INFO    : 	<Aggregate al2s>
09:48:28 INFO    : 	<Aggregate gpo-eg>
09:48:28 INFO    : Stitcher doing createsliver at <Aggregate fiu-eg>...
09:48:37 INFO    : ... Allocation at <Aggregate fiu-eg> complete.
09:48:37 INFO    : Stitcher doing createsliver at <Aggregate gpo-eg>...
09:48:47 INFO    : ... Allocation at <Aggregate gpo-eg> complete.
09:48:47 INFO    : Stitcher doing createsliver at <Aggregate al2s>...
09:48:49 ERROR   :  {'output': 'Exception: requested VLAN unavailable: rtsw.newy32aoa.net.internet2.edu,et-7/3/0.0 VLAN=3741', 'code': {'geni_code': 24}}
09:48:49 WARNING : Stitching failed but will retry: Circuit reservation failed at <Aggregate al2s>. Try again from the SCS. (Error: Topology too complex for local redo - ask Stitching Service to find a VLAN tag (AMAPIError: Error from Aggregate: code 24: Exception: requested VLAN unavailable: rtsw.newy32aoa.net.internet2.edu,et-7/3/0.0 VLAN=3741.))
09:48:49 INFO    : Deleting existing reservations...
09:48:49 INFO    : Doing deletesliver at <Aggregate fiu-eg>...
09:48:51 INFO    : Deleted reservation at <Aggregate fiu-eg>.
09:48:51 INFO    : Doing deletesliver at <Aggregate gpo-eg>...
09:48:54 INFO    : Deleted reservation at <Aggregate gpo-eg>.
09:48:54 INFO    : Calling SCS for the 2nd time...
09:48:55 INFO    : Pausing for 30 seconds for Aggregates to free up resources...


09:49:25 INFO    : Multi-AM reservation will include resources from these aggregates:
09:49:25 INFO    : 	<Aggregate fiu-eg>
09:49:25 INFO    : 	<Aggregate al2s>
09:49:25 INFO    : 	<Aggregate gpo-eg>
09:49:25 INFO    : Stitcher doing createsliver at <Aggregate fiu-eg>...
09:49:33 INFO    : ... Allocation at <Aggregate fiu-eg> complete.
09:49:33 INFO    : Stitcher doing createsliver at <Aggregate gpo-eg>...
09:49:43 INFO    : ... Allocation at <Aggregate gpo-eg> complete.
09:49:43 INFO    : Stitcher doing createsliver at <Aggregate al2s>...
09:49:45 ERROR   :  {'output': 'Exception: requested VLAN unavailable: rtsw.newy32aoa.net.internet2.edu,et-7/3/0.0 VLAN=3738', 'code': {'geni_code': 24}}
09:49:45 WARNING : Stitching failed but will retry: Circuit reservation failed at <Aggregate al2s>. Try again from the SCS. (Error: Topology too complex for local redo - ask Stitching Service to find a VLAN tag (AMAPIError: Error from Aggregate: code 24: Exception: requested VLAN unavailable: rtsw.newy32aoa.net.internet2.edu,et-7/3/0.0 VLAN=3738.))
09:49:45 INFO    : Deleting existing reservations...
09:49:45 INFO    : Doing deletesliver at <Aggregate fiu-eg>...
09:49:48 INFO    : Deleted reservation at <Aggregate fiu-eg>.
09:49:48 INFO    : Doing deletesliver at <Aggregate gpo-eg>...
09:49:51 INFO    : Deleted reservation at <Aggregate gpo-eg>.
09:49:51 INFO    : Calling SCS for the 3rd time...
09:49:51 INFO    : Pausing for 30 seconds for Aggregates to free up resources...


09:50:21 INFO    : Multi-AM reservation will include resources from these aggregates:
09:50:21 INFO    : 	<Aggregate fiu-eg>
09:50:21 INFO    : 	<Aggregate al2s>
09:50:21 INFO    : 	<Aggregate gpo-eg>
09:50:21 INFO    : Stitcher doing createsliver at <Aggregate fiu-eg>...
09:50:30 INFO    : ... Allocation at <Aggregate fiu-eg> complete.
09:50:30 INFO    : Stitcher doing createsliver at <Aggregate gpo-eg>...
09:50:39 INFO    : ... Allocation at <Aggregate gpo-eg> complete.
09:50:39 INFO    : Stitcher doing createsliver at <Aggregate al2s>...
09:50:48 INFO    : ... Allocation at <Aggregate al2s> complete.
09:50:48 INFO    : All aggregates are complete.
09:50:48 INFO    : Your resources expire at 2017-05-02T13:40:21 (UTC). 
09:50:48 INFO    : Saved combined reservation RSpec at 3 AM(s) to file '/home/lnevers/gcf-test/stitch-test/FIU/EG-ST-4-manifest-rspec-multiam-combined.xml'
Success: Reserved resources in slice EG-ST-4 at 3 Aggregates (including 1 intermediate aggregate(s) not in the original request), creating 1 stitched link(s).

Determined login information at each FIU and GPO aggregate:

$ readyToLogin.py EG-ST-4 --useSliceAggregates

eg-gpo's geni_status is: ready 
User lnevers logs in to eg-gpo using:
	ssh -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@192.1.242.31

eg-fiu's geni_status is: ready 
User lnevers logs in to eg-fiu using:
	ssh -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@131.94.144.41

Measurements

Iperf ExoGENI GPO VM to ExoGENI FIU VM (TCP) - TCP window size: 85.0 KByte (default)

Collected: 2017-04-26

One Client_

[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-60.0 sec   556 MBytes  77.7 Mbits/sec

Five Clients

[ ID] Interval       Transfer     Bandwidth
[  6]  0.0-60.0 sec   237 MBytes  33.1 Mbits/sec
[  7]  0.0-60.0 sec  68.4 MBytes  9.56 Mbits/sec
[  5]  0.0-60.1 sec   184 MBytes  25.8 Mbits/sec
[  3]  0.0-60.1 sec  94.4 MBytes  13.2 Mbits/sec
[  4]  0.0-60.2 sec   105 MBytes  14.6 Mbits/sec
[SUM]  0.0-60.2 sec   689 MBytes  96.0 Mbits/sec

Ten Clients

[ ID] Interval       Transfer     Bandwidth
[ 12]  0.0-60.0 sec  69.4 MBytes  9.70 Mbits/sec
[  9]  0.0-60.0 sec  65.0 MBytes  9.08 Mbits/sec
[  7]  0.0-60.1 sec  72.8 MBytes  10.2 Mbits/sec
[  3]  0.0-60.1 sec  41.0 MBytes  5.72 Mbits/sec
[  5]  0.0-60.2 sec  61.1 MBytes  8.52 Mbits/sec
[  8]  0.0-60.2 sec  64.5 MBytes  8.98 Mbits/sec
[  6]  0.0-60.3 sec  98.5 MBytes  13.7 Mbits/sec
[ 11]  0.0-60.4 sec  58.0 MBytes  8.06 Mbits/sec
[ 10]  0.0-60.4 sec  84.4 MBytes  11.7 Mbits/sec
[  4]  0.0-60.4 sec  82.2 MBytes  11.4 Mbits/sec
[SUM]  0.0-60.4 sec   697 MBytes  96.8 Mbits/sec

Iperf ExoGENI GPO VM to ExoGENI FIU VM (UDP) - UDP buffer size: 208 KByte (default)

[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-60.0 sec   719 MBytes   101 Mbits/sec
[  3] Sent 512821 datagrams
[  3] Server Report:
[  3]  0.0-60.0 sec   700 MBytes  97.9 Mbits/sec   0.010 ms 13369/512820 (2.6%)
[  3]  0.0-60.0 sec  1 datagrams received out-of-order

Ping from ExoGENI GPO VM to the ExoGENI FIU VM

60 packets transmitted, 60 received, 0% packet loss, time 59093ms
rtt min/avg/max/mdev = 37.339/37.466/37.778/0.216 ms

Iperf ExoGENI FIU VM to ExoGENI GPO VM (TCP) - TCP window size: 85.0 KByte (default)

Collected: 2017-04-26

One Client_

[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-60.0 sec   555 MBytes  77.5 Mbits/sec

Five Clients

[ ID] Interval       Transfer     Bandwidth
[  7]  0.0-60.0 sec   226 MBytes  31.6 Mbits/sec
[  4]  0.0-60.1 sec   152 MBytes  21.3 Mbits/sec
[  6]  0.0-60.1 sec  61.4 MBytes  8.57 Mbits/sec
[  3]  0.0-60.1 sec  88.2 MBytes  12.3 Mbits/sec
[  5]  0.0-60.2 sec   176 MBytes  24.5 Mbits/sec
[SUM]  0.0-60.2 sec   704 MBytes  98.1 Mbits/sec

Ten Clients

[ ID] Interval       Transfer     Bandwidth
[  7]  0.0-60.0 sec  65.8 MBytes  9.19 Mbits/sec
[ 10]  0.0-60.1 sec  84.4 MBytes  11.8 Mbits/sec
[  9]  0.0-60.1 sec  47.8 MBytes  6.66 Mbits/sec
[  6]  0.0-60.2 sec   126 MBytes  17.6 Mbits/sec
[ 11]  0.0-60.2 sec  64.2 MBytes  8.95 Mbits/sec
[  8]  0.0-60.3 sec  43.9 MBytes  6.10 Mbits/sec
[  4]  0.0-60.3 sec  97.4 MBytes  13.5 Mbits/sec
[  3]  0.0-60.4 sec  61.8 MBytes  8.58 Mbits/sec
[  5]  0.0-60.5 sec  45.9 MBytes  6.36 Mbits/sec
[ 12]  0.0-60.7 sec  59.4 MBytes  8.20 Mbits/sec
[SUM]  0.0-60.7 sec   697 MBytes  96.3 Mbits/sec

Iperf ExoGENI FIU VM to ExoGENI GPO VM (UDP) - UDP buffer size: 208 KByte (default)

[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-60.0 sec   719 MBytes   101 Mbits/sec
[  3] Sent 512821 datagrams
[  3] Server Report:
[  3]  0.0-60.0 sec   704 MBytes  98.4 Mbits/sec   0.015 ms 10838/512820 (2.1%)
[  3]  0.0-60.0 sec  1 datagrams received out-of-order

Ping from ExoGENI FIU VM to ExoGENI GPO VM

60 packets transmitted, 60 received, 0% packet loss, time 59080ms
rtt min/avg/max/mdev = 37.216/37.570/41.856/0.696 ms