wiki:GeniNetworkStitchingConfirmationTestStatus/Stanford

Version 17 (modified by lnevers@bbn.com, 10 years ago) (diff)

--

Stanford University Stitching Confirmation Tests

This pages capture the detailed test logs for each test defined in the New Site Stitching Confirmation Tests page. For the sites status see the New Site Stitching Confirmation Tests Status page.

IG-ST-1 New Site to GPO IG topology

The Stanford site advertises the following stitching details:

  <stitching lastUpdateTime="2014-01-29T19:10:48Z" xmlns="http://hpn.east.isi.edu/rspec/ext/stitch/0.1/">    
    <aggregate id="urn:publicid:IDN+instageni.stanford.edu+authority+cm" url="https://www.instageni.stanford.edu:12369/protogeni/xmlrpc/am">      
      <aggregatetype>        protogeni      </aggregatetype>      
      <stitchingmode>        chainANDTree      </stitchingmode>      
      <scheduledservices>        false      </scheduledservices>      
      <negotiatedservices>        false      </negotiatedservices>      
      <lifetime id="life">        
            <start type="time">          2014-01-29T19:10:48Z        </start>        
            <end type="time">          2014-01-29T19:10:48Z        </end>        
      </lifetime>      
      <node id="urn:publicid:IDN+instageni.stanford.edu+node+procurve2">        
          <port id="urn:publicid:IDN+instageni.stanford.edu+stitchport+procurve2:1.24.ion.salt.xe-0_1_1">          
              <capacity>            1000000          </capacity>          
              <maximumReservableCapacity>            1000000          </maximumReservableCapacity>          
              <minimumReservableCapacity>            1000          </minimumReservableCapacity>          
              <granularity>            1          </granularity>          
              <link id="urn:publicid:IDN+instageni.stanford.edu+interface+procurve2:1.24.ion.salt.xe-0_1_1">            
                  <remoteLinkId> urn:publicid:IDN+ion.internet2.edu+interface+rtr.salt:xe-0/1/1:stanford-ig </remoteLinkId>            
                  <trafficEngineeringMetric>              10            </trafficEngineeringMetric>            
                  <capacity>              1000000            </capacity>            
                  <maximumReservableCapacity>              1000000         </maximumReservableCapacity>            
                  <minimumReservableCapacity>              1000            </minimumReservableCapacity>            
                  <granularity>              1            </granularity>            
                  <switchingCapabilityDescriptor>              
                     <switchingcapType>                l2sc              </switchingcapType>              
                     <encodingType>                ethernet              </encodingType>              
                     <switchingCapabilitySpecificInfo>                
                        <switchingCapabilitySpecificInfo_L2sc>                  
                           <interfaceMTU>                    9000                  </interfaceMTU>                  
                           <vlanRangeAvailability>          1630-1639              </vlanRangeAvailability>                  
                           <vlanTranslation>                    false              </vlanTranslation>                  
                        </switchingCapabilitySpecificInfo_L2sc>                
                     </switchingCapabilitySpecificInfo>              
                  </switchingCapabilityDescriptor>            
              </link>          
          </port>        
      </node>      
    </aggregate>    
  </stitching>  

Experimenter may not need any of this data, but it is helpful to reference when trying to determine how many VLANs are delegated for stitching at the site or how much bandwidth can be requested.

Create a slice and then create the stitched slivers with the RSpec IG-ST-1-ion.rspec:

$ omni.py createslice IG-ST-1
12:36:03 INFO     omni: Loading agg_nick_cache file '/home/lnevers/.gcf/agg_nick_cache'
12:36:03 INFO     omni: Loading config file /home/lnevers/.gcf/omni_config
12:36:03 INFO     omni: Using control framework portal
12:36:04 INFO     omni: Created slice with Name IG-ST-1, URN urn:publicid:IDN+ch.geni.net:ln-prj+slice+IG-ST-1, Expiration 2014-02-13 17:36:04
12:36:04 INFO     omni:  ------------------------------------------------------
12:36:04 INFO     omni:  Completed createslice:
Args: createslice IG-ST-1
  Result Summary: Created slice with Name IG-ST-1, URN urn:publicid:IDN+ch.geni.net:ln-prj+slice+IG-ST-1, Expiration 2014-02-13 17:36:04 
12:36:04 INFO     omni:  ======================================================

$ stitcher.py createsliver IG-ST-1 IG-ST-1-ion.rspec -o
12:36:14 INFO     stitcher: Loading agg_nick_cache file '/home/lnevers/.gcf/agg_nick_cache'
12:36:14 INFO     stitcher: Loading config file /home/lnevers/.gcf/omni_config
12:36:14 INFO     stitcher: Using control framework portal
12:36:15 INFO     stitcher: Checking that slice IG-ST-1 is valid...
12:36:15 INFO     stitcher: Slice urn:publicid:IDN+ch.geni.net:ln-prj+slice+IG-ST-1 expires on 2014-02-13 17:36:04 UTC
12:36:19 INFO     stitcher: Stitched reservation will include resources from these aggregates:
12:36:19 INFO     stitcher: 	<Aggregate urn:publicid:IDN+instageni.stanford.edu+authority+cm>
12:36:19 INFO     stitcher: 	<Aggregate urn:publicid:IDN+instageni.gpolab.bbn.com+authority+cm>
12:36:19 INFO     stitcher: 	<Aggregate urn:publicid:IDN+ion.internet2.edu+authority+am>
12:36:19 INFO     stitch.Aggregate: Writing to '/tmp/IG-ST-1-createsliver-request-11-instageni-stanford-edu.xml'
12:36:19 INFO     stitch.Aggregate: 
	Stitcher doing createsliver at https://www.instageni.stanford.edu:12369/protogeni/xmlrpc/am
12:36:36 INFO     stitch.Aggregate: Allocation at <Aggregate urn:publicid:IDN+instageni.stanford.edu+authority+cm> complete.
12:36:36 INFO     stitch.Aggregate: Writing to '/tmp/IG-ST-1-createsliver-request-11-instageni-gpolab-bbn-com.xml'
12:36:36 INFO     stitch.Aggregate: 
	Stitcher doing createsliver at https://boss.instageni.gpolab.bbn.com:12369/protogeni/xmlrpc/am
12:36:52 INFO     stitch.Aggregate: Allocation at <Aggregate urn:publicid:IDN+instageni.gpolab.bbn.com+authority+cm> complete.
12:36:52 INFO     stitch.Aggregate: Writing to '/tmp/IG-ST-1-createsliver-request-11-ion-internet2-edu.xml'
12:36:52 INFO     stitch.Aggregate: 
	Stitcher doing createsliver at http://geni-am.net.internet2.edu:12346
12:37:36 INFO     stitch.Aggregate: DCN AM <Aggregate urn:publicid:IDN+ion.internet2.edu+authority+am>: must wait for status ready....
12:37:36 INFO     stitch.Aggregate: Pause 30 seconds to let circuit become ready...
12:38:14 INFO     stitch.Aggregate: Pause 30 seconds to let circuit become ready...
12:38:50 INFO     stitch.Aggregate: DCN circuit 64111 is ready
12:38:57 INFO     stitch.Aggregate: Allocation at <Aggregate urn:publicid:IDN+ion.internet2.edu+authority+am> complete.
12:38:57 INFO     stitch.launcher: All aggregates are complete.
12:38:57 INFO     stitcher: Writing to 'IG-ST-1-manifest-rspec-stitching-combined.xml'
12:38:57 INFO     stitcher: Saved combined reservation RSpec at 3 AMs to file IG-ST-1-manifest-rspec-stitching-combined.xml
Stitching success: Reserved resources in slice IG-ST-1 at 3 Aggregates (including 1 intermediate aggregate(s) not in the original request), creating 1 link(s).

Determined login information at each Stanford and GPO aggregate:

$ readyToLogin.py IG-ST-1 -a stanford-ig
  ....
================================================================================
LOGIN INFO for AM: https://instageni.stanford.edu:12369/protogeni/xmlrpc/am
================================================================================

For more login info, see the section entitled:
	 'Providing a private key to ssh' in 'readyToLogin.py -h'

ig-stan's geni_status is: ready (am_status:ready) 
User lnevers logs in to ig-stan using:
	ssh -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@pc4.instageni.stanford.edu

$ readyToLogin.py IG-ST-1 -a gpo-ig
  ....
================================================================================
LOGIN INFO for AM: https://boss.instageni.gpolab.bbn.com:12369/protogeni/xmlrpc/am/2.0
================================================================================

For more login info, see the section entitled:
	 'Providing a private key to ssh' in 'readyToLogin.py -h'

ig-gpo's geni_status is: ready (am_status:ready) 
User lnevers logs in to ig-gpo using:
	ssh -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@pc3.instageni.gpolab.bbn.com

Measurements

Iperf InstaGENI GPO VM to InstaGENI Stanford VM (TCP) - TCP window size: 16.0 KByte (default)

Collected: 2014-02-06

One Client_

[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-60.0 sec   356 MBytes  49.7 Mbits/sec

Five Clients

[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-60.0 sec   143 MBytes  19.9 Mbits/sec
[  4]  0.0-60.0 sec   156 MBytes  21.9 Mbits/sec
[  5]  0.0-60.2 sec   134 MBytes  18.7 Mbits/sec
[  7]  0.0-60.2 sec   136 MBytes  19.0 Mbits/sec
[  6]  0.0-60.2 sec   135 MBytes  18.8 Mbits/sec
[SUM]  0.0-60.2 sec   704 MBytes  98.2 Mbits/sec

Ten Clients

[ ID] Interval       Transfer     Bandwidth
[  6]  0.0-60.0 sec  54.0 MBytes  7.54 Mbits/sec
[ 11]  0.0-60.1 sec  81.9 MBytes  11.4 Mbits/sec
[  5]  0.0-60.1 sec  81.0 MBytes  11.3 Mbits/sec
[  4]  0.0-60.2 sec  81.0 MBytes  11.3 Mbits/sec
[  9]  0.0-60.2 sec  78.1 MBytes  10.9 Mbits/sec
[  7]  0.0-60.3 sec  76.8 MBytes  10.7 Mbits/sec
[ 10]  0.0-60.3 sec  70.1 MBytes  9.75 Mbits/sec
[  8]  0.0-60.4 sec  53.9 MBytes  7.49 Mbits/sec
[  3]  0.0-60.4 sec  54.6 MBytes  7.58 Mbits/sec
[ 12]  0.0-60.5 sec  83.8 MBytes  11.6 Mbits/sec
[SUM]  0.0-60.5 sec   715 MBytes  99.2 Mbits/sec

Iperf InstaGENI GPO VM to InstaGENI Stanford VM (UDP) - UDP buffer size: 114 KByte (default)

[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-60.0 sec   719 MBytes   101 Mbits/sec
[  3] Sent 512821 datagrams
[  3] Server Report:
[  3]  0.0-59.9 sec   698 MBytes  97.7 Mbits/sec   0.021 ms 14981/512820 (2.9%)
[  3]  0.0-59.9 sec  2 datagrams received out-of-order

Ping from InstaGENI GPO VM to the InstaGENI Stanford VM

60 packets transmitted, 60 received, 0% packet loss, time 59077ms
rtt min/avg/max/mdev = 100.221/100.262/100.383/0.357 ms

Iperf InstaGENI Stanford VM to GPO InstaGENI VM (TCP) - TCP window size: 16.0 KByte (default)

Collected: 2014-02-06

One Client_

[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-60.0 sec   349 MBytes  48.7 Mbits/sec

Five Clients

[ ID] Interval       Transfer     Bandwidth
[  7]  0.0-60.0 sec   137 MBytes  19.1 Mbits/sec
[  6]  0.0-60.1 sec   146 MBytes  20.4 Mbits/sec
[  4]  0.0-60.1 sec   145 MBytes  20.3 Mbits/sec
[  3]  0.0-60.1 sec   139 MBytes  19.3 Mbits/sec
[  5]  0.0-60.2 sec   139 MBytes  19.3 Mbits/sec
[SUM]  0.0-60.2 sec   705 MBytes  98.3 Mbits/sec

Ten Clients

[ ID] Interval       Transfer     Bandwidth
[  4]  0.0-60.0 sec  78.2 MBytes  10.9 Mbits/sec
[ 10]  0.0-60.1 sec  80.9 MBytes  11.3 Mbits/sec
[  3]  0.0-60.1 sec  78.5 MBytes  11.0 Mbits/sec
[  8]  0.0-60.1 sec  77.2 MBytes  10.8 Mbits/sec
[ 11]  0.0-60.1 sec  74.8 MBytes  10.4 Mbits/sec
[  5]  0.0-60.2 sec  53.4 MBytes  7.44 Mbits/sec
[  7]  0.0-60.3 sec  53.8 MBytes  7.48 Mbits/sec
[ 12]  0.0-60.3 sec  54.0 MBytes  7.51 Mbits/sec
[  6]  0.0-60.4 sec  84.2 MBytes  11.7 Mbits/sec
[  9]  0.0-60.4 sec  77.8 MBytes  10.8 Mbits/sec
[SUM]  0.0-60.4 sec   713 MBytes  98.9 Mbits/sec

Iperf InstaGENI Stanford VM to GPO InstaGENI VM (UDP) - UDP buffer size: 114 KByte (default)

[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-60.0 sec   719 MBytes   101 Mbits/sec
[  3] Sent 512821 datagrams
[  3] Server Report:
[  3]  0.0-59.9 sec   700 MBytes  98.0 Mbits/sec   0.096 ms 13684/512820 (2.7%)
[  3]  0.0-59.9 sec  2 datagrams received out-of-order

Ping from InstaGENI Stanford VM to GPO InstaGENI VM

60 packets transmitted, 60 received, 0% packet loss, time 59086ms
rtt min/avg/max/mdev = 100.234/100.265/100.319/0.370 ms

IG-ST-2 New Site to GPO IG Loop topology

Create a slice and then create the stitched slivers with the RSpec IG-ST-2.rspec:

$ omni.py createslice IG-ST-2
10:22:07 INFO     omni: Loading agg_nick_cache file '/home/lnevers/.gcf/agg_nick_cache'
10:22:07 INFO     omni: Loading config file /home/lnevers/.gcf/omni_config
10:22:07 INFO     omni: Using control framework portal
10:22:08 INFO     omni: Created slice with Name IG-ST-2, URN urn:publicid:IDN+ch.geni.net:ln-prj+slice+IG-ST-2, Expiration 2014-02-05 19:19:45
10:22:08 INFO     omni:  ------------------------------------------------------
10:22:08 INFO     omni:  Completed createslice:
Args: createslice IG-ST-2
  Result Summary: Created slice with Name IG-ST-2, URN urn:publicid:IDN+ch.geni.net:ln-prj+slice+IG-ST-2, Expiration 2014-02-05 19:19:45
10:22:08 INFO     omni:  ======================================================

$ stitcher.py createsliver IG-ST-2 IG-ST-2.rspec -o
10:25:50 INFO     stitcher: Loading agg_nick_cache file '/home/lnevers/.gcf/agg_nick_cache'
10:25:50 INFO     stitcher: Loading config file /home/lnevers/.gcf/omni_config
10:25:50 INFO     stitcher: Using control framework portal
10:25:51 INFO     stitcher: Checking that slice IG-ST-2 is valid...
10:25:51 INFO     stitcher: Slice urn:publicid:IDN+ch.geni.net:ln-prj+slice+IG-ST-2 expires on 2014-02-05 19:19:45 UTC
10:25:52 INFO     stitcher: <Aggregate urn:publicid:IDN+instageni.stanford.edu+authority+cm> speaks AM API v3, but sticking with v2
10:25:53 INFO     stitcher: <Aggregate urn:publicid:IDN+instageni.gpolab.bbn.com+authority+cm> speaks AM API v3, but sticking with v2
10:25:53 INFO     stitcher: Stitched reservation will include resources from these aggregates:
10:25:53 INFO     stitcher: 	<Aggregate urn:publicid:IDN+instageni.stanford.edu+authority+cm>
10:25:53 INFO     stitcher: 	<Aggregate urn:publicid:IDN+instageni.gpolab.bbn.com+authority+cm>
10:25:53 INFO     stitcher: 	<Aggregate urn:publicid:IDN+ion.internet2.edu+authority+am>
10:25:53 INFO     stitch.Aggregate: Writing to '/tmp/IG-ST-2-createsliver-request-11-instageni-stanford-edu.xml'
10:25:53 INFO     stitch.Aggregate: 
	Stitcher doing createsliver at https://www.instageni.stanford.edu:12369/protogeni/xmlrpc/am
10:26:11 INFO     stitch.Aggregate: Allocation at <Aggregate urn:publicid:IDN+instageni.stanford.edu+authority+cm> complete.
10:26:11 INFO     stitch.Aggregate: Writing to '/tmp/IG-ST-2-createsliver-request-11-instageni-gpolab-bbn-com.xml'
10:26:11 INFO     stitch.Aggregate: 
	Stitcher doing createsliver at https://boss.instageni.gpolab.bbn.com:12369/protogeni/xmlrpc/am
10:26:24 ERROR    omni:  {'output': "vlan tag 3732 for 'link1' not available", 'code': {'protogeni_error_log': 'urn:publicid:IDN+instageni.gpolab.bbn.com+log+0d50801c0811b792b7188f35fb5a91ac', 'am_type': 'protogeni', 'geni_code': 1, 'am_code': 1, 'protogeni_error_url': 'https://boss.instageni.gpolab.bbn.com/spewlogfile.php3?logfile=0d50801c0811b792b7188f35fb5a91ac'}, 'value': 0}
10:26:24 INFO     stitch.Aggregate: Got AMAPIError doing createsliver IG-ST-2 at <Aggregate urn:publicid:IDN+instageni.gpolab.bbn.com+authority+cm>: AMAPIError: Error from Aggregate: code 1. protogeni AM code: 1: vlan tag 3732 for 'link1' not available.
10:26:24 INFO     stitch.launcher: Will put <Aggregate urn:publicid:IDN+instageni.gpolab.bbn.com+authority+cm> back in the pool to allocate. Got Retry <Aggregate urn:publicid:IDN+instageni.gpolab.bbn.com+authority+cm> 2th time with <Hop u'urn:publicid:IDN+instageni.gpolab.bbn.com+interface+procurve2:5.24.ion.newy.ae0' on path u'link1'> new suggested 3720 (not 3732)
10:26:24 INFO     stitch.launcher: Pausing for 30 seconds for Aggregates to free up resources...


10:26:54 INFO     stitch.Aggregate: Writing to '/tmp/IG-ST-2-createsliver-request-12-instageni-gpolab-bbn-com.xml'
10:26:54 INFO     stitch.Aggregate: 
	Stitcher doing createsliver at https://boss.instageni.gpolab.bbn.com:12369/protogeni/xmlrpc/am
10:27:06 ERROR    omni:  {'output': "vlan tag 3720 for 'link1' not available", 'code': {'protogeni_error_log': 'urn:publicid:IDN+instageni.gpolab.bbn.com+log+1311eea9d7985b88d6c4e61a3ca82dcd', 'am_type': 'protogeni', 'geni_code': 1, 'am_code': 1, 'protogeni_error_url': 'https://boss.instageni.gpolab.bbn.com/spewlogfile.php3?logfile=1311eea9d7985b88d6c4e61a3ca82dcd'}, 'value': 0}
10:27:06 INFO     stitch.Aggregate: Got AMAPIError doing createsliver IG-ST-2 at <Aggregate urn:publicid:IDN+instageni.gpolab.bbn.com+authority+cm>: AMAPIError: Error from Aggregate: code 1. protogeni AM code: 1: vlan tag 3720 for 'link1' not available.
10:27:06 INFO     stitch.launcher: Will put <Aggregate urn:publicid:IDN+instageni.gpolab.bbn.com+authority+cm> back in the pool to allocate. Got Retry <Aggregate urn:publicid:IDN+instageni.gpolab.bbn.com+authority+cm> 3th time with <Hop u'urn:publicid:IDN+instageni.gpolab.bbn.com+interface+procurve2:5.24.ion.newy.ae0' on path u'link1'> new suggested 3718 (not 3720)
10:27:06 INFO     stitch.launcher: Pausing for 30 seconds for Aggregates to free up resources...


10:27:36 INFO     stitch.Aggregate: Writing to '/tmp/IG-ST-2-createsliver-request-13-instageni-gpolab-bbn-com.xml'
10:27:36 INFO     stitch.Aggregate: 
	Stitcher doing createsliver at https://boss.instageni.gpolab.bbn.com:12369/protogeni/xmlrpc/am
10:27:51 INFO     stitch.Aggregate: Allocation at <Aggregate urn:publicid:IDN+instageni.gpolab.bbn.com+authority+cm> complete.
10:27:51 INFO     stitch.Aggregate: Writing to '/tmp/IG-ST-2-createsliver-request-11-ion-internet2-edu.xml'
10:27:51 INFO     stitch.Aggregate: 
	Stitcher doing createsliver at http://geni-am.net.internet2.edu:12346
10:28:34 INFO     stitch.Aggregate: DCN AM <Aggregate urn:publicid:IDN+ion.internet2.edu+authority+am>: must wait for status ready....
10:28:34 INFO     stitch.Aggregate: Pause 30 seconds to let circuit become ready...
10:29:11 INFO     stitch.Aggregate: Pause 30 seconds to let circuit become ready...
10:29:48 INFO     stitch.Aggregate: DCN circuit 62651 is ready
10:29:48 INFO     stitch.Aggregate: DCN circuit 62641 is ready
10:29:55 INFO     stitch.Aggregate: Allocation at <Aggregate urn:publicid:IDN+ion.internet2.edu+authority+am> complete.
10:29:55 INFO     stitch.launcher: All aggregates are complete.
10:29:55 INFO     stitcher: Writing to 'IG-ST-2-manifest-rspec-stitching-combined.xml'
10:29:55 INFO     stitcher: Saved combined reservation RSpec at 3 AMs to file IG-ST-2-manifest-rspec-stitching-combined.xml
Stitching success: Reserved resources in slice IG-ST-2 at 3 Aggregates (including 1 intermediate aggregate(s) not in the original request), creating 2 link(s).

Determined login information at each Stanford and GPO aggregate:

$ readyToLogin.py IG-ST-2 -a stanford-ig
  ....
================================================================================
LOGIN INFO for AM: https://instageni.stanford.edu:12369/protogeni/xmlrpc/am
================================================================================

For more login info, see the section entitled:
	 'Providing a private key to ssh' in 'readyToLogin.py -h'

ig-stan's geni_status is: ready (am_status:ready) 
User lnevers logs in to ig-stan using:
	ssh -p 32314  -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@pc1.instageni.stanford.edu

$ readyToLogin.py IG-ST-2 -a gpo-ig
  ....
================================================================================
LOGIN INFO for AM: https://boss.instageni.gpolab.bbn.com:12369/protogeni/xmlrpc/am/2.0
================================================================================

For more login info, see the section entitled:
	 'Providing a private key to ssh' in 'readyToLogin.py -h'

ig-gpo's geni_status is: ready (am_status:ready) 
User lnevers logs in to ig-gpo using:
	ssh -p 32058  -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@pc1.instageni.gpolab.bbn.com

Login to each host and ping the remote on each of the two interfaces. Below is the ping output for the GPO site:

[lnevers@ig-gpo ~]$ ping 10.10.4.2 -c 60 -q
PING 10.10.4.2 (10.10.4.2) 56(84) bytes of data.

--- 10.10.4.2 ping statistics ---
60 packets transmitted, 60 received, 0% packet loss, time 59069ms
rtt min/avg/max/mdev = 100.232/100.317/100.480/0.035 ms
[lnevers@ig-gpo ~]$ ping 192.168.4.2 -c 60 -q
PING 192.168.4.2 (192.168.4.2) 56(84) bytes of data.

--- 192.168.4.2 ping statistics ---
60 packets transmitted, 60 received, 0% packet loss, time 59077ms
rtt min/avg/max/mdev = 100.261/100.347/100.518/0.414 ms

IG-ST-3 IG-ST-3 New Site 3 node linear topology

Create a slice and then create the stitched slivers with the RSPec IG-ST-3.rspec:

$ omni.py createslice IG-ST-3
10:42:49 INFO     omni: Loading agg_nick_cache file '/home/lnevers/.gcf/agg_nick_cache'
10:42:49 INFO     omni: Loading config file /home/lnevers/.gcf/omni_config
10:42:49 INFO     omni: Using control framework portal
10:42:49 INFO     omni: Created slice with Name IG-ST-3, URN urn:publicid:IDN+ch.geni.net:ln-prj+slice+IG-ST-3, Expiration 2014-02-10 15:42:49
10:42:49 INFO     omni:  ------------------------------------------------------
10:42:49 INFO     omni:  Completed createslice:
Args: createslice IG-ST-3
  Result Summary: Created slice with Name IG-ST-3, URN urn:publicid:IDN+ch.geni.net:ln-prj+slice+IG-ST-3, Expiration 2014-02-10 15:42:49
10:42:49 INFO     omni:  ======================================================

$ stitcher.py createsliver IG-ST-3 IG-ST-3.rspec -o
10:57:29 INFO     stitcher: Loading agg_nick_cache file '/home/lnevers/.gcf/agg_nick_cache'
10:57:29 INFO     stitcher: Loading config file /home/lnevers/.gcf/omni_config
10:57:29 INFO     stitcher: Using control framework portal
10:57:29 INFO     stitcher: Checking that slice IG-ST-3 is valid...
10:57:30 INFO     stitcher: Slice urn:publicid:IDN+ch.geni.net:ln-prj+slice+IG-ST-3 expires on 2014-02-10 15:42:49 UTC
10:57:31 INFO     stitcher: <Aggregate urn:publicid:IDN+instageni.stanford.edu+authority+cm> speaks AM API v3, but sticking with v2
10:57:32 INFO     stitcher: <Aggregate urn:publicid:IDN+instageni.gpolab.bbn.com+authority+cm> speaks AM API v3, but sticking with v2
10:57:32 INFO     stitcher: <Aggregate urn:publicid:IDN+emulab.net+authority+cm> speaks AM API v3, but sticking with v2
10:57:33 INFO     stitcher: <Aggregate urn:publicid:IDN+utah.geniracks.net+authority+cm> speaks AM API v3, but sticking with v2
10:57:33 INFO     stitcher: Stitched reservation will include resources from these aggregates:
10:57:33 INFO     stitcher: 	<Aggregate urn:publicid:IDN+instageni.stanford.edu+authority+cm>
10:57:33 INFO     stitcher: 	<Aggregate urn:publicid:IDN+ion.internet2.edu+authority+am>
10:57:33 INFO     stitcher: 	<Aggregate urn:publicid:IDN+instageni.gpolab.bbn.com+authority+cm>
10:57:33 INFO     stitcher: 	<Aggregate urn:publicid:IDN+emulab.net+authority+cm>
10:57:33 INFO     stitcher: 	<Aggregate urn:publicid:IDN+utah.geniracks.net+authority+cm>
10:57:33 INFO     stitch.Aggregate: Writing to '/tmp/IG-ST-3-createsliver-request-11-instageni-stanford-edu.xml'
10:57:33 INFO     stitch.Aggregate: 
	Stitcher doing createsliver at https://www.instageni.stanford.edu:12369/protogeni/xmlrpc/am
10:57:50 INFO     stitch.Aggregate: Allocation at <Aggregate urn:publicid:IDN+instageni.stanford.edu+authority+cm> complete.
10:57:50 INFO     stitch.Aggregate: Writing to '/tmp/IG-ST-3-createsliver-request-11-instageni-gpolab-bbn-com.xml'
10:57:50 INFO     stitch.Aggregate: 
	Stitcher doing createsliver at https://boss.instageni.gpolab.bbn.com:12369/protogeni/xmlrpc/am
10:58:02 ERROR    omni:  {'output': "vlan tag 3732 for 'link' not available", 'code': {'protogeni_error_log': 'urn:publicid:IDN+instageni.gpolab.bbn.com+log+c8dc55c495fda95badf634eb36be236b', 'am_type': 'protogeni', 'geni_code': 1, 'am_code': 1, 'protogeni_error_url': 'https://boss.instageni.gpolab.bbn.com/spewlogfile.php3?logfile=c8dc55c495fda95badf634eb36be236b'}, 'value': 0}
10:58:02 INFO     stitch.Aggregate: Got AMAPIError doing createsliver IG-ST-3 at <Aggregate urn:publicid:IDN+instageni.gpolab.bbn.com+authority+cm>: AMAPIError: Error from Aggregate: code 1. protogeni AM code: 1: vlan tag 3732 for 'link' not available.
10:58:02 INFO     stitch.launcher: Will put <Aggregate urn:publicid:IDN+instageni.gpolab.bbn.com+authority+cm> back in the pool to allocate. Got Retry <Aggregate urn:publicid:IDN+instageni.gpolab.bbn.com+authority+cm> 2th time with <Hop u'urn:publicid:IDN+instageni.gpolab.bbn.com+interface+procurve2:5.24.ion.newy.ae0' on path u'link'> new suggested 3748 (not 3732)
10:58:02 INFO     stitch.launcher: Pausing for 30 seconds for Aggregates to free up resources...


10:58:32 INFO     stitch.Aggregate: Writing to '/tmp/IG-ST-3-createsliver-request-11-emulab-net.xml'
10:58:32 INFO     stitch.Aggregate: 
	Stitcher doing createsliver at https://www.emulab.net:12369/protogeni/xmlrpc/am
10:59:20 INFO     stitch.Aggregate: Allocation at <Aggregate urn:publicid:IDN+emulab.net+authority+cm> complete.
10:59:20 INFO     stitch.Aggregate: Writing to '/tmp/IG-ST-3-createsliver-request-12-instageni-gpolab-bbn-com.xml'
10:59:20 INFO     stitch.Aggregate: 
	Stitcher doing createsliver at https://boss.instageni.gpolab.bbn.com:12369/protogeni/xmlrpc/am
10:59:34 INFO     stitch.Aggregate: Allocation at <Aggregate urn:publicid:IDN+instageni.gpolab.bbn.com+authority+cm> complete.
10:59:34 INFO     stitch.Aggregate: Writing to '/tmp/IG-ST-3-createsliver-request-11-utah-geniracks-net.xml'
10:59:34 INFO     stitch.Aggregate: 
	Stitcher doing createsliver at https://boss.utah.geniracks.net:12369/protogeni/xmlrpc/am
10:59:48 INFO     stitch.Aggregate: Allocation at <Aggregate urn:publicid:IDN+utah.geniracks.net+authority+cm> complete.
10:59:48 INFO     stitch.Aggregate: Writing to '/tmp/IG-ST-3-createsliver-request-11-ion-internet2-edu.xml'
10:59:48 INFO     stitch.Aggregate: 
	Stitcher doing createsliver at http://geni-am.net.internet2.edu:12346
11:00:31 INFO     stitch.Aggregate: DCN AM <Aggregate urn:publicid:IDN+ion.internet2.edu+authority+am>: must wait for status ready....
11:00:31 INFO     stitch.Aggregate: Pause 30 seconds to let circuit become ready...
11:01:08 INFO     stitch.Aggregate: Pause 30 seconds to let circuit become ready...
11:01:45 INFO     stitch.Aggregate: DCN circuit 62711 is ready
11:01:45 INFO     stitch.Aggregate: DCN circuit 62701 is ready
11:01:52 INFO     stitch.Aggregate: Allocation at <Aggregate urn:publicid:IDN+ion.internet2.edu+authority+am> complete.
11:01:52 INFO     stitch.launcher: All aggregates are complete.
11:01:52 INFO     stitcher: Writing to 'IG-ST-3-manifest-rspec-stitching-combined.xml'
11:01:52 INFO     stitcher: Saved combined reservation RSpec at 5 AMs to file IG-ST-3-manifest-rspec-stitching-combined.xml
Stitching success: Reserved resources in slice IG-ST-3 at 5 Aggregates (including 2 intermediate aggregate(s) not in the original request), creating 2 link(s).

Determined login information the Stanford host:

================================================================================
LOGIN INFO for AM: https://instageni.stanford.edu:12369/protogeni/xmlrpc/am
================================================================================

For more login info, see the section entitled:
	 'Providing a private key to ssh' in 'readyToLogin.py -h'

ig-stan's geni_status is: ready (am_status:ready) 
User lnevers logs in to ig-stan using:
	ssh -p 32314  -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@pc2.instageni.stanford.edu

Login to the Stanford host and ping each remote:

#ping GPO IG 
[lnevers@ig-stan ~]$ ping 192.168.2.1 -c 60 -q
PING 192.168.2.1 (192.168.2.1) 56(84) bytes of data.

--- 192.168.2.1 ping statistics ---
60 packets transmitted, 60 received, 0% packet loss, time 59082ms
rtt min/avg/max/mdev = 100.266/102.015/201.101/12.906 ms

# Utah IG
[lnevers@ig-stan ~]$ ping 192.168.4.1 -c 60 -q
PING 192.168.4.1 (192.168.4.1) 56(84) bytes of data.

--- 192.168.4.1 ping statistics ---
60 packets transmitted, 60 received, 0% packet loss, time 59112ms
rtt min/avg/max/mdev = 16.783/17.109/34.056/2.213 ms

IG-ST-4 New Site to GPO EG interoperability

Create a slice and then create the stitched slivers with the RSPec IG-ST-4.rspec:

08:04:15 INFO     omni: Downloaded latest `agg_nick_cache` from 'http://trac.gpolab.bbn.com/gcf/raw-attachment/wiki/Omni/agg_nick_cache' and copied to '/home/lnevers/.gcf/agg_nick_cache'.
08:04:15 INFO     omni: Loading agg_nick_cache file '/home/lnevers/.gcf/agg_nick_cache'
08:04:15 INFO     omni: Loading config file /home/lnevers/.gcf/omni_config
08:04:16 INFO     omni: Using control framework my_chapi
08:04:16 INFO     omni: Member Authority is https://ch.geni.net/MA (from config)
08:04:16 INFO     omni: Slice Authority is https://ch.geni.net/SA (from config)
08:04:16 INFO     omni: Created slice with Name IG-ST-4, URN urn:publicid:IDN+ch.geni.net:ln-prj+slice+IG-ST-4, Expiration 2014-02-27 13:04:16
08:04:16 INFO     omni:  ------------------------------------------------------
08:04:16 INFO     omni:  Completed createslice:
Args: createslice IG-ST-4
  Result Summary: Created slice with Name IG-ST-4, URN urn:publicid:IDN+ch.geni.net:ln-prj+slice+IG-ST-4, Expiration 2014-02-27 13:04:16
08:04:16 INFO     omni:  ======================================================
net:ln-prj+slice+IG-ST-4, Expiration 2014-02-10 16:18:59
13:00:30 INFO     omni:  ======================================================

$ stitcher.py createsliver IG-ST-4 --useExoSM ./IG-ST-4.rspec -o 
08:23:56 INFO     stitcher: Loading agg_nick_cache file '/home/lnevers/.gcf/agg_nick_cache'
08:23:56 INFO     stitcher: Loading config file /home/lnevers/.gcf/omni_config
08:23:56 INFO     stitcher: Using control framework portal
08:23:57 INFO     stitcher: Checking that slice IG-ST-4 is valid...
08:23:57 INFO     stitcher: Slice urn:publicid:IDN+ch.geni.net:ln-prj+slice+IG-ST-4 expires on 2014-02-27 13:04:16 UTC
08:24:00 INFO     stitcher: <Aggregate urn:publicid:IDN+instageni.stanford.edu+authority+cm> speaks AM API v3, but sticking with v2
08:24:00 INFO     stitcher: <Aggregate urn:publicid:IDN+exogeni.net:bbnvmsite+authority+am> is an EG AM and user asked for ExoSM. Changing to https://geni.renci.org:11443/orca/xmlrpc
08:24:00 INFO     stitcher: Stitched reservation will include resources from these aggregates:
08:24:00 INFO     stitcher: 	<Aggregate urn:publicid:IDN+instageni.stanford.edu+authority+cm>
08:24:00 INFO     stitcher: 	<Aggregate urn:publicid:IDN+exogeni.net:bbnvmsite+authority+am>
08:24:00 INFO     stitcher: 	<Aggregate urn:publicid:IDN+ion.internet2.edu+authority+am>
08:24:00 INFO     stitch.Aggregate: Writing to '/tmp/IG-ST-4-createsliver-request-11-instageni-stanford-edu.xml'
08:24:00 INFO     stitch.Aggregate: 
	Stitcher doing createsliver at https://www.instageni.stanford.edu:12369/protogeni/xmlrpc/am
08:24:15 INFO     stitch.Aggregate: Allocation at <Aggregate urn:publicid:IDN+instageni.stanford.edu+authority+cm> complete.
08:24:15 INFO     stitch.Aggregate: Writing to '/tmp/IG-ST-4-createsliver-request-11-exogeni-net-bbnvmsite.xml'
08:24:15 INFO     stitch.Aggregate: 
	Stitcher doing createsliver at https://geni.renci.org:11443/orca/xmlrpc
08:24:24 INFO     stitch.Aggregate: <Aggregate urn:publicid:IDN+exogeni.net:bbnvmsite+authority+am>: Couldn't find link urn:publicid:IDN+exogeni.net:bbnNet+interface+BbnNet:IBM:G8052:TenGigabitEthernet:1:1:ethernet in path link-eggpo-igutah in EG manifest rspec (usually harmless; 2 of these may happen)
08:24:24 INFO     stitch.Aggregate:  ... returning Fake avail/suggested 2-4094, 3737
08:24:24 INFO     stitch.Aggregate: <Aggregate urn:publicid:IDN+exogeni.net:bbnvmsite+authority+am>: Couldn't find link urn:publicid:IDN+exogeni.net:bbnNet+interface+BbnNet:IBM:G8052:GigabitEthernet:1:2:ethernet in path link-eggpo-igutah in EG manifest rspec (usually harmless; 2 of these may happen)
08:24:24 INFO     stitch.Aggregate:  ... returning Fake avail/suggested 2-4094, 3737
08:24:24 INFO     stitch.Aggregate: <Aggregate urn:publicid:IDN+exogeni.net:bbnvmsite+authority+am>: Couldn't find link urn:publicid:IDN+exogeni.net:bbnvmsite+interface+Bbn:ExoGeni:TenGigabitEthernet:1:ethernet in path link-eggpo-igutah in EG manifest rspec (usually harmless; 2 of these may happen)
08:24:24 INFO     stitch.Aggregate:  ... returning Fake avail/suggested 2-4094, 3737
08:24:24 INFO     stitch.Aggregate: Allocation at <Aggregate urn:publicid:IDN+exogeni.net:bbnvmsite+authority+am> complete.
08:24:24 INFO     stitch.Aggregate: Writing to '/tmp/IG-ST-4-createsliver-request-11-ion-internet2-edu.xml'
08:24:24 INFO     stitch.Aggregate: 
	Stitcher doing createsliver at http://geni-am.net.internet2.edu:12346
08:25:07 INFO     stitch.Aggregate: DCN AM <Aggregate urn:publicid:IDN+ion.internet2.edu+authority+am>: must wait for status ready....
08:25:07 INFO     stitch.Aggregate: Pause 30 seconds to let circuit become ready...
08:25:44 INFO     stitch.Aggregate: DCN circuit 69791 is ready
08:25:51 INFO     stitch.Aggregate: Allocation at <Aggregate urn:publicid:IDN+ion.internet2.edu+authority+am> complete.
08:25:51 INFO     stitch.launcher: All aggregates are complete.
08:25:51 INFO     stitch.ManifestRSpecCombiner: Did not find HopLink urn:publicid:IDN+exogeni.net:bbnNet+interface+BbnNet:IBM:G8052:TenGigabitEthernet:1:1:ethernet in AM's Man RSpec, though found AM's path link-eggpo-igutah (usually harmless; happens 2 times for ExoGENI aggregates)
08:25:51 INFO     stitch.ManifestRSpecCombiner: Did not find HopLink urn:publicid:IDN+exogeni.net:bbnNet+interface+BbnNet:IBM:G8052:GigabitEthernet:1:2:ethernet in AM's Man RSpec, though found AM's path link-eggpo-igutah (usually harmless; happens 2 times for ExoGENI aggregates)
08:25:51 INFO     stitch.ManifestRSpecCombiner: Did not find HopLink urn:publicid:IDN+exogeni.net:bbnvmsite+interface+Bbn:ExoGeni:TenGigabitEthernet:1:ethernet in AM's Man RSpec, though found AM's path link-eggpo-igutah (usually harmless; happens 2 times for ExoGENI aggregates)
11:01:52 INFO     stitch.launcher: All aggregates are complete.
11:01:52 INFO     stitcher: Writing to 'IG-ST-4-manifest-rspec-stitching-combined.xml'
11:01:52 INFO     stitcher: Saved combined reservation RSpec at 5 AMs to file IG-ST-4-manifest-rspec-stitching-combined.xml
Stitching success: Reserved resources in slice IG-ST-4 at 5 Aggregates (including 2 intermediate aggregate(s) not in the original request), creating 2 link(s).

Determined login information at each Stanford and GPO aggregate:

$ readyToLogin.py IG-ST-4 -a stanford-ig
...
================================================================================
LOGIN INFO for AM: https://instageni.stanford.edu:12369/protogeni/xmlrpc/am
================================================================================

For more login info, see the section entitled:
	 'Providing a private key to ssh' in 'readyToLogin.py -h'

ig-stan's geni_status is: ready (am_status:ready) 
User lnevers logs in to ig-stan using:
	ssh -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@pc4.instageni.stanford.edu

$ readyToLogin.py IG-ST-4 -a eg-sm
...
================================================================================
LOGIN INFO for AM: https://geni.renci.org:11443/orca/xmlrpc
================================================================================

For more login info, see the section entitled:
	 'Providing a private key to ssh' in 'readyToLogin.py -h'

eg-gpo's geni_status is: ready (am_status:ready) 
User lnevers logs in to eg-gpo using:
	ssh -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@192.1.242.111

Measurements

Iperf ExoGENI GPO VM to InstaGENI Stanford VM (TCP) - TCP window size: 23.2 KByte (default)

Collected: 2014-02-20

One Client_

[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-60.0 sec   334 MBytes  46.7 Mbits/sec

Five Clients

[ ID] Interval       Transfer     Bandwidth
[  6]  0.0-60.1 sec   332 MBytes  46.3 Mbits/sec
[  7]  0.0-60.1 sec   317 MBytes  44.3 Mbits/sec
[  5]  0.0-60.1 sec   330 MBytes  46.0 Mbits/sec
[  4]  0.0-60.1 sec   332 MBytes  46.3 Mbits/sec
[  3]  0.0-60.1 sec   321 MBytes  44.8 Mbits/sec
[SUM]  0.0-60.1 sec  1.59 GBytes   228 Mbits/sec

Ten Clients

[ ID] Interval       Transfer     Bandwidth
[  4]  0.0-60.0 sec   325 MBytes  45.5 Mbits/sec
[  7]  0.0-60.0 sec   332 MBytes  46.4 Mbits/sec
[ 11]  0.0-60.0 sec   328 MBytes  45.8 Mbits/sec
[ 12]  0.0-60.0 sec   321 MBytes  44.9 Mbits/sec
[  5]  0.0-60.0 sec   330 MBytes  46.1 Mbits/sec
[  8]  0.0-60.0 sec   330 MBytes  46.1 Mbits/sec
[  6]  0.0-60.1 sec   306 MBytes  42.7 Mbits/sec
[ 10]  0.0-60.1 sec   329 MBytes  46.0 Mbits/sec
[  9]  0.0-60.1 sec   329 MBytes  46.0 Mbits/sec
[  3]  0.0-60.1 sec   331 MBytes  46.2 Mbits/sec
[SUM]  0.0-60.1 sec  3.19 GBytes   455 Mbits/sec

Iperf ExoGENI GPO VM to InstaGENI Stanford VM (UDP) - UDP buffer size: 224 KByte (default)

[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-60.0 sec   719 MBytes   101 Mbits/sec
[  3] Sent 512821 datagrams
[  3] Server Report:
[  3]  0.0-62.0 sec   183 MBytes  24.8 Mbits/sec   6.638 ms 382129/512795 (75%)
[  3]  0.0-62.0 sec  30 datagrams received out-of-order

Ping from ExoGENI GPO VM to the InstaGENI Stanford VM

60 packets transmitted, 60 received, 0% packet loss, time 59171ms
rtt min/avg/max/mdev = 107.040/107.103/107.134/0.293 ms

Iperf InstaGENI Stanford VM to ExoGENI GPO VM (TCP) - TCP window size: 16.0 KByte (default)

Collected: 2014-02-20

One Client_

[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-60.0 sec   346 MBytes  48.3 Mbits/sec

Five Clients

[ ID] Interval       Transfer     Bandwidth
[  7]  0.0-60.0 sec   142 MBytes  19.8 Mbits/sec
[  6]  0.0-60.1 sec   144 MBytes  20.0 Mbits/sec
[  3]  0.0-60.1 sec   143 MBytes  20.0 Mbits/sec
[  4]  0.0-60.2 sec   140 MBytes  19.5 Mbits/sec
[  5]  0.0-60.2 sec   144 MBytes  20.0 Mbits/sec
[SUM]  0.0-60.2 sec   712 MBytes  99.2 Mbits/sec

Ten Clients

[ ID] Interval       Transfer     Bandwidth
[  4]  0.0-60.0 sec  77.6 MBytes  10.9 Mbits/sec
[ 11]  0.0-60.0 sec  81.2 MBytes  11.4 Mbits/sec
[ 12]  0.0-60.1 sec  78.0 MBytes  10.9 Mbits/sec
[  6]  0.0-60.1 sec  60.8 MBytes  8.48 Mbits/sec
[ 10]  0.0-60.1 sec  69.6 MBytes  9.72 Mbits/sec
[  3]  0.0-60.1 sec  83.4 MBytes  11.6 Mbits/sec
[  8]  0.0-60.2 sec  67.8 MBytes  9.45 Mbits/sec
[  5]  0.0-60.2 sec  59.4 MBytes  8.28 Mbits/sec
[  9]  0.0-60.3 sec  60.8 MBytes  8.46 Mbits/sec
[  7]  0.0-60.3 sec  78.8 MBytes  10.9 Mbits/sec
[SUM]  0.0-60.3 sec   717 MBytes  99.7 Mbits/sec

Iperf InstaGENI Stanford VM to ExoGENI GPO VM (UDP) - UDP buffer size: 114 KByte (default)

[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-60.0 sec   719 MBytes   101 Mbits/sec
[  3] Sent 512822 datagrams
[  3] Server Report:
[  3]  0.0-61.1 sec   246 MBytes  33.8 Mbits/sec   5.792 ms 337205/512821 (66%)
[  3]  0.0-61.1 sec  156 datagrams received out-of-order

Ping from InstaGENI Stanford VM to ExoGENI GPO VM

60 packets transmitted, 60 received, 0% packet loss, time 59070ms
rtt min/avg/max/mdev = 107.066/107.116/107.181/0.427 ms

IG-ST-5 Site Information

Various pages include stitching information for a site. Each of the following were verified for this site:

  1. Verified that stitching VLANs and Device URN information exists in the Stanford Aggregate page.

  1. Verified that Delegated GENI Stitching VLANs for site are documented at the Delegated GENI Stitching VLANs.
  1. Stitching Computation Service logs were reviewed while testing stitching to this site, no issues found.
  1. Added site to the list of GENI Network Stitching Sites.