wiki:GENIRacksHome/OpenGENIRacks/AcceptanceTestStatusApr2014/OG-EXP-4

Version 1 (modified by lnevers@bbn.com, 10 years ago) (diff)

--

GR-EXP-4: GRAM Multi-site Acceptance Test

This page captures status for the test case GR-EXP-4. For additional information see the Acceptance Test Status - April 2014? page overall status, or the GRAM Acceptance Test Plan? for details about the planned evaluation.

Multi-site tests with GENI Network Stitching

This tests case was modified to use stitching functionality to connect to other existing racks.

GRAM to InstaGENI Connection

As experimenter "lnevers at bbn dot com" and using stitcher create a sliver that connects GPO InstaGENI to Clemson GRAM. First create the slice:

$  omni.py createslice GR-EXP-4-exp1a
11:45:54 INFO     omni: Loading agg_nick_cache file '/home/lnevers/.gcf/agg_nick_cache'
11:45:54 INFO     omni: Loading config file /home/lnevers/.gcf/omni_config
11:45:54 INFO     omni: Setting option useSliceMembers based on omni_config setting
11:45:54 INFO     omni: Using control framework portal
11:45:54 INFO     omni: Member Authority is https://ch.geni.net/MA (from config)
11:45:54 INFO     omni: Slice Authority is https://ch.geni.net/SA (from config)
11:45:54 INFO     omni: Slice GR-EXP-4-exp1a already existed - returning existing slice
11:45:54 INFO     omni: Created slice with Name GR-EXP-4-exp1a, URN urn:publicid:IDN+ch.geni.net:ln-test+slice+GR-EXP-4-exp1a, Expiration 2014-04-11 14:19:33
11:45:54 INFO     omni:  ------------------------------------------------------
11:45:54 INFO     omni:  Completed createslice:
Args: createslice GR-EXP-4-exp1a
  Result Summary: Created slice with Name GR-EXP-4-exp1a, URN urn:publicid:IDN+ch.geni.net:ln-test+slice+GR-EXP-4-exp1a, Expiration 2014-04-11 14:19:33
11:45:54 INFO     omni:  ======================================================

Then create the sliver:

$ stitcher.py createsliver GR-EXP-4-exp1a ./GR-EXP-4-exp1.rspec 
11:46:17 INFO     stitcher: Loading agg_nick_cache file '/home/lnevers/.gcf/agg_nick_cache'
11:46:17 INFO     stitcher: Loading config file /home/lnevers/.gcf/omni_config
11:46:17 INFO     stitcher: Setting option useSliceMembers based on omni_config setting
11:46:17 INFO     stitcher: Using control framework portal
11:46:17 INFO     stitcher: Member Authority is https://ch.geni.net/MA (from config)
11:46:17 INFO     stitcher: Slice Authority is https://ch.geni.net/SA (from config)
11:46:17 INFO     stitcher: Checking that slice GR-EXP-4-exp1a is valid...
11:46:18 INFO     stitcher: Slice urn:publicid:IDN+ch.geni.net:ln-test+slice+GR-EXP-4-exp1a expires on 2014-04-11 14:19:33 UTC
11:46:18 INFO     stitcher: Stitched reservation will include resources from these aggregates:
11:46:18 INFO     stitcher: 	<Aggregate gpo-ig>
11:46:18 INFO     stitcher: 	<Aggregate urn:publicid:IDN+clemson-clemson-control-1.clemson.edu+authority+am>
11:46:18 INFO     stitcher: 	<Aggregate ion>
11:46:18 INFO     stitch.Aggregate: 
	Stitcher doing createsliver at https://boss.instageni.gpolab.bbn.com:12369/protogeni/xmlrpc/am
11:46:34 ERROR    omni:  {'output': "vlan tag 3746 for 'link' not available", 'code': {'protogeni_error_log': 'urn:publicid:IDN+instageni.gpolab.bbn.com+log+e1d5e331b3e017a099bdea6a5fe6614d', 'am_type': 'protogeni', 'geni_code': 1, 'am_code': 1, 'protogeni_error_url': 'https://boss.instageni.gpolab.bbn.com/spewlogfile.php3?logfile=e1d5e331b3e017a099bdea6a5fe6614d'}, 'value': 0}
11:46:34 INFO     stitch.Aggregate: A requested VLAN was unavailable doing createsliver GR-EXP-4-exp1a at <Aggregate gpo-ig>: AMAPIError: Error from Aggregate: code 1. protogeni AM code: 1: vlan tag 3746 for 'link' not available.
11:46:34 INFO     stitch.launcher: Will put <Aggregate gpo-ig> back in the pool to allocate. Got VLAN was unavailable. Retry <Aggregate gpo-ig> 2nd time with <Hop u'urn:publicid:IDN+instageni.gpolab.bbn.com+interface+procurve2:5.24.ion.newy.ae0' on path u'link'> new suggested 3709 (not 3746)
11:46:34 INFO     stitch.launcher: Pausing for 30 seconds for Aggregates to free up resources...


11:47:04 INFO     stitch.Aggregate: 
	Stitcher doing createsliver at https://clemson-clemson-control-1.clemson.edu:5001
11:47:05 WARNING  omni: Requested API version 2, but AM https://clemson-clemson-control-1.clemson.edu:5001 uses version 3. Same aggregate talks API v2 at a different URL: https://clemson-clemson-control-1.clemson.edu:5002
11:48:43 INFO     stitch.Aggregate: Allocation at <Aggregate urn:publicid:IDN+clemson-clemson-control-1.clemson.edu+authority+am> complete.
11:48:43 INFO     stitch.Aggregate: 
	Stitcher doing createsliver at https://boss.instageni.gpolab.bbn.com:12369/protogeni/xmlrpc/am
11:48:57 INFO     stitch.Aggregate: Allocation at <Aggregate gpo-ig> complete.
11:48:57 INFO     stitch.Aggregate: 
	Stitcher doing createsliver at http://geni-am.net.internet2.edu:12346
11:49:41 INFO     stitch.Aggregate: DCN AM <Aggregate ion>: must wait for status ready....
11:49:41 INFO     stitch.Aggregate: Pause 30 seconds to let circuit become ready...
11:50:18 INFO     stitch.Aggregate: DCN circuit 83061 is ready
11:50:25 INFO     stitch.Aggregate: Allocation at <Aggregate ion> complete.
11:50:25 INFO     stitch.launcher: All aggregates are complete.
11:50:25 INFO     stitcher: Saved combined reservation RSpec at 3 AMs to file GR-EXP-4-exp1a-manifest-rspec-stitching-combined.xml
Stitching success: Reserved resources in slice GR-EXP-4-exp1a at 3 Aggregates (including 1 intermediate aggregate(s) not in the original request), creating 1 link(s).

Determine login information for nodes:

$ readyToLogin.py -a clemson-gr  GR-EXP-4-exp1a
...
gr-clem's geni_status is: ready 
User lnevers logs in to gr-clem using:
	ssh -p 3005  -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@130.127.88.101

$ readyToLogin.py -a gpo-ig  GR-EXP-4-exp1a
...
ig-gpo's geni_status is: ready (am_status:ready) 
User lnevers logs in to ig-gpo using:
	ssh -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@pc2.instageni.gpolab.bbn.com 

Measurements collected with Raw PC

Iperf GPO IG to Clemson GR (TCP) - TCP window size: 23.5 KByte (default)

Collected: 2014-04-07

One Client_

[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-60.0 sec   682 MBytes  95.3 Mbits/sec

Five Clients

[ ID] Interval       Transfer     Bandwidth
[  7]  0.0-60.0 sec   153 MBytes  21.4 Mbits/sec
[  5]  0.0-60.1 sec   146 MBytes  20.4 Mbits/sec
[  6]  0.0-60.1 sec   122 MBytes  17.0 Mbits/sec
[  4]  0.0-60.1 sec   145 MBytes  20.3 Mbits/sec
[  3]  0.0-60.1 sec   114 MBytes  15.9 Mbits/sec
[SUM]  0.0-60.1 sec   680 MBytes  94.9 Mbits/sec

Ten Clients

[ ID] Interval       Transfer     Bandwidth
[  8]  0.0-60.0 sec  81.1 MBytes  11.3 Mbits/sec
[  3]  0.0-60.0 sec  74.9 MBytes  10.5 Mbits/sec
[ 10]  0.0-60.0 sec  66.1 MBytes  9.24 Mbits/sec
[  5]  0.0-60.0 sec  49.9 MBytes  6.97 Mbits/sec
[  9]  0.0-60.1 sec  57.8 MBytes  8.07 Mbits/sec
[  7]  0.0-60.1 sec  63.5 MBytes  8.86 Mbits/sec
[ 12]  0.0-60.2 sec  61.8 MBytes  8.61 Mbits/sec
[  6]  0.0-60.2 sec  68.6 MBytes  9.56 Mbits/sec
[  4]  0.0-60.3 sec  79.1 MBytes  11.0 Mbits/sec
[ 11]  0.0-60.3 sec  73.2 MBytes  10.2 Mbits/sec
[SUM]  0.0-60.3 sec   676 MBytes  94.0 Mbits/sec

Iperf GPO IG to Clemson GR (UDP) - UDP buffer size: 224 KByte (default)

[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-60.0 sec   719 MBytes   101 Mbits/sec
[  3] Sent 512822 datagrams
[  3] Server Report:
[  3]  0.0-59.8 sec   686 MBytes  96.2 Mbits/sec   0.017 ms 23581/512821 (4.6%)
[  3]  0.0-59.8 sec  1 datagrams received out-of-order

Ping from GPO IG to the Clemson GR

60 packets transmitted, 56 received, 6% packet loss, time 59102ms
rtt min/avg/max/mdev = 25.920/25.972/26.224/0.220 ms

Iperf Clemson GR to GPO IG (TCP) - TCP window size: 23.5 KByte (default)

Collected: 2014-04-07

One Client_

[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-63.3 sec  1.14 GBytes   154 Mbits/sec

Five Clients

[ ID] Interval       Transfer     Bandwidth
[  5]  0.0-60.7 sec   305 MBytes  42.1 Mbits/sec
[  4]  0.0-60.7 sec   342 MBytes  47.3 Mbits/sec
[  6]  0.0-61.2 sec   295 MBytes  40.5 Mbits/sec
[  3]  0.0-61.1 sec   562 MBytes  77.1 Mbits/sec
[  7]  0.0-61.4 sec   350 MBytes  47.8 Mbits/sec
[SUM]  0.0-61.4 sec  1.81 GBytes   253 Mbits/sec

Ten Clients

[ ID] Interval       Transfer     Bandwidth
[  8]  0.0-60.0 sec   184 MBytes  25.7 Mbits/sec
[  4]  0.0-60.0 sec   151 MBytes  21.1 Mbits/sec
[  9]  0.0-60.2 sec   190 MBytes  26.5 Mbits/sec
[ 10]  0.0-60.3 sec   139 MBytes  19.3 Mbits/sec
[  6]  0.0-60.6 sec   314 MBytes  43.4 Mbits/sec
[ 11]  0.0-60.7 sec   562 MBytes  77.8 Mbits/sec
[  3]  0.0-60.8 sec   148 MBytes  20.3 Mbits/sec
[ 12]  0.0-61.9 sec   338 MBytes  45.8 Mbits/sec
[  5]  0.0-62.6 sec   340 MBytes  45.6 Mbits/sec
[  7]  0.0-62.6 sec   385 MBytes  51.5 Mbits/sec
[SUM]  0.0-62.6 sec  2.69 GBytes   369 Mbits/sec

Iperf Clemson GR to GPO IG (UDP) - UDP buffer size: 224 KByte (default)

[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-60.0 sec   719 MBytes   101 Mbits/sec
[  3] Sent 512821 datagrams
[  3] Server Report:
[  3]  0.0-60.0 sec   707 MBytes  98.8 Mbits/sec   0.011 ms 8651/512820 (1.7%)
[  3]  0.0-60.0 sec  24 datagrams received out-of-order

Ping from Clemson GR to GPO IG

60 packets transmitted, 58 received, 3% packet loss, time 59113ms
rtt min/avg/max/mdev = 25.935/26.008/26.786/0.264 ms

Measurements with XEN

Iperf GPO IG to Clemson GR (TCP) - TCP window size: 23.5 KByte (default)

Collected: 2014-04-04

One Client_

[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-75.1 sec  3.62 MBytes   405 Kbits/sec

Five Clients

[ ID] Interval       Transfer     Bandwidth
[  7]  0.0-58.1 sec  40.8 MBytes  5.89 Mbits/sec
[  5]  0.0-58.4 sec  19.9 MBytes  2.86 Mbits/sec
[  6]  0.0-58.6 sec  24.5 MBytes  3.50 Mbits/sec
[  3]  0.0-60.8 sec  28.8 MBytes  3.97 Mbits/sec
[  4]  0.0-61.2 sec  26.8 MBytes  3.66 Mbits/sec
[SUM]  0.0-61.2 sec   141 MBytes  19.3 Mbits/sec

Ten Clients

[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-60.3 sec  17.4 MBytes  2.42 Mbits/sec
[  6]  0.0-60.4 sec  16.6 MBytes  2.31 Mbits/sec
[ 10]  0.0-60.7 sec  13.5 MBytes  1.87 Mbits/sec
[  8]  0.0-60.7 sec  10.5 MBytes  1.45 Mbits/sec
[ 12]  0.0-60.8 sec  17.5 MBytes  2.42 Mbits/sec
[  7]  0.0-60.8 sec  10.4 MBytes  1.43 Mbits/sec
[  9]  0.0-61.0 sec  12.9 MBytes  1.77 Mbits/sec
[  4]  0.0-61.0 sec  12.1 MBytes  1.67 Mbits/sec
[  5]  0.0-61.1 sec  12.5 MBytes  1.72 Mbits/sec
[ 11]  0.0-62.9 sec  20.4 MBytes  2.72 Mbits/sec
[SUM]  0.0-62.9 sec   144 MBytes  19.2 Mbits/sec

Iperf GPO IG to Clemson GR (UDP) - UDP buffer size: 224 KByte (default)

[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-63.9 sec   338 MBytes  44.4 Mbits/sec
[  3] Sent 241301 datagrams
[  3] Server Report:
[  3]  0.0-64.1 sec  65.5 MBytes  8.57 Mbits/sec  14.622 ms 194557/241299 (81%)

Ping from GPO IG to Clemson GR

60 packets transmitted, 58 received, 3% packet loss, time 59083ms
rtt min/avg/max/mdev = 26.130/26.302/26.728/0.241 ms

Iperf Clemson GR to GPO IG (TCP) - TCP window size: 23.5 KByte (default)

Collected: 2014-04-04

One Client_

[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-60.1 sec   135 MBytes  18.8 Mbits/sec

Five Clients

[ ID] Interval       Transfer     Bandwidth
[  7]  0.0-60.4 sec  24.5 MBytes  3.40 Mbits/sec
[  5]  0.0-60.5 sec  30.1 MBytes  4.18 Mbits/sec
[  3]  0.0-60.6 sec  28.1 MBytes  3.89 Mbits/sec
[  4]  0.0-60.7 sec  26.6 MBytes  3.68 Mbits/sec
[  6]  0.0-60.7 sec  29.5 MBytes  4.07 Mbits/sec
[SUM]  0.0-60.7 sec   139 MBytes  19.2 Mbits/sec

Ten Clients

[ ID] Interval       Transfer     Bandwidth
[  9]  0.0-60.1 sec  12.4 MBytes  1.73 Mbits/sec
[ 10]  0.0-60.1 sec  16.9 MBytes  2.35 Mbits/sec
[  3]  0.0-60.3 sec  17.2 MBytes  2.40 Mbits/sec
[  7]  0.0-60.6 sec  14.2 MBytes  1.97 Mbits/sec
[  5]  0.0-60.8 sec  16.9 MBytes  2.33 Mbits/sec
[  4]  0.0-60.8 sec  12.8 MBytes  1.76 Mbits/sec
[ 12]  0.0-60.9 sec  14.8 MBytes  2.03 Mbits/sec
[ 11]  0.0-61.4 sec  16.8 MBytes  2.29 Mbits/sec
[  8]  0.0-61.6 sec  13.9 MBytes  1.89 Mbits/sec
[  6]  0.0-61.9 sec  11.0 MBytes  1.49 Mbits/sec
[SUM]  0.0-61.9 sec   147 MBytes  19.9 Mbits/sec

Iperf Clemson GR to GPO IG (UDP) - UDP buffer size: 224 KByte (default)

[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-60.0 sec   719 MBytes   101 Mbits/sec
[  3] Sent 512821 datagrams
[  3] Server Report:
[  3]  0.0-59.6 sec   138 MBytes  19.4 Mbits/sec   0.073 ms 414393/512820 (81%)
[  3]  0.0-59.6 sec  1 datagrams received out-of-order

Ping from Clemson GR to GPO IG

60 packets transmitted, 57 received, 5% packet loss, time 59097ms
rtt min/avg/max/mdev = 26.020/26.650/39.173/2.035 ms

GRAM to ExoGENI Connection

As experimenter "lnevers1 at bbn dot com" and using stitcher create a sliver that connects GPO ExoGENI Bare Metal to Clemson GRAM. First create the slice:

$ omni.py createslice GR-EXP-4-exp2       
11:58:56 INFO     omni: Loading agg_nick_cache file '/home/lnevers1/.gcf/agg_nick_cache'
11:58:56 INFO     omni: Loading config file /home/lnevers1/.gcf/omni_config
11:58:56 INFO     omni: Setting option useSliceMembers based on omni_config setting
11:58:56 INFO     omni: Using control framework portal
11:58:56 INFO     omni: Member Authority is https://ch.geni.net/MA (from config)
11:58:56 INFO     omni: Slice Authority is https://ch.geni.net/SA (from config)
11:58:57 INFO     omni: Created slice with Name GR-EXP-4-exp2, URN urn:publicid:IDN+ch.geni.net:XYZ19+slice+GR-EXP-4-exp2, Expiration 2014-04-11 15:58:56
11:58:57 INFO     omni:  ------------------------------------------------------
11:58:57 INFO     omni:  Completed createslice:
Args: createslice GR-EXP-4-exp2

  Result Summary: Created slice with Name GR-EXP-4-exp2, URN urn:publicid:IDN+ch.geni.net:XYZ19+slice+GR-EXP-4-exp2, Expiration 2014-04-11 15:58:56
 
11:58:57 INFO     omni:  ======================================================

Then create the sliver:

$ stitcher.py createsliver GR-EXP-4-exp2 ./GR-EXP-4-exp2.rspec --useExoSM
13:09:03 INFO     stitcher: Loading agg_nick_cache file '/home/lnevers1/.gcf/agg_nick_cache'
13:09:03 INFO     stitcher: Loading config file /home/lnevers1/.gcf/omni_config
13:09:03 INFO     stitcher: Setting option useSliceMembers based on omni_config setting
13:09:03 INFO     stitcher: Using control framework portal
13:09:03 INFO     stitcher: Member Authority is https://ch.geni.net/MA (from config)
13:09:03 INFO     stitcher: Slice Authority is https://ch.geni.net/SA (from config)
13:09:03 INFO     stitcher: Checking that slice GR-EXP-4-exp2 is valid...
13:09:03 INFO     stitcher: Slice urn:publicid:IDN+ch.geni.net:XYZ19+slice+GR-EXP-4-exp2 expires on 2014-04-11 15:58:56 UTC
13:09:04 INFO     stitcher: <Aggregate urn:publicid:IDN+exogeni.net:bbnvmsite+authority+am> is an EG AM and user asked for ExoSM. Changing to https://geni.renci.org:11443/orca/xmlrpc
13:09:04 INFO     stitcher: Stitched reservation will include resources from these aggregates:
13:09:04 INFO     stitcher: 	<Aggregate urn:publicid:IDN+clemson-clemson-control-1.clemson.edu+authority+am>
13:09:04 INFO     stitcher: 	<Aggregate eg-sm>
13:09:04 INFO     stitcher: 	<Aggregate ion>
13:09:04 INFO     stitch.Aggregate: 
	Stitcher doing createsliver at https://clemson-clemson-control-1.clemson.edu:5001
13:09:05 WARNING  omni: Requested API version 2, but AM https://clemson-clemson-control-1.clemson.edu:5001 uses version 3. Same aggregate talks API v2 at a different URL: https://clemson-clemson-control-1.clemson.edu:5002
13:11:11 INFO     stitch.Aggregate: Allocation at <Aggregate urn:publicid:IDN+clemson-clemson-control-1.clemson.edu+authority+am> complete.
13:11:11 INFO     stitch.Aggregate: 
	Stitcher doing createsliver at https://geni.renci.org:11443/orca/xmlrpc
13:11:32 INFO     stitch.Aggregate: <Aggregate eg-sm>: Couldn't find link 'urn:publicid:IDN+exogeni.net:bbnvmsite+interface+Bbn:ExoGeni:TenGigabitEthernet:1:ethernet' in path 'link' in EG manifest rspec (usually harmless; 2 or 3 of these may happen)
13:11:32 INFO     stitch.Aggregate:  ... returning Fake avail/suggested 2-4094, 3736
13:11:32 INFO     stitch.Aggregate: <Aggregate eg-sm>: Couldn't find link 'urn:publicid:IDN+exogeni.net:bbnNet+interface+BbnNet:IBM:G8052:TenGigabitEthernet:1:1:ethernet' in path 'link' in EG manifest rspec (usually harmless; 2 or 3 of these may happen)
13:11:32 INFO     stitch.Aggregate:  ... returning Fake avail/suggested 2-4094, 3736
13:11:32 INFO     stitch.Aggregate: <Aggregate eg-sm>: Couldn't find link 'urn:publicid:IDN+exogeni.net:bbnNet+interface+BbnNet:IBM:G8052:GigabitEthernet:1:2:ethernet' in path 'link' in EG manifest rspec (usually harmless; 2 or 3 of these may happen)
13:11:32 INFO     stitch.Aggregate:  ... returning Fake avail/suggested 2-4094, 3736
13:11:32 INFO     stitch.Aggregate: Allocation at <Aggregate eg-sm> complete.
13:11:32 INFO     stitch.Aggregate: 
	Stitcher doing createsliver at http://geni-am.net.internet2.edu:12346
13:12:16 INFO     stitch.Aggregate: DCN AM <Aggregate ion>: must wait for status ready....
13:12:16 INFO     stitch.Aggregate: Pause 30 seconds to let circuit become ready...
13:12:53 INFO     stitch.Aggregate: DCN circuit 83151 is ready
13:13:00 INFO     stitch.Aggregate: Allocation at <Aggregate ion> complete.
13:13:00 INFO     stitch.launcher: All aggregates are complete.
13:13:00 INFO     stitch.ManifestRSpecCombiner: Did not find HopLink urn:publicid:IDN+exogeni.net:bbnvmsite+interface+Bbn:ExoGeni:TenGigabitEthernet:1:ethernet in AM's Man RSpec, though found AM's path link (usually harmless; happens 2+ times for ExoGENI aggregates)
13:13:00 INFO     stitch.ManifestRSpecCombiner: Did not find HopLink urn:publicid:IDN+exogeni.net:bbnNet+interface+BbnNet:IBM:G8052:TenGigabitEthernet:1:1:ethernet in AM's Man RSpec, though found AM's path link (usually harmless; happens 2+ times for ExoGENI aggregates)
13:13:00 INFO     stitch.ManifestRSpecCombiner: Did not find HopLink urn:publicid:IDN+exogeni.net:bbnNet+interface+BbnNet:IBM:G8052:GigabitEthernet:1:2:ethernet in AM's Man RSpec, though found AM's path link (usually harmless; happens 2+ times for ExoGENI aggregates)
13:13:00 INFO     stitcher: Saved combined reservation RSpec at 3 AMs to file GR-EXP-4-exp2-manifest-rspec-stitching-combined.xml
Stitching success: Reserved resources in slice GR-EXP-4-exp2 at 3 Aggregates (including 1 intermediate aggregate(s) not in the original request), creating 1 link(s).

Determine login information:

$ readyToLogin.py -a clemson-gr GR-EXP-4-exp2 
...
gr-clem's geni_status is: ready 
User lnevers1 logs in to gr-clem using:
	ssh -p 3000  -i /home/lnevers1/.ssh/geni_cert_portal_key lnevers1@130.127.88.101
User lnevers logs in to gr-clem using:
	ssh -p 3000  -i /home/lnevers1/.ssh/geni_cert_portal_key lnevers@130.127.88.101


$  readyToLogin.py -a eg-sm  GR-EXP-4-exp2 
...

eg-gpo's geni_status is: ready (am_status:ready) 
User lnevers1 logs in to eg-gpo using:
	ssh -i /home/lnevers1/.ssh/geni_cert_portal_key lnevers1@192.1.242.111

Measurements collected with Bare Metal node

Iperf GPO EG to Clemson GR (TCP) - TCP window size: 23.5 KByte (default)

Collected: 2014-04-04

One Client_

[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-60.0 sec   967 MBytes   135 Mbits/sec

Five Clients

[ ID] Interval       Transfer     Bandwidth
[  6]  0.0-60.0 sec   785 MBytes   110 Mbits/sec
[  7]  0.0-60.0 sec   968 MBytes   135 Mbits/sec
[  5]  0.0-60.0 sec   969 MBytes   135 Mbits/sec
[  4]  0.0-60.0 sec   769 MBytes   107 Mbits/sec
[  3]  0.0-60.0 sec   968 MBytes   135 Mbits/sec
[SUM]  0.0-60.0 sec  4.35 GBytes   623 Mbits/sec

Ten Clients

[ ID] Interval       Transfer     Bandwidth
[ 10]  0.0-60.0 sec   502 MBytes  70.1 Mbits/sec
[  8]  0.0-60.0 sec   590 MBytes  82.5 Mbits/sec
[ 11]  0.0-60.0 sec   706 MBytes  98.7 Mbits/sec
[  7]  0.0-60.0 sec   647 MBytes  90.4 Mbits/sec
[  6]  0.0-60.0 sec   660 MBytes  92.3 Mbits/sec
[  3]  0.0-60.0 sec   658 MBytes  92.0 Mbits/sec
[  5]  0.0-60.0 sec   425 MBytes  59.4 Mbits/sec
[  9]  0.0-60.0 sec   498 MBytes  69.5 Mbits/sec
[  4]  0.0-60.1 sec   431 MBytes  60.2 Mbits/sec
[ 12]  0.0-60.1 sec   606 MBytes  84.7 Mbits/sec
[SUM]  0.0-60.1 sec  5.59 GBytes   800 Mbits/sec

Iperf GPO EG to Clemson GR (UDP) - UDP buffer size: 224 KByte (default)

[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-60.0 sec  71.5 MBytes  10.0 Mbits/sec
[  3] Sent 51022 datagrams
[  3] Server Report:
[  3]  0.0-225.1 sec  26.6 MBytes   992 Kbits/sec   0.007 ms 32027/51022 (63%)

Ping from GPO EG to the Clemson GR

60 packets transmitted, 58 received, 3% packet loss, time 61332ms
rtt min/avg/max/mdev = 25.968/47.021/1132.921/144.538 ms, pipe 2

Iperf Clemson GR to GPO EG (TCP) - TCP window size: 23.5 KByte (default)

Collected: 2014-04-04

One Client_

[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-60.0 sec   240 MBytes  33.6 Mbits/sec

Five Clients

[ ID] Interval       Transfer     Bandwidth
[  6]  0.0-60.1 sec   251 MBytes  35.0 Mbits/sec
[  5]  0.0-60.1 sec   269 MBytes  37.6 Mbits/sec
[  3]  0.0-60.1 sec   199 MBytes  27.7 Mbits/sec
[  7]  0.0-60.1 sec   216 MBytes  30.2 Mbits/sec
[  4]  0.0-60.1 sec   300 MBytes  41.8 Mbits/sec
[SUM]  0.0-60.1 sec  1.21 GBytes   172 Mbits/sec

Ten Clients

[ ID] Interval       Transfer     Bandwidth
[  7]  0.0-60.0 sec   133 MBytes  18.6 Mbits/sec
[  4]  0.0-60.0 sec   418 MBytes  58.4 Mbits/sec
[  5]  0.0-60.0 sec   138 MBytes  19.2 Mbits/sec
[  8]  0.0-60.1 sec   143 MBytes  20.0 Mbits/sec
[  9]  0.0-60.1 sec   132 MBytes  18.4 Mbits/sec
[ 12]  0.0-60.1 sec   123 MBytes  17.2 Mbits/sec
[  6]  0.0-60.1 sec   137 MBytes  19.1 Mbits/sec
[  3]  0.0-60.1 sec   143 MBytes  20.0 Mbits/sec
[ 10]  0.0-60.1 sec   128 MBytes  17.8 Mbits/sec
[ 11]  0.0-60.1 sec   149 MBytes  20.8 Mbits/sec
[SUM]  0.0-60.1 sec  1.61 GBytes   229 Mbits/sec

Iperf Clemson GR to GPO EG (UDP) - UDP buffer size: 224 KByte (default)

[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-60.0 sec  35.8 MBytes  5.00 Mbits/sec
[  3] Sent 25512 datagrams
[  3] Server Report:
[  3]  0.0-59.9 sec  25.0 MBytes  3.50 Mbits/sec   0.053 ms 7685/25511 (30%)
[  3]  0.0-59.9 sec  1 datagrams received out-of-order

Ping from Clemson GR to GPO EG

60 packets transmitted, 57 received, 5% packet loss, time 59091ms
rtt min/avg/max/mdev = 25.961/26.031/26.195/0.092 ms

Three node linear topology

To verify that the GRAM rack could support more than one link created a 3 node linear topology which included:

GPO EG <-> Clemson GR <-> GPO IG

Created the sliver:

$ stitcher.py createsliver 3linear ./stitch-gr-clem-3linear.rspec 
14:57:31 INFO     stitcher: Loading agg_nick_cache file '/home/lnevers/.gcf/agg_nick_cache'
14:57:31 INFO     stitcher: Loading config file /home/lnevers/.gcf/omni_config
14:57:31 INFO     stitcher: Setting option useSliceMembers based on omni_config setting
14:57:31 INFO     stitcher: Using control framework portal
14:57:31 INFO     stitcher: Member Authority is https://ch.geni.net/MA (from config)
14:57:31 INFO     stitcher: Slice Authority is https://ch.geni.net/SA (from config)
14:57:31 INFO     stitcher: Checking that slice 3linear is valid...
14:57:31 INFO     stitcher: Slice urn:publicid:IDN+ch.geni.net:ln-test+slice+3linear expires on 2014-04-11 16:47:51 UTC
14:57:33 INFO     stitcher: Stitched reservation will include resources from these aggregates:
14:57:33 INFO     stitcher: 	<Aggregate gpo-ig>
14:57:33 INFO     stitcher: 	<Aggregate urn:publicid:IDN+clemson-clemson-control-1.clemson.edu+authority+am>
14:57:33 INFO     stitcher: 	<Aggregate gpo-eg>
14:57:33 INFO     stitcher: 	<Aggregate ion>
14:57:33 INFO     stitch.Aggregate: 
	Stitcher doing createsliver at https://boss.instageni.gpolab.bbn.com:12369/protogeni/xmlrpc/am
14:57:46 ERROR    omni:  {'output': "vlan tag 3748 for 'linkIG' not available", 'code': {'protogeni_error_log': 'urn:publicid:IDN+instageni.gpolab.bbn.com+log+922b6612fbe697b8a01a4f001a5561e0', 'am_type': 'protogeni', 'geni_code': 1, 'am_code': 1, 'protogeni_error_url': 'https://boss.instageni.gpolab.bbn.com/spewlogfile.php3?logfile=922b6612fbe697b8a01a4f001a5561e0'}, 'value': 0}
14:57:46 INFO     stitch.Aggregate: A requested VLAN was unavailable doing createsliver 3linear at <Aggregate gpo-ig>: AMAPIError: Error from Aggregate: code 1. protogeni AM code: 1: vlan tag 3748 for 'linkIG' not available.
14:57:46 INFO     stitch.launcher: Will put <Aggregate gpo-ig> back in the pool to allocate. Got VLAN was unavailable. Retry <Aggregate gpo-ig> 2nd time with <Hop u'urn:publicid:IDN+instageni.gpolab.bbn.com+interface+procurve2:5.24.ion.newy.ae0' on path u'linkIG'> new suggested 3719 (not 3748)
14:57:46 INFO     stitch.launcher: Pausing for 30 seconds for Aggregates to free up resources...


14:58:16 INFO     stitch.Aggregate: 
	Stitcher doing createsliver at https://clemson-clemson-control-1.clemson.edu:5001
14:58:17 WARNING  omni: Requested API version 2, but AM https://clemson-clemson-control-1.clemson.edu:5001 uses version 3. Same aggregate talks API v2 at a different URL: https://clemson-clemson-control-1.clemson.edu:5002
15:01:06 INFO     stitch.Aggregate: Allocation at <Aggregate urn:publicid:IDN+clemson-clemson-control-1.clemson.edu+authority+am> complete.
15:01:06 INFO     stitch.Aggregate: 
	Stitcher doing createsliver at https://bbn-hn.exogeni.net:11443/orca/xmlrpc
15:01:18 INFO     stitch.Aggregate: <Aggregate gpo-eg>: Couldn't find link 'urn:publicid:IDN+exogeni.net:bbnvmsite+interface+Bbn:ExoGeni:TenGigabitEthernet:1:ethernet' in path 'linkEG' in EG manifest rspec (usually harmless; 2 or 3 of these may happen)
15:01:18 INFO     stitch.Aggregate:  ... returning Fake avail/suggested 2-4094, 3741
15:01:18 INFO     stitch.Aggregate: <Aggregate gpo-eg>: Couldn't find link 'urn:publicid:IDN+exogeni.net:bbnNet+interface+BbnNet:IBM:G8052:GigabitEthernet:1:2:ethernet' in path 'linkEG' in EG manifest rspec (usually harmless; 2 or 3 of these may happen)
15:01:18 INFO     stitch.Aggregate:  ... returning Fake avail/suggested 2-4094, 3741
15:01:18 INFO     stitch.Aggregate: <Aggregate gpo-eg>: Couldn't find link 'urn:publicid:IDN+exogeni.net:bbnNet+interface+BbnNet:IBM:G8052:TenGigabitEthernet:1:1:ethernet' in path 'linkEG' in EG manifest rspec (usually harmless; 2 or 3 of these may happen)
15:01:18 INFO     stitch.Aggregate:  ... returning Fake avail/suggested 2-4094, 3741
15:01:18 INFO     stitch.Aggregate: Allocation at <Aggregate gpo-eg> complete.
15:01:18 INFO     stitch.Aggregate: 
	Stitcher doing createsliver at https://boss.instageni.gpolab.bbn.com:12369/protogeni/xmlrpc/am
15:01:37 INFO     stitch.Aggregate: Allocation at <Aggregate gpo-ig> complete.
15:01:37 INFO     stitch.Aggregate: 
	Stitcher doing createsliver at http://geni-am.net.internet2.edu:12346
15:02:22 INFO     stitch.Aggregate: DCN AM <Aggregate ion>: must wait for status ready....
15:02:22 INFO     stitch.Aggregate: Pause 30 seconds to let circuit become ready...
15:02:59 INFO     stitch.Aggregate: Pause 30 seconds to let circuit become ready...
15:03:36 INFO     stitch.Aggregate: DCN circuit 83211 is ready
15:03:36 INFO     stitch.Aggregate: DCN circuit 83221 is ready
15:03:42 INFO     stitch.Aggregate: Allocation at <Aggregate ion> complete.
15:03:42 INFO     stitch.launcher: All aggregates are complete.
15:03:42 INFO     stitch.ManifestRSpecCombiner: Did not find HopLink urn:publicid:IDN+exogeni.net:bbnvmsite+interface+Bbn:ExoGeni:TenGigabitEthernet:1:ethernet in AM's Man RSpec, though found AM's path linkEG (usually harmless; happens 2+ times for ExoGENI aggregates)
15:03:42 INFO     stitch.ManifestRSpecCombiner: Did not find HopLink urn:publicid:IDN+exogeni.net:bbnNet+interface+BbnNet:IBM:G8052:GigabitEthernet:1:2:ethernet in AM's Man RSpec, though found AM's path linkEG (usually harmless; happens 2+ times for ExoGENI aggregates)
15:03:42 INFO     stitch.ManifestRSpecCombiner: Did not find HopLink urn:publicid:IDN+exogeni.net:bbnNet+interface+BbnNet:IBM:G8052:TenGigabitEthernet:1:1:ethernet in AM's Man RSpec, though found AM's path linkEG (usually harmless; happens 2+ times for ExoGENI aggregates)
15:03:42 INFO     stitcher: Saved combined reservation RSpec at 4 AMs to file 3linear-manifest-rspec-stitching-combined.xml
Stitching success: Reserved resources in slice 3linear at 4 Aggregates (including 1 intermediate aggregate(s) not in the original request), creating 2 link(s).

Determined login information:

$ readyToLogin.py -a clemson-gr 3linear 
...
gr-clem's geni_status is: ready 
User lnevers logs in to gr-clem using:
	ssh -p 3000  -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@130.127.88.101

Logged into Clemson GR node and exchanged traffic with the other two endpoints:

# ping GPO IG remote
lnevers@gr-clem:~$ ping 192.168.1.1 -c 60 -q
PING 192.168.1.1 (192.168.1.1) 56(84) bytes of data.

--- 192.168.1.1 ping statistics ---
60 packets transmitted, 55 received, 8% packet loss, time 59090ms
rtt min/avg/max/mdev = 26.187/26.381/26.544/0.185 ms


# ping GPO EG remote
lnevers@gr-clem:~$ ping 192.168.2.1 -c 60 -q
PING 192.168.2.1 (192.168.2.1) 56(84) bytes of data.

--- 192.168.2.1 ping statistics ---
60 packets transmitted, 55 received, 8% packet loss, time 59083ms
rtt min/avg/max/mdev = 26.036/26.201/26.414/0.085 ms