= GR-EXP-4: GRAM Multi-site Acceptance Test = This page captures status for the test case GR-EXP-4. For additional information see the [wiki:GENIRacksHome/GRAMRacks/AcceptanceTestStatusApr2014 Acceptance Test Status - April 2014] page overall status, or the [wiki:GENIRacksHome/AcceptanceTests/GRAMAcceptanceTestsPlan GRAM Acceptance Test Plan] for details about the planned evaluation. == Multi-site tests with GENI Network Stitching == This tests case was modified to use stitching functionality to connect to other existing racks. == GRAM to InstaGENI Connection == As experimenter "lnevers at bbn dot com" and using stitcher create a sliver that connects GPO InstaGENI to Clemson GRAM. First create the slice: {{{ $ omni.py createslice GR-EXP-4-exp1a 11:45:54 INFO omni: Loading agg_nick_cache file '/home/lnevers/.gcf/agg_nick_cache' 11:45:54 INFO omni: Loading config file /home/lnevers/.gcf/omni_config 11:45:54 INFO omni: Setting option useSliceMembers based on omni_config setting 11:45:54 INFO omni: Using control framework portal 11:45:54 INFO omni: Member Authority is https://ch.geni.net/MA (from config) 11:45:54 INFO omni: Slice Authority is https://ch.geni.net/SA (from config) 11:45:54 INFO omni: Slice GR-EXP-4-exp1a already existed - returning existing slice 11:45:54 INFO omni: Created slice with Name GR-EXP-4-exp1a, URN urn:publicid:IDN+ch.geni.net:ln-test+slice+GR-EXP-4-exp1a, Expiration 2014-04-11 14:19:33 11:45:54 INFO omni: ------------------------------------------------------ 11:45:54 INFO omni: Completed createslice: Args: createslice GR-EXP-4-exp1a Result Summary: Created slice with Name GR-EXP-4-exp1a, URN urn:publicid:IDN+ch.geni.net:ln-test+slice+GR-EXP-4-exp1a, Expiration 2014-04-11 14:19:33 11:45:54 INFO omni: ====================================================== }}} Then create the sliver: {{{ $ stitcher.py createsliver GR-EXP-4-exp1a ./GR-EXP-4-exp1.rspec 11:46:17 INFO stitcher: Loading agg_nick_cache file '/home/lnevers/.gcf/agg_nick_cache' 11:46:17 INFO stitcher: Loading config file /home/lnevers/.gcf/omni_config 11:46:17 INFO stitcher: Setting option useSliceMembers based on omni_config setting 11:46:17 INFO stitcher: Using control framework portal 11:46:17 INFO stitcher: Member Authority is https://ch.geni.net/MA (from config) 11:46:17 INFO stitcher: Slice Authority is https://ch.geni.net/SA (from config) 11:46:17 INFO stitcher: Checking that slice GR-EXP-4-exp1a is valid... 11:46:18 INFO stitcher: Slice urn:publicid:IDN+ch.geni.net:ln-test+slice+GR-EXP-4-exp1a expires on 2014-04-11 14:19:33 UTC 11:46:18 INFO stitcher: Stitched reservation will include resources from these aggregates: 11:46:18 INFO stitcher: 11:46:18 INFO stitcher: 11:46:18 INFO stitcher: 11:46:18 INFO stitch.Aggregate: Stitcher doing createsliver at https://boss.instageni.gpolab.bbn.com:12369/protogeni/xmlrpc/am 11:46:34 ERROR omni: {'output': "vlan tag 3746 for 'link' not available", 'code': {'protogeni_error_log': 'urn:publicid:IDN+instageni.gpolab.bbn.com+log+e1d5e331b3e017a099bdea6a5fe6614d', 'am_type': 'protogeni', 'geni_code': 1, 'am_code': 1, 'protogeni_error_url': 'https://boss.instageni.gpolab.bbn.com/spewlogfile.php3?logfile=e1d5e331b3e017a099bdea6a5fe6614d'}, 'value': 0} 11:46:34 INFO stitch.Aggregate: A requested VLAN was unavailable doing createsliver GR-EXP-4-exp1a at : AMAPIError: Error from Aggregate: code 1. protogeni AM code: 1: vlan tag 3746 for 'link' not available. 11:46:34 INFO stitch.launcher: Will put back in the pool to allocate. Got VLAN was unavailable. Retry 2nd time with new suggested 3709 (not 3746) 11:46:34 INFO stitch.launcher: Pausing for 30 seconds for Aggregates to free up resources... 11:47:04 INFO stitch.Aggregate: Stitcher doing createsliver at https://clemson-clemson-control-1.clemson.edu:5001 11:47:05 WARNING omni: Requested API version 2, but AM https://clemson-clemson-control-1.clemson.edu:5001 uses version 3. Same aggregate talks API v2 at a different URL: https://clemson-clemson-control-1.clemson.edu:5002 11:48:43 INFO stitch.Aggregate: Allocation at complete. 11:48:43 INFO stitch.Aggregate: Stitcher doing createsliver at https://boss.instageni.gpolab.bbn.com:12369/protogeni/xmlrpc/am 11:48:57 INFO stitch.Aggregate: Allocation at complete. 11:48:57 INFO stitch.Aggregate: Stitcher doing createsliver at http://geni-am.net.internet2.edu:12346 11:49:41 INFO stitch.Aggregate: DCN AM : must wait for status ready.... 11:49:41 INFO stitch.Aggregate: Pause 30 seconds to let circuit become ready... 11:50:18 INFO stitch.Aggregate: DCN circuit 83061 is ready 11:50:25 INFO stitch.Aggregate: Allocation at complete. 11:50:25 INFO stitch.launcher: All aggregates are complete. 11:50:25 INFO stitcher: Saved combined reservation RSpec at 3 AMs to file GR-EXP-4-exp1a-manifest-rspec-stitching-combined.xml Stitching success: Reserved resources in slice GR-EXP-4-exp1a at 3 Aggregates (including 1 intermediate aggregate(s) not in the original request), creating 1 link(s). }}} Determine login information for nodes: {{{ $ readyToLogin.py -a clemson-gr GR-EXP-4-exp1a ... gr-clem's geni_status is: ready User lnevers logs in to gr-clem using: ssh -p 3005 -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@130.127.88.101 $ readyToLogin.py -a gpo-ig GR-EXP-4-exp1a ... ig-gpo's geni_status is: ready (am_status:ready) User lnevers logs in to ig-gpo using: ssh -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@pc2.instageni.gpolab.bbn.com }}} === Measurements collected with Raw PC === '''Iperf GPO IG to Clemson GR (TCP) - TCP window size: 23.5 KByte (default)''' ''Collected: 2014-04-07'' __One Client_ {{{ [ ID] Interval Transfer Bandwidth [ 3] 0.0-60.0 sec 682 MBytes 95.3 Mbits/sec }}} __Five Clients__ {{{ [ ID] Interval Transfer Bandwidth [ 7] 0.0-60.0 sec 153 MBytes 21.4 Mbits/sec [ 5] 0.0-60.1 sec 146 MBytes 20.4 Mbits/sec [ 6] 0.0-60.1 sec 122 MBytes 17.0 Mbits/sec [ 4] 0.0-60.1 sec 145 MBytes 20.3 Mbits/sec [ 3] 0.0-60.1 sec 114 MBytes 15.9 Mbits/sec [SUM] 0.0-60.1 sec 680 MBytes 94.9 Mbits/sec }}} __Ten Clients__ {{{ [ ID] Interval Transfer Bandwidth [ 8] 0.0-60.0 sec 81.1 MBytes 11.3 Mbits/sec [ 3] 0.0-60.0 sec 74.9 MBytes 10.5 Mbits/sec [ 10] 0.0-60.0 sec 66.1 MBytes 9.24 Mbits/sec [ 5] 0.0-60.0 sec 49.9 MBytes 6.97 Mbits/sec [ 9] 0.0-60.1 sec 57.8 MBytes 8.07 Mbits/sec [ 7] 0.0-60.1 sec 63.5 MBytes 8.86 Mbits/sec [ 12] 0.0-60.2 sec 61.8 MBytes 8.61 Mbits/sec [ 6] 0.0-60.2 sec 68.6 MBytes 9.56 Mbits/sec [ 4] 0.0-60.3 sec 79.1 MBytes 11.0 Mbits/sec [ 11] 0.0-60.3 sec 73.2 MBytes 10.2 Mbits/sec [SUM] 0.0-60.3 sec 676 MBytes 94.0 Mbits/sec }}} '''Iperf GPO IG to Clemson GR (UDP) - UDP buffer size: 224 KByte (default) ''' {{{ [ ID] Interval Transfer Bandwidth [ 3] 0.0-60.0 sec 719 MBytes 101 Mbits/sec [ 3] Sent 512822 datagrams [ 3] Server Report: [ 3] 0.0-59.8 sec 686 MBytes 96.2 Mbits/sec 0.017 ms 23581/512821 (4.6%) [ 3] 0.0-59.8 sec 1 datagrams received out-of-order }}} '''Ping from GPO IG to the Clemson GR ''' {{{ 60 packets transmitted, 56 received, 6% packet loss, time 59102ms rtt min/avg/max/mdev = 25.920/25.972/26.224/0.220 ms }}} '''Iperf Clemson GR to GPO IG (TCP) - TCP window size: 23.5 KByte (default)''' ''Collected: 2014-04-07'' __One Client_ {{{ [ ID] Interval Transfer Bandwidth [ 3] 0.0-63.3 sec 1.14 GBytes 154 Mbits/sec }}} __Five Clients__ {{{ [ ID] Interval Transfer Bandwidth [ 5] 0.0-60.7 sec 305 MBytes 42.1 Mbits/sec [ 4] 0.0-60.7 sec 342 MBytes 47.3 Mbits/sec [ 6] 0.0-61.2 sec 295 MBytes 40.5 Mbits/sec [ 3] 0.0-61.1 sec 562 MBytes 77.1 Mbits/sec [ 7] 0.0-61.4 sec 350 MBytes 47.8 Mbits/sec [SUM] 0.0-61.4 sec 1.81 GBytes 253 Mbits/sec }}} __Ten Clients__ {{{ [ ID] Interval Transfer Bandwidth [ 8] 0.0-60.0 sec 184 MBytes 25.7 Mbits/sec [ 4] 0.0-60.0 sec 151 MBytes 21.1 Mbits/sec [ 9] 0.0-60.2 sec 190 MBytes 26.5 Mbits/sec [ 10] 0.0-60.3 sec 139 MBytes 19.3 Mbits/sec [ 6] 0.0-60.6 sec 314 MBytes 43.4 Mbits/sec [ 11] 0.0-60.7 sec 562 MBytes 77.8 Mbits/sec [ 3] 0.0-60.8 sec 148 MBytes 20.3 Mbits/sec [ 12] 0.0-61.9 sec 338 MBytes 45.8 Mbits/sec [ 5] 0.0-62.6 sec 340 MBytes 45.6 Mbits/sec [ 7] 0.0-62.6 sec 385 MBytes 51.5 Mbits/sec [SUM] 0.0-62.6 sec 2.69 GBytes 369 Mbits/sec }}} '''Iperf Clemson GR to GPO IG (UDP) - UDP buffer size: 224 KByte (default) ''' {{{ [ ID] Interval Transfer Bandwidth [ 3] 0.0-60.0 sec 719 MBytes 101 Mbits/sec [ 3] Sent 512821 datagrams [ 3] Server Report: [ 3] 0.0-60.0 sec 707 MBytes 98.8 Mbits/sec 0.011 ms 8651/512820 (1.7%) [ 3] 0.0-60.0 sec 24 datagrams received out-of-order }}} '''Ping from Clemson GR to GPO IG ''' {{{ 60 packets transmitted, 58 received, 3% packet loss, time 59113ms rtt min/avg/max/mdev = 25.935/26.008/26.786/0.264 ms }}} === Measurements with XEN === '''Iperf GPO IG to Clemson GR (TCP) - TCP window size: 23.5 KByte (default)''' ''Collected: 2014-04-04'' __One Client_ {{{ [ ID] Interval Transfer Bandwidth [ 3] 0.0-75.1 sec 3.62 MBytes 405 Kbits/sec }}} __Five Clients__ {{{ [ ID] Interval Transfer Bandwidth [ 7] 0.0-58.1 sec 40.8 MBytes 5.89 Mbits/sec [ 5] 0.0-58.4 sec 19.9 MBytes 2.86 Mbits/sec [ 6] 0.0-58.6 sec 24.5 MBytes 3.50 Mbits/sec [ 3] 0.0-60.8 sec 28.8 MBytes 3.97 Mbits/sec [ 4] 0.0-61.2 sec 26.8 MBytes 3.66 Mbits/sec [SUM] 0.0-61.2 sec 141 MBytes 19.3 Mbits/sec }}} __Ten Clients__ {{{ [ ID] Interval Transfer Bandwidth [ 3] 0.0-60.3 sec 17.4 MBytes 2.42 Mbits/sec [ 6] 0.0-60.4 sec 16.6 MBytes 2.31 Mbits/sec [ 10] 0.0-60.7 sec 13.5 MBytes 1.87 Mbits/sec [ 8] 0.0-60.7 sec 10.5 MBytes 1.45 Mbits/sec [ 12] 0.0-60.8 sec 17.5 MBytes 2.42 Mbits/sec [ 7] 0.0-60.8 sec 10.4 MBytes 1.43 Mbits/sec [ 9] 0.0-61.0 sec 12.9 MBytes 1.77 Mbits/sec [ 4] 0.0-61.0 sec 12.1 MBytes 1.67 Mbits/sec [ 5] 0.0-61.1 sec 12.5 MBytes 1.72 Mbits/sec [ 11] 0.0-62.9 sec 20.4 MBytes 2.72 Mbits/sec [SUM] 0.0-62.9 sec 144 MBytes 19.2 Mbits/sec }}} '''Iperf GPO IG to Clemson GR (UDP) - UDP buffer size: 224 KByte (default) ''' {{{ [ ID] Interval Transfer Bandwidth [ 3] 0.0-63.9 sec 338 MBytes 44.4 Mbits/sec [ 3] Sent 241301 datagrams [ 3] Server Report: [ 3] 0.0-64.1 sec 65.5 MBytes 8.57 Mbits/sec 14.622 ms 194557/241299 (81%) }}} '''Ping from GPO IG to Clemson GR ''' {{{ 60 packets transmitted, 58 received, 3% packet loss, time 59083ms rtt min/avg/max/mdev = 26.130/26.302/26.728/0.241 ms }}} '''Iperf Clemson GR to GPO IG (TCP) - TCP window size: 23.5 KByte (default)''' ''Collected: 2014-04-04'' __One Client_ {{{ [ ID] Interval Transfer Bandwidth [ 3] 0.0-60.1 sec 135 MBytes 18.8 Mbits/sec }}} __Five Clients__ {{{ [ ID] Interval Transfer Bandwidth [ 7] 0.0-60.4 sec 24.5 MBytes 3.40 Mbits/sec [ 5] 0.0-60.5 sec 30.1 MBytes 4.18 Mbits/sec [ 3] 0.0-60.6 sec 28.1 MBytes 3.89 Mbits/sec [ 4] 0.0-60.7 sec 26.6 MBytes 3.68 Mbits/sec [ 6] 0.0-60.7 sec 29.5 MBytes 4.07 Mbits/sec [SUM] 0.0-60.7 sec 139 MBytes 19.2 Mbits/sec }}} __Ten Clients__ {{{ [ ID] Interval Transfer Bandwidth [ 9] 0.0-60.1 sec 12.4 MBytes 1.73 Mbits/sec [ 10] 0.0-60.1 sec 16.9 MBytes 2.35 Mbits/sec [ 3] 0.0-60.3 sec 17.2 MBytes 2.40 Mbits/sec [ 7] 0.0-60.6 sec 14.2 MBytes 1.97 Mbits/sec [ 5] 0.0-60.8 sec 16.9 MBytes 2.33 Mbits/sec [ 4] 0.0-60.8 sec 12.8 MBytes 1.76 Mbits/sec [ 12] 0.0-60.9 sec 14.8 MBytes 2.03 Mbits/sec [ 11] 0.0-61.4 sec 16.8 MBytes 2.29 Mbits/sec [ 8] 0.0-61.6 sec 13.9 MBytes 1.89 Mbits/sec [ 6] 0.0-61.9 sec 11.0 MBytes 1.49 Mbits/sec [SUM] 0.0-61.9 sec 147 MBytes 19.9 Mbits/sec }}} '''Iperf Clemson GR to GPO IG (UDP) - UDP buffer size: 224 KByte (default) ''' {{{ [ ID] Interval Transfer Bandwidth [ 3] 0.0-60.0 sec 719 MBytes 101 Mbits/sec [ 3] Sent 512821 datagrams [ 3] Server Report: [ 3] 0.0-59.6 sec 138 MBytes 19.4 Mbits/sec 0.073 ms 414393/512820 (81%) [ 3] 0.0-59.6 sec 1 datagrams received out-of-order }}} '''Ping from Clemson GR to GPO IG ''' {{{ 60 packets transmitted, 57 received, 5% packet loss, time 59097ms rtt min/avg/max/mdev = 26.020/26.650/39.173/2.035 ms }}} == GRAM to ExoGENI Connection == As experimenter "lnevers1 at bbn dot com" and using stitcher create a sliver that connects GPO ExoGENI Bare Metal to Clemson GRAM. First create the slice: {{{ $ omni.py createslice GR-EXP-4-exp2 11:58:56 INFO omni: Loading agg_nick_cache file '/home/lnevers1/.gcf/agg_nick_cache' 11:58:56 INFO omni: Loading config file /home/lnevers1/.gcf/omni_config 11:58:56 INFO omni: Setting option useSliceMembers based on omni_config setting 11:58:56 INFO omni: Using control framework portal 11:58:56 INFO omni: Member Authority is https://ch.geni.net/MA (from config) 11:58:56 INFO omni: Slice Authority is https://ch.geni.net/SA (from config) 11:58:57 INFO omni: Created slice with Name GR-EXP-4-exp2, URN urn:publicid:IDN+ch.geni.net:XYZ19+slice+GR-EXP-4-exp2, Expiration 2014-04-11 15:58:56 11:58:57 INFO omni: ------------------------------------------------------ 11:58:57 INFO omni: Completed createslice: Args: createslice GR-EXP-4-exp2 Result Summary: Created slice with Name GR-EXP-4-exp2, URN urn:publicid:IDN+ch.geni.net:XYZ19+slice+GR-EXP-4-exp2, Expiration 2014-04-11 15:58:56 11:58:57 INFO omni: ====================================================== }}} Then create the sliver: {{{ $ stitcher.py createsliver GR-EXP-4-exp2 ./GR-EXP-4-exp2.rspec --useExoSM 13:09:03 INFO stitcher: Loading agg_nick_cache file '/home/lnevers1/.gcf/agg_nick_cache' 13:09:03 INFO stitcher: Loading config file /home/lnevers1/.gcf/omni_config 13:09:03 INFO stitcher: Setting option useSliceMembers based on omni_config setting 13:09:03 INFO stitcher: Using control framework portal 13:09:03 INFO stitcher: Member Authority is https://ch.geni.net/MA (from config) 13:09:03 INFO stitcher: Slice Authority is https://ch.geni.net/SA (from config) 13:09:03 INFO stitcher: Checking that slice GR-EXP-4-exp2 is valid... 13:09:03 INFO stitcher: Slice urn:publicid:IDN+ch.geni.net:XYZ19+slice+GR-EXP-4-exp2 expires on 2014-04-11 15:58:56 UTC 13:09:04 INFO stitcher: is an EG AM and user asked for ExoSM. Changing to https://geni.renci.org:11443/orca/xmlrpc 13:09:04 INFO stitcher: Stitched reservation will include resources from these aggregates: 13:09:04 INFO stitcher: 13:09:04 INFO stitcher: 13:09:04 INFO stitcher: 13:09:04 INFO stitch.Aggregate: Stitcher doing createsliver at https://clemson-clemson-control-1.clemson.edu:5001 13:09:05 WARNING omni: Requested API version 2, but AM https://clemson-clemson-control-1.clemson.edu:5001 uses version 3. Same aggregate talks API v2 at a different URL: https://clemson-clemson-control-1.clemson.edu:5002 13:11:11 INFO stitch.Aggregate: Allocation at complete. 13:11:11 INFO stitch.Aggregate: Stitcher doing createsliver at https://geni.renci.org:11443/orca/xmlrpc 13:11:32 INFO stitch.Aggregate: : Couldn't find link 'urn:publicid:IDN+exogeni.net:bbnvmsite+interface+Bbn:ExoGeni:TenGigabitEthernet:1:ethernet' in path 'link' in EG manifest rspec (usually harmless; 2 or 3 of these may happen) 13:11:32 INFO stitch.Aggregate: ... returning Fake avail/suggested 2-4094, 3736 13:11:32 INFO stitch.Aggregate: : Couldn't find link 'urn:publicid:IDN+exogeni.net:bbnNet+interface+BbnNet:IBM:G8052:TenGigabitEthernet:1:1:ethernet' in path 'link' in EG manifest rspec (usually harmless; 2 or 3 of these may happen) 13:11:32 INFO stitch.Aggregate: ... returning Fake avail/suggested 2-4094, 3736 13:11:32 INFO stitch.Aggregate: : Couldn't find link 'urn:publicid:IDN+exogeni.net:bbnNet+interface+BbnNet:IBM:G8052:GigabitEthernet:1:2:ethernet' in path 'link' in EG manifest rspec (usually harmless; 2 or 3 of these may happen) 13:11:32 INFO stitch.Aggregate: ... returning Fake avail/suggested 2-4094, 3736 13:11:32 INFO stitch.Aggregate: Allocation at complete. 13:11:32 INFO stitch.Aggregate: Stitcher doing createsliver at http://geni-am.net.internet2.edu:12346 13:12:16 INFO stitch.Aggregate: DCN AM : must wait for status ready.... 13:12:16 INFO stitch.Aggregate: Pause 30 seconds to let circuit become ready... 13:12:53 INFO stitch.Aggregate: DCN circuit 83151 is ready 13:13:00 INFO stitch.Aggregate: Allocation at complete. 13:13:00 INFO stitch.launcher: All aggregates are complete. 13:13:00 INFO stitch.ManifestRSpecCombiner: Did not find HopLink urn:publicid:IDN+exogeni.net:bbnvmsite+interface+Bbn:ExoGeni:TenGigabitEthernet:1:ethernet in AM's Man RSpec, though found AM's path link (usually harmless; happens 2+ times for ExoGENI aggregates) 13:13:00 INFO stitch.ManifestRSpecCombiner: Did not find HopLink urn:publicid:IDN+exogeni.net:bbnNet+interface+BbnNet:IBM:G8052:TenGigabitEthernet:1:1:ethernet in AM's Man RSpec, though found AM's path link (usually harmless; happens 2+ times for ExoGENI aggregates) 13:13:00 INFO stitch.ManifestRSpecCombiner: Did not find HopLink urn:publicid:IDN+exogeni.net:bbnNet+interface+BbnNet:IBM:G8052:GigabitEthernet:1:2:ethernet in AM's Man RSpec, though found AM's path link (usually harmless; happens 2+ times for ExoGENI aggregates) 13:13:00 INFO stitcher: Saved combined reservation RSpec at 3 AMs to file GR-EXP-4-exp2-manifest-rspec-stitching-combined.xml Stitching success: Reserved resources in slice GR-EXP-4-exp2 at 3 Aggregates (including 1 intermediate aggregate(s) not in the original request), creating 1 link(s). }}} Determine login information: {{{ $ readyToLogin.py -a clemson-gr GR-EXP-4-exp2 ... gr-clem's geni_status is: ready User lnevers1 logs in to gr-clem using: ssh -p 3000 -i /home/lnevers1/.ssh/geni_cert_portal_key lnevers1@130.127.88.101 User lnevers logs in to gr-clem using: ssh -p 3000 -i /home/lnevers1/.ssh/geni_cert_portal_key lnevers@130.127.88.101 $ readyToLogin.py -a eg-sm GR-EXP-4-exp2 ... eg-gpo's geni_status is: ready (am_status:ready) User lnevers1 logs in to eg-gpo using: ssh -i /home/lnevers1/.ssh/geni_cert_portal_key lnevers1@192.1.242.111 }}} === Measurements collected with Bare Metal node === '''Iperf GPO EG to Clemson GR (TCP) - TCP window size: 23.5 KByte (default)''' ''Collected: 2014-04-04'' __One Client_ {{{ [ ID] Interval Transfer Bandwidth [ 3] 0.0-60.0 sec 967 MBytes 135 Mbits/sec }}} __Five Clients__ {{{ [ ID] Interval Transfer Bandwidth [ 6] 0.0-60.0 sec 785 MBytes 110 Mbits/sec [ 7] 0.0-60.0 sec 968 MBytes 135 Mbits/sec [ 5] 0.0-60.0 sec 969 MBytes 135 Mbits/sec [ 4] 0.0-60.0 sec 769 MBytes 107 Mbits/sec [ 3] 0.0-60.0 sec 968 MBytes 135 Mbits/sec [SUM] 0.0-60.0 sec 4.35 GBytes 623 Mbits/sec }}} __Ten Clients__ {{{ [ ID] Interval Transfer Bandwidth [ 10] 0.0-60.0 sec 502 MBytes 70.1 Mbits/sec [ 8] 0.0-60.0 sec 590 MBytes 82.5 Mbits/sec [ 11] 0.0-60.0 sec 706 MBytes 98.7 Mbits/sec [ 7] 0.0-60.0 sec 647 MBytes 90.4 Mbits/sec [ 6] 0.0-60.0 sec 660 MBytes 92.3 Mbits/sec [ 3] 0.0-60.0 sec 658 MBytes 92.0 Mbits/sec [ 5] 0.0-60.0 sec 425 MBytes 59.4 Mbits/sec [ 9] 0.0-60.0 sec 498 MBytes 69.5 Mbits/sec [ 4] 0.0-60.1 sec 431 MBytes 60.2 Mbits/sec [ 12] 0.0-60.1 sec 606 MBytes 84.7 Mbits/sec [SUM] 0.0-60.1 sec 5.59 GBytes 800 Mbits/sec }}} '''Iperf GPO EG to Clemson GR (UDP) - UDP buffer size: 224 KByte (default) ''' {{{ [ ID] Interval Transfer Bandwidth [ 3] 0.0-60.0 sec 71.5 MBytes 10.0 Mbits/sec [ 3] Sent 51022 datagrams [ 3] Server Report: [ 3] 0.0-225.1 sec 26.6 MBytes 992 Kbits/sec 0.007 ms 32027/51022 (63%) }}} '''Ping from GPO EG to the Clemson GR ''' {{{ 60 packets transmitted, 58 received, 3% packet loss, time 61332ms rtt min/avg/max/mdev = 25.968/47.021/1132.921/144.538 ms, pipe 2 }}} '''Iperf Clemson GR to GPO EG (TCP) - TCP window size: 23.5 KByte (default)''' ''Collected: 2014-04-04'' __One Client_ {{{ [ ID] Interval Transfer Bandwidth [ 3] 0.0-60.0 sec 240 MBytes 33.6 Mbits/sec }}} __Five Clients__ {{{ [ ID] Interval Transfer Bandwidth [ 6] 0.0-60.1 sec 251 MBytes 35.0 Mbits/sec [ 5] 0.0-60.1 sec 269 MBytes 37.6 Mbits/sec [ 3] 0.0-60.1 sec 199 MBytes 27.7 Mbits/sec [ 7] 0.0-60.1 sec 216 MBytes 30.2 Mbits/sec [ 4] 0.0-60.1 sec 300 MBytes 41.8 Mbits/sec [SUM] 0.0-60.1 sec 1.21 GBytes 172 Mbits/sec }}} __Ten Clients__ {{{ [ ID] Interval Transfer Bandwidth [ 7] 0.0-60.0 sec 133 MBytes 18.6 Mbits/sec [ 4] 0.0-60.0 sec 418 MBytes 58.4 Mbits/sec [ 5] 0.0-60.0 sec 138 MBytes 19.2 Mbits/sec [ 8] 0.0-60.1 sec 143 MBytes 20.0 Mbits/sec [ 9] 0.0-60.1 sec 132 MBytes 18.4 Mbits/sec [ 12] 0.0-60.1 sec 123 MBytes 17.2 Mbits/sec [ 6] 0.0-60.1 sec 137 MBytes 19.1 Mbits/sec [ 3] 0.0-60.1 sec 143 MBytes 20.0 Mbits/sec [ 10] 0.0-60.1 sec 128 MBytes 17.8 Mbits/sec [ 11] 0.0-60.1 sec 149 MBytes 20.8 Mbits/sec [SUM] 0.0-60.1 sec 1.61 GBytes 229 Mbits/sec }}} '''Iperf Clemson GR to GPO EG (UDP) - UDP buffer size: 224 KByte (default) ''' {{{ [ ID] Interval Transfer Bandwidth [ 3] 0.0-60.0 sec 35.8 MBytes 5.00 Mbits/sec [ 3] Sent 25512 datagrams [ 3] Server Report: [ 3] 0.0-59.9 sec 25.0 MBytes 3.50 Mbits/sec 0.053 ms 7685/25511 (30%) [ 3] 0.0-59.9 sec 1 datagrams received out-of-order }}} '''Ping from Clemson GR to GPO EG ''' {{{ 60 packets transmitted, 57 received, 5% packet loss, time 59091ms rtt min/avg/max/mdev = 25.961/26.031/26.195/0.092 ms }}} === Three node linear topology === To verify that the GRAM rack could support more than one link created a 3 node linear topology which included: GPO EG <-> Clemson GR <-> GPO IG Created the sliver: {{{ $ stitcher.py createsliver 3linear ./stitch-gr-clem-3linear.rspec 14:57:31 INFO stitcher: Loading agg_nick_cache file '/home/lnevers/.gcf/agg_nick_cache' 14:57:31 INFO stitcher: Loading config file /home/lnevers/.gcf/omni_config 14:57:31 INFO stitcher: Setting option useSliceMembers based on omni_config setting 14:57:31 INFO stitcher: Using control framework portal 14:57:31 INFO stitcher: Member Authority is https://ch.geni.net/MA (from config) 14:57:31 INFO stitcher: Slice Authority is https://ch.geni.net/SA (from config) 14:57:31 INFO stitcher: Checking that slice 3linear is valid... 14:57:31 INFO stitcher: Slice urn:publicid:IDN+ch.geni.net:ln-test+slice+3linear expires on 2014-04-11 16:47:51 UTC 14:57:33 INFO stitcher: Stitched reservation will include resources from these aggregates: 14:57:33 INFO stitcher: 14:57:33 INFO stitcher: 14:57:33 INFO stitcher: 14:57:33 INFO stitcher: 14:57:33 INFO stitch.Aggregate: Stitcher doing createsliver at https://boss.instageni.gpolab.bbn.com:12369/protogeni/xmlrpc/am 14:57:46 ERROR omni: {'output': "vlan tag 3748 for 'linkIG' not available", 'code': {'protogeni_error_log': 'urn:publicid:IDN+instageni.gpolab.bbn.com+log+922b6612fbe697b8a01a4f001a5561e0', 'am_type': 'protogeni', 'geni_code': 1, 'am_code': 1, 'protogeni_error_url': 'https://boss.instageni.gpolab.bbn.com/spewlogfile.php3?logfile=922b6612fbe697b8a01a4f001a5561e0'}, 'value': 0} 14:57:46 INFO stitch.Aggregate: A requested VLAN was unavailable doing createsliver 3linear at : AMAPIError: Error from Aggregate: code 1. protogeni AM code: 1: vlan tag 3748 for 'linkIG' not available. 14:57:46 INFO stitch.launcher: Will put back in the pool to allocate. Got VLAN was unavailable. Retry 2nd time with new suggested 3719 (not 3748) 14:57:46 INFO stitch.launcher: Pausing for 30 seconds for Aggregates to free up resources... 14:58:16 INFO stitch.Aggregate: Stitcher doing createsliver at https://clemson-clemson-control-1.clemson.edu:5001 14:58:17 WARNING omni: Requested API version 2, but AM https://clemson-clemson-control-1.clemson.edu:5001 uses version 3. Same aggregate talks API v2 at a different URL: https://clemson-clemson-control-1.clemson.edu:5002 15:01:06 INFO stitch.Aggregate: Allocation at complete. 15:01:06 INFO stitch.Aggregate: Stitcher doing createsliver at https://bbn-hn.exogeni.net:11443/orca/xmlrpc 15:01:18 INFO stitch.Aggregate: : Couldn't find link 'urn:publicid:IDN+exogeni.net:bbnvmsite+interface+Bbn:ExoGeni:TenGigabitEthernet:1:ethernet' in path 'linkEG' in EG manifest rspec (usually harmless; 2 or 3 of these may happen) 15:01:18 INFO stitch.Aggregate: ... returning Fake avail/suggested 2-4094, 3741 15:01:18 INFO stitch.Aggregate: : Couldn't find link 'urn:publicid:IDN+exogeni.net:bbnNet+interface+BbnNet:IBM:G8052:GigabitEthernet:1:2:ethernet' in path 'linkEG' in EG manifest rspec (usually harmless; 2 or 3 of these may happen) 15:01:18 INFO stitch.Aggregate: ... returning Fake avail/suggested 2-4094, 3741 15:01:18 INFO stitch.Aggregate: : Couldn't find link 'urn:publicid:IDN+exogeni.net:bbnNet+interface+BbnNet:IBM:G8052:TenGigabitEthernet:1:1:ethernet' in path 'linkEG' in EG manifest rspec (usually harmless; 2 or 3 of these may happen) 15:01:18 INFO stitch.Aggregate: ... returning Fake avail/suggested 2-4094, 3741 15:01:18 INFO stitch.Aggregate: Allocation at complete. 15:01:18 INFO stitch.Aggregate: Stitcher doing createsliver at https://boss.instageni.gpolab.bbn.com:12369/protogeni/xmlrpc/am 15:01:37 INFO stitch.Aggregate: Allocation at complete. 15:01:37 INFO stitch.Aggregate: Stitcher doing createsliver at http://geni-am.net.internet2.edu:12346 15:02:22 INFO stitch.Aggregate: DCN AM : must wait for status ready.... 15:02:22 INFO stitch.Aggregate: Pause 30 seconds to let circuit become ready... 15:02:59 INFO stitch.Aggregate: Pause 30 seconds to let circuit become ready... 15:03:36 INFO stitch.Aggregate: DCN circuit 83211 is ready 15:03:36 INFO stitch.Aggregate: DCN circuit 83221 is ready 15:03:42 INFO stitch.Aggregate: Allocation at complete. 15:03:42 INFO stitch.launcher: All aggregates are complete. 15:03:42 INFO stitch.ManifestRSpecCombiner: Did not find HopLink urn:publicid:IDN+exogeni.net:bbnvmsite+interface+Bbn:ExoGeni:TenGigabitEthernet:1:ethernet in AM's Man RSpec, though found AM's path linkEG (usually harmless; happens 2+ times for ExoGENI aggregates) 15:03:42 INFO stitch.ManifestRSpecCombiner: Did not find HopLink urn:publicid:IDN+exogeni.net:bbnNet+interface+BbnNet:IBM:G8052:GigabitEthernet:1:2:ethernet in AM's Man RSpec, though found AM's path linkEG (usually harmless; happens 2+ times for ExoGENI aggregates) 15:03:42 INFO stitch.ManifestRSpecCombiner: Did not find HopLink urn:publicid:IDN+exogeni.net:bbnNet+interface+BbnNet:IBM:G8052:TenGigabitEthernet:1:1:ethernet in AM's Man RSpec, though found AM's path linkEG (usually harmless; happens 2+ times for ExoGENI aggregates) 15:03:42 INFO stitcher: Saved combined reservation RSpec at 4 AMs to file 3linear-manifest-rspec-stitching-combined.xml Stitching success: Reserved resources in slice 3linear at 4 Aggregates (including 1 intermediate aggregate(s) not in the original request), creating 2 link(s). }}} Determined login information: {{{ $ readyToLogin.py -a clemson-gr 3linear ... gr-clem's geni_status is: ready User lnevers logs in to gr-clem using: ssh -p 3000 -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@130.127.88.101 }}} Logged into Clemson GR node and exchanged traffic with the other two endpoints: {{{ # ping GPO IG remote lnevers@gr-clem:~$ ping 192.168.1.1 -c 60 -q PING 192.168.1.1 (192.168.1.1) 56(84) bytes of data. --- 192.168.1.1 ping statistics --- 60 packets transmitted, 55 received, 8% packet loss, time 59090ms rtt min/avg/max/mdev = 26.187/26.381/26.544/0.185 ms # ping GPO EG remote lnevers@gr-clem:~$ ping 192.168.2.1 -c 60 -q PING 192.168.2.1 (192.168.2.1) 56(84) bytes of data. --- 192.168.2.1 ping statistics --- 60 packets transmitted, 55 received, 8% packet loss, time 59083ms rtt min/avg/max/mdev = 26.036/26.201/26.414/0.085 ms }}}