| 1 | = GR-EXP-4: GRAM Multi-site Acceptance Test = |
| 2 | |
| 3 | This page captures status for the test case GR-EXP-4. For additional information see the [wiki:GENIRacksHome/GRAMRacks/AcceptanceTestStatusApr2014 Acceptance Test Status - April 2014] page overall status, or the [wiki:GENIRacksHome/AcceptanceTests/GRAMAcceptanceTestsPlan GRAM Acceptance Test Plan] for details about the planned evaluation. |
| 4 | == Multi-site tests with GENI Network Stitching == |
| 5 | |
| 6 | This tests case was modified to use stitching functionality to connect to other existing racks. |
| 7 | |
| 8 | == GRAM to InstaGENI Connection == |
| 9 | |
| 10 | As experimenter "lnevers at bbn dot com" and using stitcher create a sliver that connects GPO InstaGENI to Clemson GRAM. First create the slice: |
| 11 | {{{ |
| 12 | $ omni.py createslice GR-EXP-4-exp1a |
| 13 | 11:45:54 INFO omni: Loading agg_nick_cache file '/home/lnevers/.gcf/agg_nick_cache' |
| 14 | 11:45:54 INFO omni: Loading config file /home/lnevers/.gcf/omni_config |
| 15 | 11:45:54 INFO omni: Setting option useSliceMembers based on omni_config setting |
| 16 | 11:45:54 INFO omni: Using control framework portal |
| 17 | 11:45:54 INFO omni: Member Authority is https://ch.geni.net/MA (from config) |
| 18 | 11:45:54 INFO omni: Slice Authority is https://ch.geni.net/SA (from config) |
| 19 | 11:45:54 INFO omni: Slice GR-EXP-4-exp1a already existed - returning existing slice |
| 20 | 11:45:54 INFO omni: Created slice with Name GR-EXP-4-exp1a, URN urn:publicid:IDN+ch.geni.net:ln-test+slice+GR-EXP-4-exp1a, Expiration 2014-04-11 14:19:33 |
| 21 | 11:45:54 INFO omni: ------------------------------------------------------ |
| 22 | 11:45:54 INFO omni: Completed createslice: |
| 23 | Args: createslice GR-EXP-4-exp1a |
| 24 | Result Summary: Created slice with Name GR-EXP-4-exp1a, URN urn:publicid:IDN+ch.geni.net:ln-test+slice+GR-EXP-4-exp1a, Expiration 2014-04-11 14:19:33 |
| 25 | 11:45:54 INFO omni: ====================================================== |
| 26 | }}} |
| 27 | Then create the sliver: |
| 28 | {{{ |
| 29 | $ stitcher.py createsliver GR-EXP-4-exp1a ./GR-EXP-4-exp1.rspec |
| 30 | 11:46:17 INFO stitcher: Loading agg_nick_cache file '/home/lnevers/.gcf/agg_nick_cache' |
| 31 | 11:46:17 INFO stitcher: Loading config file /home/lnevers/.gcf/omni_config |
| 32 | 11:46:17 INFO stitcher: Setting option useSliceMembers based on omni_config setting |
| 33 | 11:46:17 INFO stitcher: Using control framework portal |
| 34 | 11:46:17 INFO stitcher: Member Authority is https://ch.geni.net/MA (from config) |
| 35 | 11:46:17 INFO stitcher: Slice Authority is https://ch.geni.net/SA (from config) |
| 36 | 11:46:17 INFO stitcher: Checking that slice GR-EXP-4-exp1a is valid... |
| 37 | 11:46:18 INFO stitcher: Slice urn:publicid:IDN+ch.geni.net:ln-test+slice+GR-EXP-4-exp1a expires on 2014-04-11 14:19:33 UTC |
| 38 | 11:46:18 INFO stitcher: Stitched reservation will include resources from these aggregates: |
| 39 | 11:46:18 INFO stitcher: <Aggregate gpo-ig> |
| 40 | 11:46:18 INFO stitcher: <Aggregate urn:publicid:IDN+clemson-clemson-control-1.clemson.edu+authority+am> |
| 41 | 11:46:18 INFO stitcher: <Aggregate ion> |
| 42 | 11:46:18 INFO stitch.Aggregate: |
| 43 | Stitcher doing createsliver at https://boss.instageni.gpolab.bbn.com:12369/protogeni/xmlrpc/am |
| 44 | 11:46:34 ERROR omni: {'output': "vlan tag 3746 for 'link' not available", 'code': {'protogeni_error_log': 'urn:publicid:IDN+instageni.gpolab.bbn.com+log+e1d5e331b3e017a099bdea6a5fe6614d', 'am_type': 'protogeni', 'geni_code': 1, 'am_code': 1, 'protogeni_error_url': 'https://boss.instageni.gpolab.bbn.com/spewlogfile.php3?logfile=e1d5e331b3e017a099bdea6a5fe6614d'}, 'value': 0} |
| 45 | 11:46:34 INFO stitch.Aggregate: A requested VLAN was unavailable doing createsliver GR-EXP-4-exp1a at <Aggregate gpo-ig>: AMAPIError: Error from Aggregate: code 1. protogeni AM code: 1: vlan tag 3746 for 'link' not available. |
| 46 | 11:46:34 INFO stitch.launcher: Will put <Aggregate gpo-ig> back in the pool to allocate. Got VLAN was unavailable. Retry <Aggregate gpo-ig> 2nd time with <Hop u'urn:publicid:IDN+instageni.gpolab.bbn.com+interface+procurve2:5.24.ion.newy.ae0' on path u'link'> new suggested 3709 (not 3746) |
| 47 | 11:46:34 INFO stitch.launcher: Pausing for 30 seconds for Aggregates to free up resources... |
| 48 | |
| 49 | |
| 50 | 11:47:04 INFO stitch.Aggregate: |
| 51 | Stitcher doing createsliver at https://clemson-clemson-control-1.clemson.edu:5001 |
| 52 | 11:47:05 WARNING omni: Requested API version 2, but AM https://clemson-clemson-control-1.clemson.edu:5001 uses version 3. Same aggregate talks API v2 at a different URL: https://clemson-clemson-control-1.clemson.edu:5002 |
| 53 | 11:48:43 INFO stitch.Aggregate: Allocation at <Aggregate urn:publicid:IDN+clemson-clemson-control-1.clemson.edu+authority+am> complete. |
| 54 | 11:48:43 INFO stitch.Aggregate: |
| 55 | Stitcher doing createsliver at https://boss.instageni.gpolab.bbn.com:12369/protogeni/xmlrpc/am |
| 56 | 11:48:57 INFO stitch.Aggregate: Allocation at <Aggregate gpo-ig> complete. |
| 57 | 11:48:57 INFO stitch.Aggregate: |
| 58 | Stitcher doing createsliver at http://geni-am.net.internet2.edu:12346 |
| 59 | 11:49:41 INFO stitch.Aggregate: DCN AM <Aggregate ion>: must wait for status ready.... |
| 60 | 11:49:41 INFO stitch.Aggregate: Pause 30 seconds to let circuit become ready... |
| 61 | 11:50:18 INFO stitch.Aggregate: DCN circuit 83061 is ready |
| 62 | 11:50:25 INFO stitch.Aggregate: Allocation at <Aggregate ion> complete. |
| 63 | 11:50:25 INFO stitch.launcher: All aggregates are complete. |
| 64 | 11:50:25 INFO stitcher: Saved combined reservation RSpec at 3 AMs to file GR-EXP-4-exp1a-manifest-rspec-stitching-combined.xml |
| 65 | Stitching success: Reserved resources in slice GR-EXP-4-exp1a at 3 Aggregates (including 1 intermediate aggregate(s) not in the original request), creating 1 link(s). |
| 66 | }}} |
| 67 | |
| 68 | Determine login information for nodes: |
| 69 | {{{ |
| 70 | $ readyToLogin.py -a clemson-gr GR-EXP-4-exp1a |
| 71 | ... |
| 72 | gr-clem's geni_status is: ready |
| 73 | User lnevers logs in to gr-clem using: |
| 74 | ssh -p 3005 -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@130.127.88.101 |
| 75 | |
| 76 | $ readyToLogin.py -a gpo-ig GR-EXP-4-exp1a |
| 77 | ... |
| 78 | ig-gpo's geni_status is: ready (am_status:ready) |
| 79 | User lnevers logs in to ig-gpo using: |
| 80 | ssh -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@pc2.instageni.gpolab.bbn.com |
| 81 | }}} |
| 82 | |
| 83 | === Measurements collected with Raw PC === |
| 84 | |
| 85 | '''Iperf GPO IG to Clemson GR (TCP) - TCP window size: 23.5 KByte (default)''' |
| 86 | |
| 87 | ''Collected: 2014-04-07'' |
| 88 | |
| 89 | __One Client_ |
| 90 | {{{ |
| 91 | [ ID] Interval Transfer Bandwidth |
| 92 | [ 3] 0.0-60.0 sec 682 MBytes 95.3 Mbits/sec |
| 93 | }}} |
| 94 | |
| 95 | __Five Clients__ |
| 96 | {{{ |
| 97 | [ ID] Interval Transfer Bandwidth |
| 98 | [ 7] 0.0-60.0 sec 153 MBytes 21.4 Mbits/sec |
| 99 | [ 5] 0.0-60.1 sec 146 MBytes 20.4 Mbits/sec |
| 100 | [ 6] 0.0-60.1 sec 122 MBytes 17.0 Mbits/sec |
| 101 | [ 4] 0.0-60.1 sec 145 MBytes 20.3 Mbits/sec |
| 102 | [ 3] 0.0-60.1 sec 114 MBytes 15.9 Mbits/sec |
| 103 | [SUM] 0.0-60.1 sec 680 MBytes 94.9 Mbits/sec |
| 104 | }}} |
| 105 | |
| 106 | __Ten Clients__ |
| 107 | {{{ |
| 108 | [ ID] Interval Transfer Bandwidth |
| 109 | [ 8] 0.0-60.0 sec 81.1 MBytes 11.3 Mbits/sec |
| 110 | [ 3] 0.0-60.0 sec 74.9 MBytes 10.5 Mbits/sec |
| 111 | [ 10] 0.0-60.0 sec 66.1 MBytes 9.24 Mbits/sec |
| 112 | [ 5] 0.0-60.0 sec 49.9 MBytes 6.97 Mbits/sec |
| 113 | [ 9] 0.0-60.1 sec 57.8 MBytes 8.07 Mbits/sec |
| 114 | [ 7] 0.0-60.1 sec 63.5 MBytes 8.86 Mbits/sec |
| 115 | [ 12] 0.0-60.2 sec 61.8 MBytes 8.61 Mbits/sec |
| 116 | [ 6] 0.0-60.2 sec 68.6 MBytes 9.56 Mbits/sec |
| 117 | [ 4] 0.0-60.3 sec 79.1 MBytes 11.0 Mbits/sec |
| 118 | [ 11] 0.0-60.3 sec 73.2 MBytes 10.2 Mbits/sec |
| 119 | [SUM] 0.0-60.3 sec 676 MBytes 94.0 Mbits/sec |
| 120 | }}} |
| 121 | |
| 122 | '''Iperf GPO IG to Clemson GR (UDP) - UDP buffer size: 224 KByte (default) ''' |
| 123 | {{{ |
| 124 | [ ID] Interval Transfer Bandwidth |
| 125 | [ 3] 0.0-60.0 sec 719 MBytes 101 Mbits/sec |
| 126 | [ 3] Sent 512822 datagrams |
| 127 | [ 3] Server Report: |
| 128 | [ 3] 0.0-59.8 sec 686 MBytes 96.2 Mbits/sec 0.017 ms 23581/512821 (4.6%) |
| 129 | [ 3] 0.0-59.8 sec 1 datagrams received out-of-order |
| 130 | }}} |
| 131 | |
| 132 | '''Ping from GPO IG to the Clemson GR ''' |
| 133 | {{{ |
| 134 | 60 packets transmitted, 56 received, 6% packet loss, time 59102ms |
| 135 | rtt min/avg/max/mdev = 25.920/25.972/26.224/0.220 ms |
| 136 | }}} |
| 137 | |
| 138 | '''Iperf Clemson GR to GPO IG (TCP) - TCP window size: 23.5 KByte (default)''' |
| 139 | |
| 140 | ''Collected: 2014-04-07'' |
| 141 | |
| 142 | __One Client_ |
| 143 | {{{ |
| 144 | [ ID] Interval Transfer Bandwidth |
| 145 | [ 3] 0.0-63.3 sec 1.14 GBytes 154 Mbits/sec |
| 146 | }}} |
| 147 | |
| 148 | __Five Clients__ |
| 149 | {{{ |
| 150 | [ ID] Interval Transfer Bandwidth |
| 151 | [ 5] 0.0-60.7 sec 305 MBytes 42.1 Mbits/sec |
| 152 | [ 4] 0.0-60.7 sec 342 MBytes 47.3 Mbits/sec |
| 153 | [ 6] 0.0-61.2 sec 295 MBytes 40.5 Mbits/sec |
| 154 | [ 3] 0.0-61.1 sec 562 MBytes 77.1 Mbits/sec |
| 155 | [ 7] 0.0-61.4 sec 350 MBytes 47.8 Mbits/sec |
| 156 | [SUM] 0.0-61.4 sec 1.81 GBytes 253 Mbits/sec |
| 157 | }}} |
| 158 | |
| 159 | __Ten Clients__ |
| 160 | {{{ |
| 161 | [ ID] Interval Transfer Bandwidth |
| 162 | [ 8] 0.0-60.0 sec 184 MBytes 25.7 Mbits/sec |
| 163 | [ 4] 0.0-60.0 sec 151 MBytes 21.1 Mbits/sec |
| 164 | [ 9] 0.0-60.2 sec 190 MBytes 26.5 Mbits/sec |
| 165 | [ 10] 0.0-60.3 sec 139 MBytes 19.3 Mbits/sec |
| 166 | [ 6] 0.0-60.6 sec 314 MBytes 43.4 Mbits/sec |
| 167 | [ 11] 0.0-60.7 sec 562 MBytes 77.8 Mbits/sec |
| 168 | [ 3] 0.0-60.8 sec 148 MBytes 20.3 Mbits/sec |
| 169 | [ 12] 0.0-61.9 sec 338 MBytes 45.8 Mbits/sec |
| 170 | [ 5] 0.0-62.6 sec 340 MBytes 45.6 Mbits/sec |
| 171 | [ 7] 0.0-62.6 sec 385 MBytes 51.5 Mbits/sec |
| 172 | [SUM] 0.0-62.6 sec 2.69 GBytes 369 Mbits/sec |
| 173 | }}} |
| 174 | |
| 175 | '''Iperf Clemson GR to GPO IG (UDP) - UDP buffer size: 224 KByte (default) ''' |
| 176 | {{{ |
| 177 | [ ID] Interval Transfer Bandwidth |
| 178 | [ 3] 0.0-60.0 sec 719 MBytes 101 Mbits/sec |
| 179 | [ 3] Sent 512821 datagrams |
| 180 | [ 3] Server Report: |
| 181 | [ 3] 0.0-60.0 sec 707 MBytes 98.8 Mbits/sec 0.011 ms 8651/512820 (1.7%) |
| 182 | [ 3] 0.0-60.0 sec 24 datagrams received out-of-order |
| 183 | }}} |
| 184 | |
| 185 | '''Ping from Clemson GR to GPO IG ''' |
| 186 | {{{ |
| 187 | 60 packets transmitted, 58 received, 3% packet loss, time 59113ms |
| 188 | rtt min/avg/max/mdev = 25.935/26.008/26.786/0.264 ms |
| 189 | }}} |
| 190 | |
| 191 | |
| 192 | === Measurements with XEN === |
| 193 | |
| 194 | '''Iperf GPO IG to Clemson GR (TCP) - TCP window size: 23.5 KByte (default)''' |
| 195 | |
| 196 | ''Collected: 2014-04-04'' |
| 197 | |
| 198 | __One Client_ |
| 199 | {{{ |
| 200 | [ ID] Interval Transfer Bandwidth |
| 201 | [ 3] 0.0-75.1 sec 3.62 MBytes 405 Kbits/sec |
| 202 | }}} |
| 203 | |
| 204 | __Five Clients__ |
| 205 | {{{ |
| 206 | [ ID] Interval Transfer Bandwidth |
| 207 | [ 7] 0.0-58.1 sec 40.8 MBytes 5.89 Mbits/sec |
| 208 | [ 5] 0.0-58.4 sec 19.9 MBytes 2.86 Mbits/sec |
| 209 | [ 6] 0.0-58.6 sec 24.5 MBytes 3.50 Mbits/sec |
| 210 | [ 3] 0.0-60.8 sec 28.8 MBytes 3.97 Mbits/sec |
| 211 | [ 4] 0.0-61.2 sec 26.8 MBytes 3.66 Mbits/sec |
| 212 | [SUM] 0.0-61.2 sec 141 MBytes 19.3 Mbits/sec |
| 213 | }}} |
| 214 | |
| 215 | __Ten Clients__ |
| 216 | {{{ |
| 217 | [ ID] Interval Transfer Bandwidth |
| 218 | [ 3] 0.0-60.3 sec 17.4 MBytes 2.42 Mbits/sec |
| 219 | [ 6] 0.0-60.4 sec 16.6 MBytes 2.31 Mbits/sec |
| 220 | [ 10] 0.0-60.7 sec 13.5 MBytes 1.87 Mbits/sec |
| 221 | [ 8] 0.0-60.7 sec 10.5 MBytes 1.45 Mbits/sec |
| 222 | [ 12] 0.0-60.8 sec 17.5 MBytes 2.42 Mbits/sec |
| 223 | [ 7] 0.0-60.8 sec 10.4 MBytes 1.43 Mbits/sec |
| 224 | [ 9] 0.0-61.0 sec 12.9 MBytes 1.77 Mbits/sec |
| 225 | [ 4] 0.0-61.0 sec 12.1 MBytes 1.67 Mbits/sec |
| 226 | [ 5] 0.0-61.1 sec 12.5 MBytes 1.72 Mbits/sec |
| 227 | [ 11] 0.0-62.9 sec 20.4 MBytes 2.72 Mbits/sec |
| 228 | [SUM] 0.0-62.9 sec 144 MBytes 19.2 Mbits/sec |
| 229 | }}} |
| 230 | |
| 231 | '''Iperf GPO IG to Clemson GR (UDP) - UDP buffer size: 224 KByte (default) ''' |
| 232 | {{{ |
| 233 | [ ID] Interval Transfer Bandwidth |
| 234 | [ 3] 0.0-63.9 sec 338 MBytes 44.4 Mbits/sec |
| 235 | [ 3] Sent 241301 datagrams |
| 236 | [ 3] Server Report: |
| 237 | [ 3] 0.0-64.1 sec 65.5 MBytes 8.57 Mbits/sec 14.622 ms 194557/241299 (81%) |
| 238 | }}} |
| 239 | |
| 240 | '''Ping from GPO IG to Clemson GR ''' |
| 241 | {{{ |
| 242 | 60 packets transmitted, 58 received, 3% packet loss, time 59083ms |
| 243 | rtt min/avg/max/mdev = 26.130/26.302/26.728/0.241 ms |
| 244 | }}} |
| 245 | |
| 246 | '''Iperf Clemson GR to GPO IG (TCP) - TCP window size: 23.5 KByte (default)''' |
| 247 | |
| 248 | ''Collected: 2014-04-04'' |
| 249 | |
| 250 | __One Client_ |
| 251 | {{{ |
| 252 | [ ID] Interval Transfer Bandwidth |
| 253 | [ 3] 0.0-60.1 sec 135 MBytes 18.8 Mbits/sec |
| 254 | }}} |
| 255 | |
| 256 | __Five Clients__ |
| 257 | {{{ |
| 258 | [ ID] Interval Transfer Bandwidth |
| 259 | [ 7] 0.0-60.4 sec 24.5 MBytes 3.40 Mbits/sec |
| 260 | [ 5] 0.0-60.5 sec 30.1 MBytes 4.18 Mbits/sec |
| 261 | [ 3] 0.0-60.6 sec 28.1 MBytes 3.89 Mbits/sec |
| 262 | [ 4] 0.0-60.7 sec 26.6 MBytes 3.68 Mbits/sec |
| 263 | [ 6] 0.0-60.7 sec 29.5 MBytes 4.07 Mbits/sec |
| 264 | [SUM] 0.0-60.7 sec 139 MBytes 19.2 Mbits/sec |
| 265 | }}} |
| 266 | |
| 267 | __Ten Clients__ |
| 268 | {{{ |
| 269 | [ ID] Interval Transfer Bandwidth |
| 270 | [ 9] 0.0-60.1 sec 12.4 MBytes 1.73 Mbits/sec |
| 271 | [ 10] 0.0-60.1 sec 16.9 MBytes 2.35 Mbits/sec |
| 272 | [ 3] 0.0-60.3 sec 17.2 MBytes 2.40 Mbits/sec |
| 273 | [ 7] 0.0-60.6 sec 14.2 MBytes 1.97 Mbits/sec |
| 274 | [ 5] 0.0-60.8 sec 16.9 MBytes 2.33 Mbits/sec |
| 275 | [ 4] 0.0-60.8 sec 12.8 MBytes 1.76 Mbits/sec |
| 276 | [ 12] 0.0-60.9 sec 14.8 MBytes 2.03 Mbits/sec |
| 277 | [ 11] 0.0-61.4 sec 16.8 MBytes 2.29 Mbits/sec |
| 278 | [ 8] 0.0-61.6 sec 13.9 MBytes 1.89 Mbits/sec |
| 279 | [ 6] 0.0-61.9 sec 11.0 MBytes 1.49 Mbits/sec |
| 280 | [SUM] 0.0-61.9 sec 147 MBytes 19.9 Mbits/sec |
| 281 | }}} |
| 282 | |
| 283 | '''Iperf Clemson GR to GPO IG (UDP) - UDP buffer size: 224 KByte (default) ''' |
| 284 | {{{ |
| 285 | [ ID] Interval Transfer Bandwidth |
| 286 | [ 3] 0.0-60.0 sec 719 MBytes 101 Mbits/sec |
| 287 | [ 3] Sent 512821 datagrams |
| 288 | [ 3] Server Report: |
| 289 | [ 3] 0.0-59.6 sec 138 MBytes 19.4 Mbits/sec 0.073 ms 414393/512820 (81%) |
| 290 | [ 3] 0.0-59.6 sec 1 datagrams received out-of-order |
| 291 | }}} |
| 292 | |
| 293 | '''Ping from Clemson GR to GPO IG ''' |
| 294 | {{{ |
| 295 | 60 packets transmitted, 57 received, 5% packet loss, time 59097ms |
| 296 | rtt min/avg/max/mdev = 26.020/26.650/39.173/2.035 ms |
| 297 | }}} |
| 298 | |
| 299 | == GRAM to ExoGENI Connection == |
| 300 | |
| 301 | As experimenter "lnevers1 at bbn dot com" and using stitcher create a sliver that connects GPO ExoGENI Bare Metal to Clemson GRAM. First create the slice: |
| 302 | {{{ |
| 303 | $ omni.py createslice GR-EXP-4-exp2 |
| 304 | 11:58:56 INFO omni: Loading agg_nick_cache file '/home/lnevers1/.gcf/agg_nick_cache' |
| 305 | 11:58:56 INFO omni: Loading config file /home/lnevers1/.gcf/omni_config |
| 306 | 11:58:56 INFO omni: Setting option useSliceMembers based on omni_config setting |
| 307 | 11:58:56 INFO omni: Using control framework portal |
| 308 | 11:58:56 INFO omni: Member Authority is https://ch.geni.net/MA (from config) |
| 309 | 11:58:56 INFO omni: Slice Authority is https://ch.geni.net/SA (from config) |
| 310 | 11:58:57 INFO omni: Created slice with Name GR-EXP-4-exp2, URN urn:publicid:IDN+ch.geni.net:XYZ19+slice+GR-EXP-4-exp2, Expiration 2014-04-11 15:58:56 |
| 311 | 11:58:57 INFO omni: ------------------------------------------------------ |
| 312 | 11:58:57 INFO omni: Completed createslice: |
| 313 | Args: createslice GR-EXP-4-exp2 |
| 314 | |
| 315 | Result Summary: Created slice with Name GR-EXP-4-exp2, URN urn:publicid:IDN+ch.geni.net:XYZ19+slice+GR-EXP-4-exp2, Expiration 2014-04-11 15:58:56 |
| 316 | |
| 317 | 11:58:57 INFO omni: ====================================================== |
| 318 | }}} |
| 319 | Then create the sliver: |
| 320 | {{{ |
| 321 | $ stitcher.py createsliver GR-EXP-4-exp2 ./GR-EXP-4-exp2.rspec --useExoSM |
| 322 | 13:09:03 INFO stitcher: Loading agg_nick_cache file '/home/lnevers1/.gcf/agg_nick_cache' |
| 323 | 13:09:03 INFO stitcher: Loading config file /home/lnevers1/.gcf/omni_config |
| 324 | 13:09:03 INFO stitcher: Setting option useSliceMembers based on omni_config setting |
| 325 | 13:09:03 INFO stitcher: Using control framework portal |
| 326 | 13:09:03 INFO stitcher: Member Authority is https://ch.geni.net/MA (from config) |
| 327 | 13:09:03 INFO stitcher: Slice Authority is https://ch.geni.net/SA (from config) |
| 328 | 13:09:03 INFO stitcher: Checking that slice GR-EXP-4-exp2 is valid... |
| 329 | 13:09:03 INFO stitcher: Slice urn:publicid:IDN+ch.geni.net:XYZ19+slice+GR-EXP-4-exp2 expires on 2014-04-11 15:58:56 UTC |
| 330 | 13:09:04 INFO stitcher: <Aggregate urn:publicid:IDN+exogeni.net:bbnvmsite+authority+am> is an EG AM and user asked for ExoSM. Changing to https://geni.renci.org:11443/orca/xmlrpc |
| 331 | 13:09:04 INFO stitcher: Stitched reservation will include resources from these aggregates: |
| 332 | 13:09:04 INFO stitcher: <Aggregate urn:publicid:IDN+clemson-clemson-control-1.clemson.edu+authority+am> |
| 333 | 13:09:04 INFO stitcher: <Aggregate eg-sm> |
| 334 | 13:09:04 INFO stitcher: <Aggregate ion> |
| 335 | 13:09:04 INFO stitch.Aggregate: |
| 336 | Stitcher doing createsliver at https://clemson-clemson-control-1.clemson.edu:5001 |
| 337 | 13:09:05 WARNING omni: Requested API version 2, but AM https://clemson-clemson-control-1.clemson.edu:5001 uses version 3. Same aggregate talks API v2 at a different URL: https://clemson-clemson-control-1.clemson.edu:5002 |
| 338 | 13:11:11 INFO stitch.Aggregate: Allocation at <Aggregate urn:publicid:IDN+clemson-clemson-control-1.clemson.edu+authority+am> complete. |
| 339 | 13:11:11 INFO stitch.Aggregate: |
| 340 | Stitcher doing createsliver at https://geni.renci.org:11443/orca/xmlrpc |
| 341 | 13:11:32 INFO stitch.Aggregate: <Aggregate eg-sm>: Couldn't find link 'urn:publicid:IDN+exogeni.net:bbnvmsite+interface+Bbn:ExoGeni:TenGigabitEthernet:1:ethernet' in path 'link' in EG manifest rspec (usually harmless; 2 or 3 of these may happen) |
| 342 | 13:11:32 INFO stitch.Aggregate: ... returning Fake avail/suggested 2-4094, 3736 |
| 343 | 13:11:32 INFO stitch.Aggregate: <Aggregate eg-sm>: Couldn't find link 'urn:publicid:IDN+exogeni.net:bbnNet+interface+BbnNet:IBM:G8052:TenGigabitEthernet:1:1:ethernet' in path 'link' in EG manifest rspec (usually harmless; 2 or 3 of these may happen) |
| 344 | 13:11:32 INFO stitch.Aggregate: ... returning Fake avail/suggested 2-4094, 3736 |
| 345 | 13:11:32 INFO stitch.Aggregate: <Aggregate eg-sm>: Couldn't find link 'urn:publicid:IDN+exogeni.net:bbnNet+interface+BbnNet:IBM:G8052:GigabitEthernet:1:2:ethernet' in path 'link' in EG manifest rspec (usually harmless; 2 or 3 of these may happen) |
| 346 | 13:11:32 INFO stitch.Aggregate: ... returning Fake avail/suggested 2-4094, 3736 |
| 347 | 13:11:32 INFO stitch.Aggregate: Allocation at <Aggregate eg-sm> complete. |
| 348 | 13:11:32 INFO stitch.Aggregate: |
| 349 | Stitcher doing createsliver at http://geni-am.net.internet2.edu:12346 |
| 350 | 13:12:16 INFO stitch.Aggregate: DCN AM <Aggregate ion>: must wait for status ready.... |
| 351 | 13:12:16 INFO stitch.Aggregate: Pause 30 seconds to let circuit become ready... |
| 352 | 13:12:53 INFO stitch.Aggregate: DCN circuit 83151 is ready |
| 353 | 13:13:00 INFO stitch.Aggregate: Allocation at <Aggregate ion> complete. |
| 354 | 13:13:00 INFO stitch.launcher: All aggregates are complete. |
| 355 | 13:13:00 INFO stitch.ManifestRSpecCombiner: Did not find HopLink urn:publicid:IDN+exogeni.net:bbnvmsite+interface+Bbn:ExoGeni:TenGigabitEthernet:1:ethernet in AM's Man RSpec, though found AM's path link (usually harmless; happens 2+ times for ExoGENI aggregates) |
| 356 | 13:13:00 INFO stitch.ManifestRSpecCombiner: Did not find HopLink urn:publicid:IDN+exogeni.net:bbnNet+interface+BbnNet:IBM:G8052:TenGigabitEthernet:1:1:ethernet in AM's Man RSpec, though found AM's path link (usually harmless; happens 2+ times for ExoGENI aggregates) |
| 357 | 13:13:00 INFO stitch.ManifestRSpecCombiner: Did not find HopLink urn:publicid:IDN+exogeni.net:bbnNet+interface+BbnNet:IBM:G8052:GigabitEthernet:1:2:ethernet in AM's Man RSpec, though found AM's path link (usually harmless; happens 2+ times for ExoGENI aggregates) |
| 358 | 13:13:00 INFO stitcher: Saved combined reservation RSpec at 3 AMs to file GR-EXP-4-exp2-manifest-rspec-stitching-combined.xml |
| 359 | Stitching success: Reserved resources in slice GR-EXP-4-exp2 at 3 Aggregates (including 1 intermediate aggregate(s) not in the original request), creating 1 link(s). |
| 360 | }}} |
| 361 | |
| 362 | Determine login information: |
| 363 | {{{ |
| 364 | $ readyToLogin.py -a clemson-gr GR-EXP-4-exp2 |
| 365 | ... |
| 366 | gr-clem's geni_status is: ready |
| 367 | User lnevers1 logs in to gr-clem using: |
| 368 | ssh -p 3000 -i /home/lnevers1/.ssh/geni_cert_portal_key lnevers1@130.127.88.101 |
| 369 | User lnevers logs in to gr-clem using: |
| 370 | ssh -p 3000 -i /home/lnevers1/.ssh/geni_cert_portal_key lnevers@130.127.88.101 |
| 371 | |
| 372 | |
| 373 | $ readyToLogin.py -a eg-sm GR-EXP-4-exp2 |
| 374 | ... |
| 375 | |
| 376 | eg-gpo's geni_status is: ready (am_status:ready) |
| 377 | User lnevers1 logs in to eg-gpo using: |
| 378 | ssh -i /home/lnevers1/.ssh/geni_cert_portal_key lnevers1@192.1.242.111 |
| 379 | }}} |
| 380 | |
| 381 | === Measurements collected with Bare Metal node === |
| 382 | |
| 383 | '''Iperf GPO EG to Clemson GR (TCP) - TCP window size: 23.5 KByte (default)''' |
| 384 | |
| 385 | ''Collected: 2014-04-04'' |
| 386 | |
| 387 | __One Client_ |
| 388 | {{{ |
| 389 | [ ID] Interval Transfer Bandwidth |
| 390 | [ 3] 0.0-60.0 sec 967 MBytes 135 Mbits/sec |
| 391 | }}} |
| 392 | |
| 393 | __Five Clients__ |
| 394 | {{{ |
| 395 | [ ID] Interval Transfer Bandwidth |
| 396 | [ 6] 0.0-60.0 sec 785 MBytes 110 Mbits/sec |
| 397 | [ 7] 0.0-60.0 sec 968 MBytes 135 Mbits/sec |
| 398 | [ 5] 0.0-60.0 sec 969 MBytes 135 Mbits/sec |
| 399 | [ 4] 0.0-60.0 sec 769 MBytes 107 Mbits/sec |
| 400 | [ 3] 0.0-60.0 sec 968 MBytes 135 Mbits/sec |
| 401 | [SUM] 0.0-60.0 sec 4.35 GBytes 623 Mbits/sec |
| 402 | }}} |
| 403 | |
| 404 | __Ten Clients__ |
| 405 | {{{ |
| 406 | [ ID] Interval Transfer Bandwidth |
| 407 | [ 10] 0.0-60.0 sec 502 MBytes 70.1 Mbits/sec |
| 408 | [ 8] 0.0-60.0 sec 590 MBytes 82.5 Mbits/sec |
| 409 | [ 11] 0.0-60.0 sec 706 MBytes 98.7 Mbits/sec |
| 410 | [ 7] 0.0-60.0 sec 647 MBytes 90.4 Mbits/sec |
| 411 | [ 6] 0.0-60.0 sec 660 MBytes 92.3 Mbits/sec |
| 412 | [ 3] 0.0-60.0 sec 658 MBytes 92.0 Mbits/sec |
| 413 | [ 5] 0.0-60.0 sec 425 MBytes 59.4 Mbits/sec |
| 414 | [ 9] 0.0-60.0 sec 498 MBytes 69.5 Mbits/sec |
| 415 | [ 4] 0.0-60.1 sec 431 MBytes 60.2 Mbits/sec |
| 416 | [ 12] 0.0-60.1 sec 606 MBytes 84.7 Mbits/sec |
| 417 | [SUM] 0.0-60.1 sec 5.59 GBytes 800 Mbits/sec |
| 418 | }}} |
| 419 | |
| 420 | '''Iperf GPO EG to Clemson GR (UDP) - UDP buffer size: 224 KByte (default) ''' |
| 421 | {{{ |
| 422 | [ ID] Interval Transfer Bandwidth |
| 423 | [ 3] 0.0-60.0 sec 71.5 MBytes 10.0 Mbits/sec |
| 424 | [ 3] Sent 51022 datagrams |
| 425 | [ 3] Server Report: |
| 426 | [ 3] 0.0-225.1 sec 26.6 MBytes 992 Kbits/sec 0.007 ms 32027/51022 (63%) |
| 427 | }}} |
| 428 | |
| 429 | '''Ping from GPO EG to the Clemson GR ''' |
| 430 | {{{ |
| 431 | 60 packets transmitted, 58 received, 3% packet loss, time 61332ms |
| 432 | rtt min/avg/max/mdev = 25.968/47.021/1132.921/144.538 ms, pipe 2 |
| 433 | }}} |
| 434 | |
| 435 | '''Iperf Clemson GR to GPO EG (TCP) - TCP window size: 23.5 KByte (default)''' |
| 436 | |
| 437 | ''Collected: 2014-04-04'' |
| 438 | |
| 439 | __One Client_ |
| 440 | {{{ |
| 441 | [ ID] Interval Transfer Bandwidth |
| 442 | [ 3] 0.0-60.0 sec 240 MBytes 33.6 Mbits/sec |
| 443 | }}} |
| 444 | |
| 445 | __Five Clients__ |
| 446 | {{{ |
| 447 | [ ID] Interval Transfer Bandwidth |
| 448 | [ 6] 0.0-60.1 sec 251 MBytes 35.0 Mbits/sec |
| 449 | [ 5] 0.0-60.1 sec 269 MBytes 37.6 Mbits/sec |
| 450 | [ 3] 0.0-60.1 sec 199 MBytes 27.7 Mbits/sec |
| 451 | [ 7] 0.0-60.1 sec 216 MBytes 30.2 Mbits/sec |
| 452 | [ 4] 0.0-60.1 sec 300 MBytes 41.8 Mbits/sec |
| 453 | [SUM] 0.0-60.1 sec 1.21 GBytes 172 Mbits/sec |
| 454 | }}} |
| 455 | |
| 456 | __Ten Clients__ |
| 457 | {{{ |
| 458 | [ ID] Interval Transfer Bandwidth |
| 459 | [ 7] 0.0-60.0 sec 133 MBytes 18.6 Mbits/sec |
| 460 | [ 4] 0.0-60.0 sec 418 MBytes 58.4 Mbits/sec |
| 461 | [ 5] 0.0-60.0 sec 138 MBytes 19.2 Mbits/sec |
| 462 | [ 8] 0.0-60.1 sec 143 MBytes 20.0 Mbits/sec |
| 463 | [ 9] 0.0-60.1 sec 132 MBytes 18.4 Mbits/sec |
| 464 | [ 12] 0.0-60.1 sec 123 MBytes 17.2 Mbits/sec |
| 465 | [ 6] 0.0-60.1 sec 137 MBytes 19.1 Mbits/sec |
| 466 | [ 3] 0.0-60.1 sec 143 MBytes 20.0 Mbits/sec |
| 467 | [ 10] 0.0-60.1 sec 128 MBytes 17.8 Mbits/sec |
| 468 | [ 11] 0.0-60.1 sec 149 MBytes 20.8 Mbits/sec |
| 469 | [SUM] 0.0-60.1 sec 1.61 GBytes 229 Mbits/sec |
| 470 | }}} |
| 471 | |
| 472 | '''Iperf Clemson GR to GPO EG (UDP) - UDP buffer size: 224 KByte (default) ''' |
| 473 | {{{ |
| 474 | [ ID] Interval Transfer Bandwidth |
| 475 | [ 3] 0.0-60.0 sec 35.8 MBytes 5.00 Mbits/sec |
| 476 | [ 3] Sent 25512 datagrams |
| 477 | [ 3] Server Report: |
| 478 | [ 3] 0.0-59.9 sec 25.0 MBytes 3.50 Mbits/sec 0.053 ms 7685/25511 (30%) |
| 479 | [ 3] 0.0-59.9 sec 1 datagrams received out-of-order |
| 480 | }}} |
| 481 | |
| 482 | '''Ping from Clemson GR to GPO EG ''' |
| 483 | {{{ |
| 484 | 60 packets transmitted, 57 received, 5% packet loss, time 59091ms |
| 485 | rtt min/avg/max/mdev = 25.961/26.031/26.195/0.092 ms |
| 486 | }}} |
| 487 | |
| 488 | |
| 489 | === Three node linear topology === |
| 490 | |
| 491 | To verify that the GRAM rack could support more than one link created a 3 node linear topology which included: |
| 492 | |
| 493 | GPO EG <-> Clemson GR <-> GPO IG |
| 494 | |
| 495 | Created the sliver: |
| 496 | {{{ |
| 497 | $ stitcher.py createsliver 3linear ./stitch-gr-clem-3linear.rspec |
| 498 | 14:57:31 INFO stitcher: Loading agg_nick_cache file '/home/lnevers/.gcf/agg_nick_cache' |
| 499 | 14:57:31 INFO stitcher: Loading config file /home/lnevers/.gcf/omni_config |
| 500 | 14:57:31 INFO stitcher: Setting option useSliceMembers based on omni_config setting |
| 501 | 14:57:31 INFO stitcher: Using control framework portal |
| 502 | 14:57:31 INFO stitcher: Member Authority is https://ch.geni.net/MA (from config) |
| 503 | 14:57:31 INFO stitcher: Slice Authority is https://ch.geni.net/SA (from config) |
| 504 | 14:57:31 INFO stitcher: Checking that slice 3linear is valid... |
| 505 | 14:57:31 INFO stitcher: Slice urn:publicid:IDN+ch.geni.net:ln-test+slice+3linear expires on 2014-04-11 16:47:51 UTC |
| 506 | 14:57:33 INFO stitcher: Stitched reservation will include resources from these aggregates: |
| 507 | 14:57:33 INFO stitcher: <Aggregate gpo-ig> |
| 508 | 14:57:33 INFO stitcher: <Aggregate urn:publicid:IDN+clemson-clemson-control-1.clemson.edu+authority+am> |
| 509 | 14:57:33 INFO stitcher: <Aggregate gpo-eg> |
| 510 | 14:57:33 INFO stitcher: <Aggregate ion> |
| 511 | 14:57:33 INFO stitch.Aggregate: |
| 512 | Stitcher doing createsliver at https://boss.instageni.gpolab.bbn.com:12369/protogeni/xmlrpc/am |
| 513 | 14:57:46 ERROR omni: {'output': "vlan tag 3748 for 'linkIG' not available", 'code': {'protogeni_error_log': 'urn:publicid:IDN+instageni.gpolab.bbn.com+log+922b6612fbe697b8a01a4f001a5561e0', 'am_type': 'protogeni', 'geni_code': 1, 'am_code': 1, 'protogeni_error_url': 'https://boss.instageni.gpolab.bbn.com/spewlogfile.php3?logfile=922b6612fbe697b8a01a4f001a5561e0'}, 'value': 0} |
| 514 | 14:57:46 INFO stitch.Aggregate: A requested VLAN was unavailable doing createsliver 3linear at <Aggregate gpo-ig>: AMAPIError: Error from Aggregate: code 1. protogeni AM code: 1: vlan tag 3748 for 'linkIG' not available. |
| 515 | 14:57:46 INFO stitch.launcher: Will put <Aggregate gpo-ig> back in the pool to allocate. Got VLAN was unavailable. Retry <Aggregate gpo-ig> 2nd time with <Hop u'urn:publicid:IDN+instageni.gpolab.bbn.com+interface+procurve2:5.24.ion.newy.ae0' on path u'linkIG'> new suggested 3719 (not 3748) |
| 516 | 14:57:46 INFO stitch.launcher: Pausing for 30 seconds for Aggregates to free up resources... |
| 517 | |
| 518 | |
| 519 | 14:58:16 INFO stitch.Aggregate: |
| 520 | Stitcher doing createsliver at https://clemson-clemson-control-1.clemson.edu:5001 |
| 521 | 14:58:17 WARNING omni: Requested API version 2, but AM https://clemson-clemson-control-1.clemson.edu:5001 uses version 3. Same aggregate talks API v2 at a different URL: https://clemson-clemson-control-1.clemson.edu:5002 |
| 522 | 15:01:06 INFO stitch.Aggregate: Allocation at <Aggregate urn:publicid:IDN+clemson-clemson-control-1.clemson.edu+authority+am> complete. |
| 523 | 15:01:06 INFO stitch.Aggregate: |
| 524 | Stitcher doing createsliver at https://bbn-hn.exogeni.net:11443/orca/xmlrpc |
| 525 | 15:01:18 INFO stitch.Aggregate: <Aggregate gpo-eg>: Couldn't find link 'urn:publicid:IDN+exogeni.net:bbnvmsite+interface+Bbn:ExoGeni:TenGigabitEthernet:1:ethernet' in path 'linkEG' in EG manifest rspec (usually harmless; 2 or 3 of these may happen) |
| 526 | 15:01:18 INFO stitch.Aggregate: ... returning Fake avail/suggested 2-4094, 3741 |
| 527 | 15:01:18 INFO stitch.Aggregate: <Aggregate gpo-eg>: Couldn't find link 'urn:publicid:IDN+exogeni.net:bbnNet+interface+BbnNet:IBM:G8052:GigabitEthernet:1:2:ethernet' in path 'linkEG' in EG manifest rspec (usually harmless; 2 or 3 of these may happen) |
| 528 | 15:01:18 INFO stitch.Aggregate: ... returning Fake avail/suggested 2-4094, 3741 |
| 529 | 15:01:18 INFO stitch.Aggregate: <Aggregate gpo-eg>: Couldn't find link 'urn:publicid:IDN+exogeni.net:bbnNet+interface+BbnNet:IBM:G8052:TenGigabitEthernet:1:1:ethernet' in path 'linkEG' in EG manifest rspec (usually harmless; 2 or 3 of these may happen) |
| 530 | 15:01:18 INFO stitch.Aggregate: ... returning Fake avail/suggested 2-4094, 3741 |
| 531 | 15:01:18 INFO stitch.Aggregate: Allocation at <Aggregate gpo-eg> complete. |
| 532 | 15:01:18 INFO stitch.Aggregate: |
| 533 | Stitcher doing createsliver at https://boss.instageni.gpolab.bbn.com:12369/protogeni/xmlrpc/am |
| 534 | 15:01:37 INFO stitch.Aggregate: Allocation at <Aggregate gpo-ig> complete. |
| 535 | 15:01:37 INFO stitch.Aggregate: |
| 536 | Stitcher doing createsliver at http://geni-am.net.internet2.edu:12346 |
| 537 | 15:02:22 INFO stitch.Aggregate: DCN AM <Aggregate ion>: must wait for status ready.... |
| 538 | 15:02:22 INFO stitch.Aggregate: Pause 30 seconds to let circuit become ready... |
| 539 | 15:02:59 INFO stitch.Aggregate: Pause 30 seconds to let circuit become ready... |
| 540 | 15:03:36 INFO stitch.Aggregate: DCN circuit 83211 is ready |
| 541 | 15:03:36 INFO stitch.Aggregate: DCN circuit 83221 is ready |
| 542 | 15:03:42 INFO stitch.Aggregate: Allocation at <Aggregate ion> complete. |
| 543 | 15:03:42 INFO stitch.launcher: All aggregates are complete. |
| 544 | 15:03:42 INFO stitch.ManifestRSpecCombiner: Did not find HopLink urn:publicid:IDN+exogeni.net:bbnvmsite+interface+Bbn:ExoGeni:TenGigabitEthernet:1:ethernet in AM's Man RSpec, though found AM's path linkEG (usually harmless; happens 2+ times for ExoGENI aggregates) |
| 545 | 15:03:42 INFO stitch.ManifestRSpecCombiner: Did not find HopLink urn:publicid:IDN+exogeni.net:bbnNet+interface+BbnNet:IBM:G8052:GigabitEthernet:1:2:ethernet in AM's Man RSpec, though found AM's path linkEG (usually harmless; happens 2+ times for ExoGENI aggregates) |
| 546 | 15:03:42 INFO stitch.ManifestRSpecCombiner: Did not find HopLink urn:publicid:IDN+exogeni.net:bbnNet+interface+BbnNet:IBM:G8052:TenGigabitEthernet:1:1:ethernet in AM's Man RSpec, though found AM's path linkEG (usually harmless; happens 2+ times for ExoGENI aggregates) |
| 547 | 15:03:42 INFO stitcher: Saved combined reservation RSpec at 4 AMs to file 3linear-manifest-rspec-stitching-combined.xml |
| 548 | Stitching success: Reserved resources in slice 3linear at 4 Aggregates (including 1 intermediate aggregate(s) not in the original request), creating 2 link(s). |
| 549 | }}} |
| 550 | |
| 551 | Determined login information: |
| 552 | {{{ |
| 553 | $ readyToLogin.py -a clemson-gr 3linear |
| 554 | ... |
| 555 | gr-clem's geni_status is: ready |
| 556 | User lnevers logs in to gr-clem using: |
| 557 | ssh -p 3000 -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@130.127.88.101 |
| 558 | |
| 559 | }}} |
| 560 | |
| 561 | Logged into Clemson GR node and exchanged traffic with the other two endpoints: |
| 562 | {{{ |
| 563 | # ping GPO IG remote |
| 564 | lnevers@gr-clem:~$ ping 192.168.1.1 -c 60 -q |
| 565 | PING 192.168.1.1 (192.168.1.1) 56(84) bytes of data. |
| 566 | |
| 567 | --- 192.168.1.1 ping statistics --- |
| 568 | 60 packets transmitted, 55 received, 8% packet loss, time 59090ms |
| 569 | rtt min/avg/max/mdev = 26.187/26.381/26.544/0.185 ms |
| 570 | |
| 571 | |
| 572 | # ping GPO EG remote |
| 573 | lnevers@gr-clem:~$ ping 192.168.2.1 -c 60 -q |
| 574 | PING 192.168.2.1 (192.168.2.1) 56(84) bytes of data. |
| 575 | |
| 576 | --- 192.168.2.1 ping statistics --- |
| 577 | 60 packets transmitted, 55 received, 8% packet loss, time 59083ms |
| 578 | rtt min/avg/max/mdev = 26.036/26.201/26.414/0.085 ms |
| 579 | |
| 580 | }}} |