wiki:GENIRacksHome/Performance

Version 44 (modified by lnevers@bbn.com, 6 years ago) (diff)

--

GENI Racks Performance

This page captures performance measurements for GENI Racks using OpenFlow and Stitching Scenarios. The following topologies will be used with raw-pc/bare metal dedicated hosts to collect performance data:

  • Site Confirmations test OpenFlow connections over Meso-scale:
    • New IG or EG Site to GPO IG, GPO EG, Utah PG
  • Site Confirmations test for OpenFlow connection over AL2S:
    • New IG or EG Site to GPO IG, GPO EG, Utah PG
  • Site Stitching Confirmation test via stitched VLAN:
    • New IG or EG Site to GPO IG
    • New IG or EG Site to GPO EG Bare Metal

For details about the performance test criteria see the Test Methodology section.

1.0 Performance Results

All results (meso-scale, AL2S, and stitching) captured on this page are also available in the attached GENI Racks Performance Spreadsheet.

1.1 OpenFlow connections over Meso-scale Connection

Meso-scale Run 2 Results

Results were mostly collected on 2014-01-09 in an overnight test run. Exceptions are (2) run on 2014-01-10 and (3) run on 2014-01-13.

End points One Client(tcp)5 Clients(tcp)10 Clients(tcp)1 client(udp)Ping rtt min/avg/max/mdev
Clemson IG to GPO IG (3) 10.9 Mbits/sec 62.4 Mbits/sec 110 Mbits/sec 101 Mbits/sec 164.605/242.429/2699.317/383.612 ms
Clemson IG to GPO EG (3) 14.6 Mbits/sec 63.5 Mbits/sec 95.9 Mbits/sec 101 Mbits/sec 164.597/236.744/2596.726/362.714 ms,
Clemson IG to PG Utah (3) 4.98 Mbits/sec 16.8 Mbits/sec 9.12 Mbits/sec 73.7 Mbits/sec 109.542/164.085/2105.248/288.803 ms
Wisconsin IG to GPO IG 20.5 Mbits/sec 94.4 Mbits/sec 174 Mbits/sec 101 Mbits/sec 223.437/291.509/2569.446/346.581 ms
Wisconsin IG to GPO EG 11.5 Mbits/sec 47.0 Mbits/sec 86.9 Mbits/sec 101 Mbits/sec 223.475/299.931/2732.393/377.818 ms
Wisconsin IG to PG Utah 2.27 Mbits/sec 12.5 Mbits/sec 22.5 Mbits/sec 73.2 Mbits/sec 141.118/173.372/1492.558/179.663 ms
GATech IG to GPO IG (3) 18.1 Mbits/sec 64.8 Mbits/sec 139 Mbits/sec 101 Mbits/sec 162.066/227.407/2438.457/335.989 ms
GATech IG to GPO EG (3) 19.1 Mbits/sec 71.5 Mbits/sec 122 Mbits/sec 101 Mbits/se 162.092/227.705/2456.414/337.049 ms
GATech IG to PG Utah (3) 3.11 Mbits/sec 16.8 Mbits/sec 15.3 Mbits/sec 73.6 Mbits/sec 106.893/203.628/1488.354/284.866 ms
Northwestern IG to GPO IG 71.7 Mbits/sec 378 Mbits/sec 476 Mbits/sec 101 Mbits/sec 24.347/30.541/394.300/47.357 ms
Northwestern IG to GPO EG 129 Mbits/sec 257 Mbits/sec 525 Mbits/sec 101 Mbits/sec 24.314/31.482/452.330/54.789 ms
Northwestern IG to PG Utah 3.44 Mbits/sec 9.08 Mbits/sec 16.4 Mbits/sec 73.2 Mbits/sec 0.000/353.941/3377.582/500.676 ms
Utah IG to GPO IG 870 Kbits/sec 220 Kbits/sec 5.03 Mbits/sec 82.6 Mbits/sec 267.572/389.508/3529.448/528.933 ms
Utah IG to GPO EG 12.4 Mbits/sec 52.8 Mbits/sec 4.98 Mbits/sec 82.6 Mbits/sec 267.608/374.094/3219.757/473.812 ms
Utah IG to PG Utah see(1) 908 Mbits/sec 922 Mbits/sec 101 Mbits/sec 0.133/2.358/133.263/17.042 ms
Stanford IG to GPO IG 38.7 Mbits/sec 152 Mbits/sec 242 Mbits/sec 101 Mbits/sec 97.352/151.356/2172.346/297.104 ms
Stanford IG to GPO EG 31.4 Mbits/sec 142 Mbits/sec 276 Mbits/sec 101 Mbits/sec 97.328/144.376/2004.508/268.679 ms
Stanford IG to PG Utah 3.07 Mbits/sec 13.2 Mbits/sec 20.2 Mbits/sec 72.7 Mbits/sec 172.194/242.546/2522.587/346.033 ms
NYU IG to GPO IG 14.1 Mbits/sec 61.7 Mbits/sec 86.6 Mbits/sec 101 Mbits/sec 180.129/270.892/2989.070/434.613 ms
NYU IG to GPO EG 8.12 Mbits/sec 64.3 Mbits/sec 102 Mbits/sec 101 Mbits/sec 180.167/270.813/2822.628/420.586 ms
NYU IG to PG Utah 3.55 Mbits/sec 16.6 Mbits/sec 25.6 Mbits/sec 73.4 Mbits/sec 87.424/112.428/1255.048/150.285 ms
FIU EG to GPO IG 24.0 Mbits/sec 74.4 Mbits/sec 145 Mbits/sec 101 Mbits/sec 176.175/238.363/2408.382/326.441 ms
FIU EG to GPO EG 44.5 Mbits/sec 128 Mbits/sec 215 Mbits/sec 101 Mbits/sec 176.164/240.502/2426.307/331.258 ms
FIU EG to PG Utah 3.86 Mbits/sec 13.8 Mbits/sec 20.6 Mbits/sec 73.2 Mbits/sec 121.067/184.518/2331.012/321.109 ms
MAX IG to GPO IG 14.1 Mbits/sec 62.7 Mbits/sec 105 Mbits/sec 101 Mbits/sec 177.402/243.640/2486.008/339.033 ms
MAX IG to GPO EG 13.6 Mbits/sec 55.2 Mbits/sec 112 Mbits/sec 101 Mbits/sec 177.445/244.031/2477.794/340.001 ms
MAX IG to PG Utah 3.85 Mbits/sec 16.0 Mbits/sec 23.1 Mbits/sec 73.4 Mbits/sec 95.027/124.700/1349.733/165.157 ms
Cornell IG to GPO IG 15.2 Mbits/sec 75.3 Mbits/sec 112 Mbits/sec 101 Mbits/sec 187.608/267.211/2768.377/390.637 ms
Cornell IG to GPO EG 13.4 Mbits/sec 66.1 Mbits/sec 135 Mbits/sec 101 Mbits/sec 187.647/273.300/2863.667/413.394 ms
Cornell IG to PG Utah 22.0 Mbits/sec 52.1 Mbits/sec 66.5 Mbits/sec 74.4 Mbits/sec 94.983/120.251/1215.880/145.002 ms
Missouri IG to GPO IG 12.0 Mbits/sec 50.7 Mbits/sec 98.7 Mbits/sec 94.9 Mbits/sec 193.538/258.538/2455.796/334.196 ms
Missouri IG to GPO EG 18.2 Mbits/sec 59.4 Mbits/sec 122 Mbits/sec 101 Mbits/sec 193.550/269.545/2696.825/376.939 ms
Missouri IG to PG Utah 2.67 Mbits/sec 14.6 Mbits/sec 20.1 Mbits/sec 73.6 Mbits/sec 137.582/169.560/1467.011/177.364 ms
UKY IG to GPO IG 12.0 Mbits/sec 52.3 Mbits/sec 98.9 Mbits/sec 101 Mbits/sec 174.480/242.502/2532.513/347.970 ms
UKY IG to GPO EG 11.9 Mbits/sec 57.7 Mbits/sec 117 Mbits/sec 101 Mbits/sec 174.493/245.164/2552.096/355.386 ms
UKY IG to PG Utah 5.51 Mbits/sec 14.2 Mbits/sec 23.3 Mbits/sec 73.6 Mbits/sec 118.564/155.329/1620.124/202.896
Illinois IG to GPO IG 13.0 Mbits/sec 59.2 Mbits/sec 102 Mbits/sec 101 Mbits/sec 219.239/305.993/2947.567/418.736 ms
Illinois IG to GPO EG 13.5 Mbits/sec 61.5 Mbits/sec 94.1 Mbits/sec 101 Mbits/sec 219.229/325.038/3284.657/486.653 ms
Illinois IG to PG Utah 5.52 Mbits/sec 14.2 Mbits/sec 22.5 Mbits/sec 73.6 Mbits/sec 126.527/153.970/1372.223/161.678 ms
Kansas IG to GPO IG 20.7 Mbits/sec 95.9 Mbits/sec 152 Mbits/sec 101 Mbits/sec 191.604/246.551/2266.483/297.061 ms
Kansas IG to GPO EG 12.2 Mbits/sec 75.0 Mbits/sec 159 Mbits/sec 101 Mbits/sec 191.598/263.661/2615.676/362.429 ms
Kansas IG to PG Utah 3.42 Mbits/sec 14.3 Mbits/sec 24.6 Mbits/sec 73.7 Mbits/sec 135.688/163.678/1365.677/161.164 ms
Princeton IG to GPO IG 15.5 Mbits/sec 60.6 Mbits/sec 111 Mbits/sec 101 Mbits/sec 179.376/264.131/2841.306/409.399 ms
Princeton IG to GPO EG 17.7 Mbits/sec 78.6 Mbits/sec 112 Mbits/sec 101 Mbits/sec 179.410/265.331/2864.731/414.106 ms
Princeton IG to PG Utah 4.06 Mbits/sec 13.5 Mbits/sec 23.1 Mbits/sec 73.6 Mbits/sec 97.165/124.312/1296.864/158.901 ms
SOX IG to GPO IG 13.8 Mbits/sec 97.3 Mbits/sec 172 Mbits/sec 101 Mbits/sec 161.887/248.926/2885.673/419.480 ms
SOX IG to GPO EG 37.2 Mbits/sec 185 Mbits/sec 271 Mbits/sec 101 Mbits/sec 161.899/228.756/2487.371/343.236 ms
SOX IG to PG Utah 3.64 Mbits/sec 14.1 Mbits/sec 24.7 Mbits/sec 93.3 Mbits/sec 105.714/134.064/1440.026/175.335 ms
UtahDDC IG to GPO IG 5.38 Mbits/sec 21.4 Mbits/sec 31.2 Mbits/sec 82.8 Mbits/sec 267.780/370.700/3244.307/470.129 ms
UtahDDC IG to GPO EG 4.50 Mbits/sec 21.1 Mbits/sec 26.1 Mbits/sec 82.7 Mbits/sec 267.509/400.487/3612.669/546.805 ms
UtahDDC IG to PG Utah see(1) 907 Mbits/sec 907 Mbits/sec 101 Mbits/sec 0.305/4.822/270.651/34.607 ms
NYSERNet IG to GPO IG (2) 14.2 Mbits/sec 68.1 Mbits/sec 138 Mbits/sec 101 Mbits/sec 186.578/272.783/2886.861/414.969 ms
NYSERNet IG to GPO EG (2)15.7 Mbits/sec 83.3 Mbits/sec 136 Mbits/sec 9.24 Mbits/sec 186.371/291.596/3176.386/476.176 ms
NYSERNet IG to PG Utah (2)2.57 Mbits/sec 17.4 Mbits/sec 24.8 Mbits/sec 73.7 Mbits/sec 93.803/121.687/1348.084/163.065 ms
Kettering IG to GPO IG (3) 1.96 Mbits/sec 9.05 Mbits/sec 17.7 Mbits/sec 101 Mbits/sec 31.800/39.366/473.450/56.998 ms
Kettering IG to GPO EG (3) 1.94 Mbits/sec 9.07 Mbits/sec 16.7 Mbits/sec 101 Mbits/sec 31.843/39.266/452.410/55.209 ms
Kettering IG to PG Utah(3) 623 Kbits/sec 2.53 Mbits/sec 4.82 Mbits/sec 71.8 Mbits/sec 251.946/354.514/3202.340/465.730 m

Notes:

(1): Iperf ran but no result was reported. Logged in and run manually, but ran into very slow login and manual iperf eventually times out.
(2): Collected on 2014-01-10, when raw pc became available.
(3): Collected on 2014-01-13, when raw pc became available.

Meso-scale Run1 Results

Collected on 2014-01-08

End points One Client(tcp)5 Clients(tcp)10 Clients(tcp)1 client(udp)Ping rtt min/avg/max/mdev
Clemson IG to GPO IG
Clemson IG to GPO EG
Clemson IG to PG Utah
Wisconsin IG to GPO IG 19.7 Mbits/sec 78.0 Mbits/sec 71.6 Mbits/sec 101 Mbits/sec 223.454/293.203/2592.621/351.482 ms
Wisconsin IG to GPO EG 12.3 Mbits/sec 51.0 Mbits/sec 86.3 Mbits/sec 101 Mbits/sec 223.496/321.050/3153.228/460.866 ms
Wisconsin IG to PG Utah 3.49 Mbits/sec 14.1 Mbits/sec 20.5 Mbits/sec 73.5 Mbits/sec 140.793/169.237/1380.665/161.432 ms
GATech IG to GPO IG
GATech IG to GPO EG
GATech IG to PG Utah
Northwestern IG to GPO IG
Northwestern IG to GPO EG
Northwestern IG to PG Utah
Utah IG to GPO IG 3.14 Mbits/sec 16.3 Mbits/sec 7.64 Mbits/sec 82.4 Mbits/sec 267.639/379.346/3374.474/496.067 ms
Utah IG to GPO EG 3.41 Mbits/sec Slow-down(*)
Utah IG to PG Utah 908 Mbits/sec 907 Mbits/sec 909 Mbits/sec 100 Mbits/sec 0.121/2.330/131.876/16.865 ms
Stanford IG to GPO IG 35.3 Mbits/sec 121 Mbits/sec 252 Mbits/sec 102 Mbits/sec 97.367/145.113/2026.749/272.494 ms
Stanford IG to GPO EG 34.0 Mbits/sec 162 Mbits/sec 264 Mbits/sec 101 Mbits/sec 97.366/161.696/2351.520/332.025 ms
Stanford IG to PG Utah 3.19 Mbits/sec 13.5 Mbits/sec 19.3 Mbits/sec 73.4 Mbits/sec 172.050/229.660/2202.472/288.924 ms
NYU IG to GPO IG 15.3 Mbits/sec 56.8 Mbits/sec 104 Mbits/sec 100 Mbits/sec 180.110/256.791/2663.923/375.587 ms
NYU IG to GPO EG 16.5 Mbits/sec 63.1 Mbits/sec 149 Mbits/sec 101 Mbits/sec 180.025/258.056/2713.687/383.342 ms
NYU IG to PG Utah 3.60 Mbits/sec 14.7 Mbits/sec 25.5 Mbits/sec 73.4 Mbits/sec 87.261/107.137/1094.417/128.559 ms
FIU EG to GPO IG 28.8 Mbits/sec 78.4 Mbits/sec 145 Mbits/sec 101 Mbits/sec 176.145/236.258/2360.998/318.668 ms
FIU EG to GPO EG 75.5 Mbits/sec 222 Mbits/sec 326 Mbits/sec 101 Mbits/sec 176.116/236.662/2372.462/320.630 ms
FIU EG to PG Utah 2.75 Mbits/sec 13.3 Mbits/sec 22.4 Mbits/sec 73.6 Mbits/sec 120.232/180.811/2225.746/304.978 ms
MAX IG to GPO IG 14.2 Mbits/sec 55.4 Mbits/sec 93.2 Mbits/sec 101 Mbits/sec 177.311/268.479/2965.349/434.770 ms
MAX IG to GPO EG 24.5 Mbits/sec 170 Mbits/sec 342 Mbits/sec 101 Mbits/sec 177.307/231.886/2250.159/298.515 ms
MAX IG to PG Utah 5.45 Mbits/sec 14.4 Mbits/sec 22.9 Mbits/sec 73.3 Mbits/sec 94.991/119.167/1251.537/148.781 ms
Cornell IG to GPO IG 4.96 Mbits/sec 72.5 Mbits/sec 128 Mbits/sec 101 Mbits/sec 187.644/273.408/2881.506/413.454 ms
Cornell IG to GPO EG 15.3 Mbits/sec 76.0 Mbits/sec 142 Mbits/sec 1.59 Mbits/sec 187.684/270.544/2816.417/402.579 ms
Cornell IG to PG Utah 2.90 Mbits/sec 17.0 Mbits/sec 23.5 Mbits/sec 73.6 Mbits/sec 94.872/118.892/1194.373/141.152 ms
Missouri IG to GPO IG 13.0 Mbits/sec 49.3 Mbits/sec 95.6 Mbits/sec 101 Mbits/sec 193.541/259.395/2479.076/337.704 ms
Missouri IG to GPO EG 13.8 Mbits/sec 56.8 Mbits/sec 109 Mbits/sec 101 Mbits/sec 193.498/255.447/2416.004/324.931 ms
Missouri IG to PG Utah 3.58 Mbits/sec 10.2 Mbits/sec 21.7 Mbits/sec 73.3 Mbits/sec 137.708/170.968/1512.713/183.070 ms
UKY IG to GPO IG 10.6 Mbits/sec 54.9 Mbits/sec 98.6 Mbits/sec 101 Mbits/sec 174.482/241.546/2513.105/344.421 ms
UKY IG to GPO EG 13.0 Mbits/sec 53.6 Mbits/sec 112 Mbits/sec 101 Mbits/sec 174.481/252.125/2694.603/382.283 ms
UKY IG to PG Utah 22.7 Mbits/sec 51.4 Mbits/sec 63.4 Mbits/sec 95.4 Mbits/sec 118.415/194.091/1522.065/279.006 ms
Illinois IG to GPO IG 12.1 Mbits/sec 57.3 Mbits/sec 99.7 Mbits/sec 99.3 Mbits/sec 219.221/295.864/2696.410/376.439 ms
Illinois IG to GPO EG 11.7 Mbits/sec 61.0 Mbits/sec 105 Mbits/sec 101 Mbits/sec 219.216/303.746/2879.754/408.441 ms
Illinois IG to PG Utah 3.67 Mbits/sec 15.3 Mbits/sec 21.5 Mbits/sec 73.6 Mbits/sec 126.422/157.134/1449.972/174.272 ms
Kansas IG to GPO IG 17.7 Mbits/sec 83.3 Mbits/sec 168 Mbits/sec 101 Mbits/sec 191.607/251.736/2365.998/316.775 ms
Kansas IG to GPO EG 17.1 Mbits/sec 85.9 Mbits/sec 134 Mbits/sec 101 Mbits/sec 191.567/253.321/2414.072/324.494 ms
Kansas IG to PG Utah 4.17 Mbits/sec 15.5 Mbits/sec 24.1 Mbits/sec 73.2 Mbits/sec 135.706/167.686/1503.518/181.377 ms
Princeton IG to GPO IG 17.2 Mbits/sec 66.5 Mbits/sec 104 Mbits/sec 101 Mbits/sec 179.373/244.340/2444.582/333.813 ms
Princeton IG to GPO EG 17.5 Mbits/sec 73.2 Mbits/sec 110 Mbits/sec 101 Mbits/sec 179.365/241.084/2397.313/323.281 ms
Princeton IG to PG Utah 3.53 Mbits/sec 16.0 Mbits/sec 13.0 Mbits/sec 73.5 Mbits/sec 96.900/127.180/1336.491/167.203 ms
SOX IG to GPO IG 22.9 Mbits/sec 72.9 Mbits/sec 132 Mbits/sec 101 Mbits/sec 161.899/235.848/2629.072/369.318 ms
SOX IG to GPO EG 18.8 Mbits/sec 85.0 Mbits/sec 162 Mbits/sec 101 Mbits/sec 161.894/237.187/2660.243/374.803 ms
SOX IG to PG Utah 2.81 Mbits/sec 14.5 Mbits/sec 25.5 Mbits/sec 73.5 Mbits/sec 105.876/142.708/1616.305/203.650 ms
UtahDDC IG to GPO IG 17.5 Mbits/sec 51.5 Mbits/sec 40.8 Mbits/sec 82.5 Mbits/sec 267.639/389.767/3532.878/530.202 ms
UtahDDC IG to GPO EG 5.43 Mbits/sec 18.2 Mbits/sec 32.0 Mbits/sec 82.5 Mbits/sec 267.519/388.490/3437.685/512.089 ms
UtahDDC IG to PG Utah 907 Mbits/sec 908 Mbits/sec 907 Mbits/sec 101 Mbits/sec 0.284/4.549/254.738/32.571 ms

(*) Slow-down: Very low (Kbps) throughput for individual clients, attempts to login take several minutes.

1.2 OpenFlow connection over AL2S Connection

End points One Client(tcp)5 Clients(tcp)10 Clients(tcp)1 client(udp)Ping rtt min/avg/max/mdev
Clemson IG to GPO IG
Clemson IG to GPO EG
Clemson IG to PG Utah
Wisconsin IG to GPO IG
Wisconsin IG to GPO EG
Wisconsin IG to PG Utah
GATech IG to GPO IG
GATech IG to GPO EG
GATech IG to PG Utah
Northwestern IG to GPO IG
Northwestern IG to GPO EG
Northwestern IG to PG Utah
Utah IG to GPO IG
Utah IG to GPO EG
Utah IG to PG Utah
Stanford IG to GPO IG
Stanford IG to GPO EG
Stanford IG to PG Utah
NYU IG to GPO IG
NYU IG to GPO EG
NYU IG to PG Utah
FIU EG to GPO IG
FIU EG to GPO EG
FIU EG to PG Utah

1.3 Stitched connection

Stitching Results 2014-01-10

End points One Client(tcp)5 Clients(tcp)10 Clients(tcp)1 client(udp)Ping rtt min/avg/max/mdev
Wisconsin IG to GPO IG 96.3 Mbits/sec 99.5 Mbits/sec 101 Mbits/sec 97.9 Mbits/sec 49.455/49.525/50.067/0.253 ms
Wisconsin IG to GPO EG
MAX IG to GPO IG 100 Mbits/sec 101 Mbits/sec 101 Mbits/sec 97.8 Mbits/sec 11.528/11.619/11.828/0.105 ms
MAX IG to GPO EG 714 Kbits/sec 264 Kbits/sec 203 Kbits/sec 26.3 Mbits/sec 11.561/11.661/11.946/0.161 ms
NYSERnet IG to GPO IG
NYSERnet IG to GPO EG
Illinois IG to GPO IG
Illinois IG to GPO EG
Kentucky PG to GPO IG 499 Kbits/sec 2.43 Mbits/sec 4.61 Mbits/sec 92.9 Mbits/sec 35.788/36.491/66.378/3.942 ms
Kentucky PG to GPO EG
Missouri IG to GPO IG
Missouri IG to GPO EG
Utah IG to GPO IG 54.2 Mbits/sec 99.5 Mbits/sec 100 Mbits/sec no ack 92.166/92.459/93.010/0.378 ms
Utah IG to GPO EG
GPO IG to GPO EG (1)

note (1) Due to some changes in the representation of port and links, this no longer works, ExoGENI update should fix this issue next week (2014-01-13).

2.0 Miscellaneous Information

2.1 Test Methodology

Test Characteristics:

  • All test hosts are dedicate hosts (bare metal/raw-pc)
  • All results are captured for default bandwidth allocation (100Mb/s shaped), unless otherwise stated.
  • All results collected between 2014-01-xxx and xxx???

Iperf TCP measurements captured in this page have the following assumptions:

  • All results are for a 60 second test run.
  • for OpenFlow scenarios, traffic is exchanged to establish data flows before measurement test runs are executed.
  • iperf '1 client' scenario command: 'iperf -c dest_host -t 60'
  • iperf '5 clients' scenario command: 'iperf -c dest_host -t 60 -P 5'
  • iperf '10 clients' scenario command: 'iperf -c dest_host -t 60 -P 10'

Iperf UDP measurements captured in this page have the following assumptions:

  • Each test run is 60 seconds.
  • UDP measurements between racks requested a bandwidth of 100 Mbits/sec, if results showed that 100Mb/s was possible, then increased to 1Gb/s.
  • UDP measurements within a rack requested a bandwidth of 1Gbits/sec for test run

2.2 Historical Performance Data

Various effort have captured performance for GENI Racks, following is a list of earlier pages that have capture some aspect of performance with OpenVZ, Xen and dedicated hosts. These pages should be considered obsolete:

Attachments (1)

Download all attachments as: .zip