Version 39 (modified by 10 years ago) (diff) | ,
---|
GENI Racks Performance
This page captures performance measurements for GENI Racks using OpenFlow and Stitching Scenarios. The following topologies will be used with raw-pc/bare metal dedicated hosts to collect performance data:
- Site Confirmations test OpenFlow connections over Meso-scale:
- New IG or EG Site to GPO IG, GPO EG, Utah PG
- Site Confirmations test for OpenFlow connection over AL2S:
- New IG or EG Site to GPO IG, GPO EG, Utah PG
- Site Stitching Confirmation test via stitched VLAN:
- New IG or EG Site to GPO IG
- New IG or EG Site to GPO EG Bare Metal
For details about the performance test criteria see the Test Methodology section.
1.0 Performance Results
All results (meso-scale, AL2S, and stitching) captured on this page are also available in the attached GENI Racks Performance Spreadsheet.
1.1 OpenFlow connections over Meso-scale Connection
Results 2014-01-08 (ovenight test)
End points | One Client(tcp) | 5 Clients(tcp) | 10 Clients(tcp) | 1 client(udp) | Ping rtt min/avg/max/mdev |
Clemson IG to GPO IG | |||||
Clemson IG to GPO EG | |||||
Clemson IG to PG Utah | |||||
Wisconsin IG to GPO IG | 20.5 Mbits/sec | 94.4 Mbits/sec | 174 Mbits/sec | 101 Mbits/sec | 223.437/291.509/2569.446/346.581 ms |
Wisconsin IG to GPO EG | 11.5 Mbits/sec | 47.0 Mbits/sec | 86.9 Mbits/sec | 101 Mbits/sec | 223.475/299.931/2732.393/377.818 ms |
Wisconsin IG to PG Utah | 2.27 Mbits/sec | 12.5 Mbits/sec | 22.5 Mbits/sec | 73.2 Mbits/sec | 141.118/173.372/1492.558/179.663 ms |
GATech IG to GPO IG | |||||
GATech IG to GPO EG | |||||
GATech IG to PG Utah | |||||
Northwestern IG to GPO IG | |||||
Northwestern IG to GPO EG | |||||
Northwestern IG to PG Utah | |||||
Utah IG to GPO IG | 870 Kbits/sec | 220 Kbits/sec | 5.03 Mbits/sec | 82.6 Mbits/sec | 267.572/389.508/3529.448/528.933 ms |
Utah IG to GPO EG | 12.4 Mbits/sec | 52.8 Mbits/sec | 4.98 Mbits/sec | 82.6 Mbits/sec | 267.608/374.094/3219.757/473.812 ms |
Utah IG to PG Utah | see(1) | 908 Mbits/sec | 922 Mbits/sec | 101 Mbits/sec | 0.133/2.358/133.263/17.042 ms |
Stanford IG to GPO IG | 38.7 Mbits/sec | 152 Mbits/sec | 242 Mbits/sec | 101 Mbits/sec | 97.352/151.356/2172.346/297.104 ms |
Stanford IG to GPO EG | 31.4 Mbits/sec | 142 Mbits/sec | 276 Mbits/sec | 101 Mbits/sec | 97.328/144.376/2004.508/268.679 ms |
Stanford IG to PG Utah | 3.07 Mbits/sec | 13.2 Mbits/sec | 20.2 Mbits/sec | 72.7 Mbits/sec | 172.194/242.546/2522.587/346.033 ms |
NYU IG to GPO IG | 14.1 Mbits/sec | 61.7 Mbits/sec | 86.6 Mbits/sec | 101 Mbits/sec | 180.129/270.892/2989.070/434.613 ms |
NYU IG to GPO EG | 8.12 Mbits/sec | 64.3 Mbits/sec | 102 Mbits/sec | 101 Mbits/sec | 180.167/270.813/2822.628/420.586 ms |
NYU IG to PG Utah | 3.55 Mbits/sec | 16.6 Mbits/sec | 25.6 Mbits/sec | 73.4 Mbits/sec | 87.424/112.428/1255.048/150.285 ms |
FIU EG to GPO IG | 24.0 Mbits/sec | 74.4 Mbits/sec | 145 Mbits/sec | 101 Mbits/sec | 176.175/238.363/2408.382/326.441 ms |
FIU EG to GPO EG | 44.5 Mbits/sec | 128 Mbits/sec | 215 Mbits/sec | 101 Mbits/sec | 176.164/240.502/2426.307/331.258 ms |
FIU EG to PG Utah | 3.86 Mbits/sec | 13.8 Mbits/sec | 20.6 Mbits/sec | 73.2 Mbits/sec | 121.067/184.518/2331.012/321.109 ms |
MAX IG to GPO IG | 14.1 Mbits/sec | 62.7 Mbits/sec | 105 Mbits/sec | 101 Mbits/sec | 177.402/243.640/2486.008/339.033 ms |
MAX IG to GPO EG | 13.6 Mbits/sec | 55.2 Mbits/sec | 112 Mbits/sec | 101 Mbits/sec | 177.445/244.031/2477.794/340.001 ms |
MAX IG to PG Utah | 3.85 Mbits/sec | 16.0 Mbits/sec | 23.1 Mbits/sec | 73.4 Mbits/sec | 95.027/124.700/1349.733/165.157 ms |
Cornell IG to GPO IG | 15.2 Mbits/sec | 75.3 Mbits/sec | 112 Mbits/sec | 101 Mbits/sec | 187.608/267.211/2768.377/390.637 ms |
Cornell IG to GPO EG | 13.4 Mbits/sec | 66.1 Mbits/sec | 135 Mbits/sec | 101 Mbits/sec | 187.647/273.300/2863.667/413.394 ms |
Cornell IG to PG Utah | 22.0 Mbits/sec | 52.1 Mbits/sec | 66.5 Mbits/sec | 74.4 Mbits/sec | 94.983/120.251/1215.880/145.002 ms |
Missouri IG to GPO IG | 12.0 Mbits/sec | 50.7 Mbits/sec | 98.7 Mbits/sec | 94.9 Mbits/sec | 193.538/258.538/2455.796/334.196 ms |
Missouri IG to GPO EG | 18.2 Mbits/sec | 59.4 Mbits/sec | 122 Mbits/sec | 101 Mbits/sec | 193.550/269.545/2696.825/376.939 ms |
Missouri IG to PG Utah | 2.67 Mbits/sec | 14.6 Mbits/sec | 20.1 Mbits/sec | 73.6 Mbits/sec | 137.582/169.560/1467.011/177.364 ms |
UKY IG to GPO IG | 12.0 Mbits/sec | 52.3 Mbits/sec | 98.9 Mbits/sec | 101 Mbits/sec | 174.480/242.502/2532.513/347.970 ms |
UKY IG to GPO EG | 11.9 Mbits/sec | 57.7 Mbits/sec | 117 Mbits/sec | 101 Mbits/sec | 174.493/245.164/2552.096/355.386 ms |
UKY IG to PG Utah | 5.51 Mbits/sec | 14.2 Mbits/sec | 23.3 Mbits/sec | 73.6 Mbits/sec | 118.564/155.329/1620.124/202.896 |
Illinois IG to GPO IG | 13.0 Mbits/sec | 59.2 Mbits/sec | 102 Mbits/sec | 101 Mbits/sec | 219.239/305.993/2947.567/418.736 ms |
Illinois IG to GPO EG | 13.5 Mbits/sec | 61.5 Mbits/sec | 94.1 Mbits/sec | 101 Mbits/sec | 219.229/325.038/3284.657/486.653 ms |
Illinois IG to PG Utah | 5.52 Mbits/sec | 14.2 Mbits/sec | 22.5 Mbits/sec | 73.6 Mbits/sec | 126.527/153.970/1372.223/161.678 ms |
Kansas IG to GPO IG | 20.7 Mbits/sec | 95.9 Mbits/sec | 152 Mbits/sec | 101 Mbits/sec | 191.604/246.551/2266.483/297.061 ms |
Kansas IG to GPO EG | 12.2 Mbits/sec | 75.0 Mbits/sec | 159 Mbits/sec | 101 Mbits/sec | 191.598/263.661/2615.676/362.429 ms |
Kansas IG to PG Utah | 3.42 Mbits/sec | 14.3 Mbits/sec | 24.6 Mbits/sec | 73.7 Mbits/sec | 135.688/163.678/1365.677/161.164 ms |
Princeton IG to GPO IG | 15.5 Mbits/sec | 60.6 Mbits/sec | 111 Mbits/sec | 101 Mbits/sec | 179.376/264.131/2841.306/409.399 ms |
Princeton IG to GPO EG | 17.7 Mbits/sec | 78.6 Mbits/sec | 112 Mbits/sec | 101 Mbits/sec | 179.410/265.331/2864.731/414.106 ms |
Princeton IG to PG Utah | 4.06 Mbits/sec | 13.5 Mbits/sec | 23.1 Mbits/sec | 73.6 Mbits/sec | 97.165/124.312/1296.864/158.901 ms |
SOX IG to GPO IG | 13.8 Mbits/sec | 97.3 Mbits/sec | 172 Mbits/sec | 101 Mbits/sec | 161.887/248.926/2885.673/419.480 ms |
SOX IG to GPO EG | 37.2 Mbits/sec | 185 Mbits/sec | 271 Mbits/sec | 101 Mbits/sec | 161.899/228.756/2487.371/343.236 ms |
SOX IG to PG Utah | 3.64 Mbits/sec | 14.1 Mbits/sec | 24.7 Mbits/sec | 93.3 Mbits/sec | 105.714/134.064/1440.026/175.335 ms |
UtahDDC IG to GPO IG | 5.38 Mbits/sec | 21.4 Mbits/sec | 31.2 Mbits/sec | 82.8 Mbits/sec | 267.780/370.700/3244.307/470.129 ms |
UtahDDC IG to GPO EG | 4.50 Mbits/sec | 21.1 Mbits/sec | 26.1 Mbits/sec | 82.7 Mbits/sec | 267.509/400.487/3612.669/546.805 ms |
UtahDDC IG to PG Utah | see(1) | 907 Mbits/sec | 907 Mbits/sec | 101 Mbits/sec | 0.305/4.822/270.651/34.607 ms |
NYSERNet IG to GPO IG (2) | 14.2 Mbits/sec | 68.1 Mbits/sec | 138 Mbits/sec | 101 Mbits/sec | 186.578/272.783/2886.861/414.969 ms |
NYSERNet IG to GPO EG (2) | 15.7 Mbits/sec | 83.3 Mbits/sec | 136 Mbits/sec | 9.24 Mbits/sec | 186.371/291.596/3176.386/476.176 ms |
NYSERNet IG to PG Utah (2) | 2.57 Mbits/sec | 17.4 Mbits/sec | 24.8 Mbits/sec | 73.7 Mbits/sec | 93.803/121.687/1348.084/163.065 ms |
Notes:
(1): Iperf ran but no result was reported. Logged in and run manually, but ran into very slow login and manual iperf eventually times out.
(2): Collected on 2014-01-10, when raw pc first became available.
Results 2014-01-08
End points | One Client(tcp) | 5 Clients(tcp) | 10 Clients(tcp) | 1 client(udp) | Ping rtt min/avg/max/mdev |
Clemson IG to GPO IG | |||||
Clemson IG to GPO EG | |||||
Clemson IG to PG Utah | |||||
Wisconsin IG to GPO IG | 19.7 Mbits/sec | 78.0 Mbits/sec | 71.6 Mbits/sec | 101 Mbits/sec | 223.454/293.203/2592.621/351.482 ms |
Wisconsin IG to GPO EG | 12.3 Mbits/sec | 51.0 Mbits/sec | 86.3 Mbits/sec | 101 Mbits/sec | 223.496/321.050/3153.228/460.866 ms |
Wisconsin IG to PG Utah | 3.49 Mbits/sec | 14.1 Mbits/sec | 20.5 Mbits/sec | 73.5 Mbits/sec | 140.793/169.237/1380.665/161.432 ms |
GATech IG to GPO IG | |||||
GATech IG to GPO EG | |||||
GATech IG to PG Utah | |||||
Northwestern IG to GPO IG | |||||
Northwestern IG to GPO EG | |||||
Northwestern IG to PG Utah | |||||
Utah IG to GPO IG | 3.14 Mbits/sec | 16.3 Mbits/sec | 7.64 Mbits/sec | 82.4 Mbits/sec | 267.639/379.346/3374.474/496.067 ms |
Utah IG to GPO EG | 3.41 Mbits/sec | Slow-down(*) | |||
Utah IG to PG Utah | 908 Mbits/sec | 907 Mbits/sec | 909 Mbits/sec | 100 Mbits/sec | 0.121/2.330/131.876/16.865 ms |
Stanford IG to GPO IG | 35.3 Mbits/sec | 121 Mbits/sec | 252 Mbits/sec | 102 Mbits/sec | 97.367/145.113/2026.749/272.494 ms |
Stanford IG to GPO EG | 34.0 Mbits/sec | 162 Mbits/sec | 264 Mbits/sec | 101 Mbits/sec | 97.366/161.696/2351.520/332.025 ms |
Stanford IG to PG Utah | 3.19 Mbits/sec | 13.5 Mbits/sec | 19.3 Mbits/sec | 73.4 Mbits/sec | 172.050/229.660/2202.472/288.924 ms |
NYU IG to GPO IG | 15.3 Mbits/sec | 56.8 Mbits/sec | 104 Mbits/sec | 100 Mbits/sec | 180.110/256.791/2663.923/375.587 ms |
NYU IG to GPO EG | 16.5 Mbits/sec | 63.1 Mbits/sec | 149 Mbits/sec | 101 Mbits/sec | 180.025/258.056/2713.687/383.342 ms |
NYU IG to PG Utah | 3.60 Mbits/sec | 14.7 Mbits/sec | 25.5 Mbits/sec | 73.4 Mbits/sec | 87.261/107.137/1094.417/128.559 ms |
FIU EG to GPO IG | 28.8 Mbits/sec | 78.4 Mbits/sec | 145 Mbits/sec | 101 Mbits/sec | 176.145/236.258/2360.998/318.668 ms |
FIU EG to GPO EG | 75.5 Mbits/sec | 222 Mbits/sec | 326 Mbits/sec | 101 Mbits/sec | 176.116/236.662/2372.462/320.630 ms |
FIU EG to PG Utah | 2.75 Mbits/sec | 13.3 Mbits/sec | 22.4 Mbits/sec | 73.6 Mbits/sec | 120.232/180.811/2225.746/304.978 ms |
MAX IG to GPO IG | 14.2 Mbits/sec | 55.4 Mbits/sec | 93.2 Mbits/sec | 101 Mbits/sec | 177.311/268.479/2965.349/434.770 ms |
MAX IG to GPO EG | 24.5 Mbits/sec | 170 Mbits/sec | 342 Mbits/sec | 101 Mbits/sec | 177.307/231.886/2250.159/298.515 ms |
MAX IG to PG Utah | 5.45 Mbits/sec | 14.4 Mbits/sec | 22.9 Mbits/sec | 73.3 Mbits/sec | 94.991/119.167/1251.537/148.781 ms |
Cornell IG to GPO IG | 4.96 Mbits/sec | 72.5 Mbits/sec | 128 Mbits/sec | 101 Mbits/sec | 187.644/273.408/2881.506/413.454 ms |
Cornell IG to GPO EG | 15.3 Mbits/sec | 76.0 Mbits/sec | 142 Mbits/sec | 1.59 Mbits/sec | 187.684/270.544/2816.417/402.579 ms |
Cornell IG to PG Utah | 2.90 Mbits/sec | 17.0 Mbits/sec | 23.5 Mbits/sec | 73.6 Mbits/sec | 94.872/118.892/1194.373/141.152 ms |
Missouri IG to GPO IG | 13.0 Mbits/sec | 49.3 Mbits/sec | 95.6 Mbits/sec | 101 Mbits/sec | 193.541/259.395/2479.076/337.704 ms |
Missouri IG to GPO EG | 13.8 Mbits/sec | 56.8 Mbits/sec | 109 Mbits/sec | 101 Mbits/sec | 193.498/255.447/2416.004/324.931 ms |
Missouri IG to PG Utah | 3.58 Mbits/sec | 10.2 Mbits/sec | 21.7 Mbits/sec | 73.3 Mbits/sec | 137.708/170.968/1512.713/183.070 ms |
UKY IG to GPO IG | 10.6 Mbits/sec | 54.9 Mbits/sec | 98.6 Mbits/sec | 101 Mbits/sec | 174.482/241.546/2513.105/344.421 ms |
UKY IG to GPO EG | 13.0 Mbits/sec | 53.6 Mbits/sec | 112 Mbits/sec | 101 Mbits/sec | 174.481/252.125/2694.603/382.283 ms |
UKY IG to PG Utah | 22.7 Mbits/sec | 51.4 Mbits/sec | 63.4 Mbits/sec | 95.4 Mbits/sec | 118.415/194.091/1522.065/279.006 ms |
Illinois IG to GPO IG | 12.1 Mbits/sec | 57.3 Mbits/sec | 99.7 Mbits/sec | 99.3 Mbits/sec | 219.221/295.864/2696.410/376.439 ms |
Illinois IG to GPO EG | 11.7 Mbits/sec | 61.0 Mbits/sec | 105 Mbits/sec | 101 Mbits/sec | 219.216/303.746/2879.754/408.441 ms |
Illinois IG to PG Utah | 3.67 Mbits/sec | 15.3 Mbits/sec | 21.5 Mbits/sec | 73.6 Mbits/sec | 126.422/157.134/1449.972/174.272 ms |
Kansas IG to GPO IG | 17.7 Mbits/sec | 83.3 Mbits/sec | 168 Mbits/sec | 101 Mbits/sec | 191.607/251.736/2365.998/316.775 ms |
Kansas IG to GPO EG | 17.1 Mbits/sec | 85.9 Mbits/sec | 134 Mbits/sec | 101 Mbits/sec | 191.567/253.321/2414.072/324.494 ms |
Kansas IG to PG Utah | 4.17 Mbits/sec | 15.5 Mbits/sec | 24.1 Mbits/sec | 73.2 Mbits/sec | 135.706/167.686/1503.518/181.377 ms |
Princeton IG to GPO IG | 17.2 Mbits/sec | 66.5 Mbits/sec | 104 Mbits/sec | 101 Mbits/sec | 179.373/244.340/2444.582/333.813 ms |
Princeton IG to GPO EG | 17.5 Mbits/sec | 73.2 Mbits/sec | 110 Mbits/sec | 101 Mbits/sec | 179.365/241.084/2397.313/323.281 ms |
Princeton IG to PG Utah | 3.53 Mbits/sec | 16.0 Mbits/sec | 13.0 Mbits/sec | 73.5 Mbits/sec | 96.900/127.180/1336.491/167.203 ms |
SOX IG to GPO IG | 22.9 Mbits/sec | 72.9 Mbits/sec | 132 Mbits/sec | 101 Mbits/sec | 161.899/235.848/2629.072/369.318 ms |
SOX IG to GPO EG | 18.8 Mbits/sec | 85.0 Mbits/sec | 162 Mbits/sec | 101 Mbits/sec | 161.894/237.187/2660.243/374.803 ms |
SOX IG to PG Utah | 2.81 Mbits/sec | 14.5 Mbits/sec | 25.5 Mbits/sec | 73.5 Mbits/sec | 105.876/142.708/1616.305/203.650 ms |
UtahDDC IG to GPO IG | 17.5 Mbits/sec | 51.5 Mbits/sec | 40.8 Mbits/sec | 82.5 Mbits/sec | 267.639/389.767/3532.878/530.202 ms |
UtahDDC IG to GPO EG | 5.43 Mbits/sec | 18.2 Mbits/sec | 32.0 Mbits/sec | 82.5 Mbits/sec | 267.519/388.490/3437.685/512.089 ms |
UtahDDC IG to PG Utah | 907 Mbits/sec | 908 Mbits/sec | 907 Mbits/sec | 101 Mbits/sec | 0.284/4.549/254.738/32.571 ms |
(*) Slow-down: Very low (Kbps) throughput for individual clients, attempts to login take several minutes.
1.2 OpenFlow connection over AL2S Connection
End points | One Client(tcp) | 5 Clients(tcp) | 10 Clients(tcp) | 1 client(udp) | Ping rtt min/avg/max/mdev |
Clemson IG to GPO IG | |||||
Clemson IG to GPO EG | |||||
Clemson IG to PG Utah | |||||
Wisconsin IG to GPO IG | |||||
Wisconsin IG to GPO EG | |||||
Wisconsin IG to PG Utah | |||||
GATech IG to GPO IG | |||||
GATech IG to GPO EG | |||||
GATech IG to PG Utah | |||||
Northwestern IG to GPO IG | |||||
Northwestern IG to GPO EG | |||||
Northwestern IG to PG Utah | |||||
Utah IG to GPO IG | |||||
Utah IG to GPO EG | |||||
Utah IG to PG Utah | |||||
Stanford IG to GPO IG | |||||
Stanford IG to GPO EG | |||||
Stanford IG to PG Utah | |||||
NYU IG to GPO IG | |||||
NYU IG to GPO EG | |||||
NYU IG to PG Utah | |||||
FIU EG to GPO IG | |||||
FIU EG to GPO EG | |||||
FIU EG to PG Utah | |||||
1.3 Stitched connection
End points | One Client(tcp) | 5 Clients(tcp) | 10 Clients(tcp) | 1 client(udp) | Ping rtt min/avg/max/mdev |
Wisconsin IG to GPO IG | 96.3 Mbits/sec | 99.5 Mbits/sec | 101 Mbits/sec | 97.9 Mbits/sec | 49.455/49.525/50.067/0.253 ms |
Wisconsin IG to GPO EG | |||||
MAX IG to GPO IG | 100 Mbits/sec | 101 Mbits/sec | 101 Mbits/sec | 97.8 Mbits/sec | 11.528/11.619/11.828/0.105 ms |
MAX IG to GPO EG | 714 Kbits/sec | 264 Kbits/sec | 203 Kbits/sec | 26.3 Mbits/sec | 11.561/11.661/11.946/0.161 ms |
NYSERnet IG to GPO IG | |||||
NYSERnet IG to GPO EG | |||||
Illinois IG to GPO IG | |||||
Illinois IG to GPO EG | |||||
Kentucky PG to GPO IG | |||||
Kentucky PG to GPO EG | |||||
Missouri IG to GPO IG | |||||
Missouri IG to GPO EG | |||||
Utah IG to GPO IG | |||||
Utah IG to GPO EG | |||||
GPO IG to GPO EG | |||||
2.0 Miscellaneous Information
2.1 Test Methodology
Test Characteristics:
- All test hosts are dedicate hosts (bare metal/raw-pc)
- All results are captured for default bandwidth allocation (100Mb/s shaped), unless otherwise stated.
- All results collected between 2014-01-xxx and xxx???
Iperf TCP measurements captured in this page have the following assumptions:
- All results are for a 60 second test run.
- for OpenFlow scenarios, traffic is exchanged to establish data flows before measurement test runs are executed.
- iperf '1 client' scenario command: 'iperf -c dest_host -t 60'
- iperf '5 clients' scenario command: 'iperf -c dest_host -t 60 -P 5'
- iperf '10 clients' scenario command: 'iperf -c dest_host -t 60 -P 10'
Iperf UDP measurements captured in this page have the following assumptions:
- Each test run is 60 seconds.
- UDP measurements between racks requested a bandwidth of 100 Mbits/sec, if results showed that 100Mb/s was possible, then increased to 1Gb/s.
- UDP measurements within a rack requested a bandwidth of 1Gbits/sec for test run
2.2 Historical Performance Data
Various effort have captured performance for GENI Racks, following is a list of earlier pages that have capture some aspect of performance with OpenVZ, Xen and dedicated hosts. These pages should be considered obsolete:
Attachments (1)
- GENIRacks-Performance.xlsx (97.7 KB) - added by 10 years ago.
Download all attachments as: .zip