Version 65 (modified by 10 years ago) (diff) | ,
---|
GENI Racks Performance
This page captures performance measurements for GENI Racks using OpenFlow and Stitching Scenarios. The following topologies will be used with raw-pc/bare metal dedicated hosts to collect performance data:
- Site Confirmations test OpenFlow connections over Meso-scale:
- New IG or EG Site to GPO IG, GPO EG, Utah PG
- Site Confirmations test for OpenFlow connection over AL2S:
- New IG or EG Site to GPO IG, GPO EG, Utah PG
- Site Stitching Confirmation test via stitched VLAN:
- New IG or EG Site to GPO IG
- New IG or EG Site to GPO EG Bare Metal
For details about the performance test criteria see the Test Methodology section.
1.0 Performance Results
All results (meso-scale, AL2S, and stitching) captured on this page are also available in the attached GENI Racks Performance Spreadsheet.
1.1 OpenFlow connections over Meso-scale Connection
Meso-scale Run2 Raw-PC/Bare-metal Results
Results were collected on 2014-01-21.
End points | One Client(tcp) | 5 Clients(tcp) | 10 Clients(tcp) | 1 client(udp) | Ping rtt min/avg/max/mdev |
Clemson IG to GPO IG | |||||
Clemson IG to GPO EG | |||||
Clemson IG to PG Utah | |||||
Wisconsin IG to GPO IG | |||||
Wisconsin IG to GPO EG | |||||
Wisconsin IG to PG Utah | |||||
GATech IG to GPO IG | |||||
GATech IG to GPO EG | |||||
GATech IG to PG Utah | |||||
Northwestern IG to GPO IG | |||||
Northwestern IG to GPO EG | |||||
Northwestern IG to PG Utah | |||||
Utah IG to GPO IG | |||||
Utah IG to GPO EG | |||||
Utah IG to PG Utah | |||||
Stanford IG to GPO IG | |||||
Stanford IG to GPO EG | |||||
Stanford IG to PG Utah | |||||
NYU IG to GPO IG | |||||
NYU IG to GPO EG | |||||
NYU IG to PG Utah | |||||
FIU EG to GPO IG | |||||
FIU EG to GPO EG | |||||
FIU EG to PG Utah | |||||
MAX IG to GPO IG | |||||
MAX IG to GPO EG | |||||
MAX IG to PG Utah | |||||
Cornell IG to GPO IG | |||||
Cornell IG to GPO EG | |||||
Cornell IG to PG Utah | |||||
Missouri IG to GPO IG | |||||
Missouri IG to GPO EG | |||||
Missouri IG to PG Utah | |||||
UKY IG to GPO IG | |||||
UKY IG to GPO EG | |||||
UKY IG to PG Utah | |||||
Illinois IG to GPO IG | |||||
Illinois IG to GPO EG | |||||
Illinois IG to PG Utah | |||||
Kansas IG to GPO IG | |||||
Kansas IG to GPO EG | |||||
Kansas IG to PG Utah | |||||
Princeton IG to GPO IG | |||||
Princeton IG to GPO EG | |||||
Princeton IG to PG Utah | |||||
SOX IG to GPO IG | |||||
SOX IG to GPO EG | |||||
SOX IG to PG Utah | |||||
UtahDDC IG to GPO IG | |||||
UtahDDC IG to GPO EG | |||||
UtahDDC IG to PG Utah | |||||
NYSERNet IG to GPO IG | |||||
NYSERNet IG to GPO EG | |||||
NYSERNet IG to PG Utah | |||||
Kettering IG to GPO IG | |||||
Kettering IG to GPO EG | |||||
Kettering IG to PG Utah | |||||
Meso-scale Run1 Xen Results
Results were collected on 2014-01-21.
End points | One Client(tcp) | 5 Clients(tcp) | 10 Clients(tcp) | 1 client(udp) | Ping rtt min/avg/max/mdev |
Clemson IG to GPO IG | |||||
Clemson IG to GPO EG | |||||
Clemson IG to PG Utah | |||||
Wisconsin IG to GPO IG | |||||
Wisconsin IG to GPO EG | |||||
Wisconsin IG to PG Utah | |||||
GATech IG to GPO IG | |||||
GATech IG to GPO EG | |||||
GATech IG to PG Utah | |||||
Northwestern IG to GPO IG | |||||
Northwestern IG to GPO EG | |||||
Northwestern IG to PG Utah | |||||
Utah IG to GPO IG | |||||
Utah IG to GPO EG | |||||
Utah IG to PG Utah | |||||
Stanford IG to GPO IG | 9.82 Mbits/sec | 48.2 Mbits/sec | 94.1 Mbits/sec | 101 Mbits/sec | 97.585/97.936/110.542/1.666 ms |
Stanford IG to GPO EG | xx | ||||
Stanford IG to PG Utah | 2.84 Mbits/sec | 10.3 Mbits/sec | 19.3 Mbits/sec | 61.6 Mbits/sec | 173.427/177.312/185.144/2.801 ms |
NYU IG to GPO IG | |||||
NYU IG to GPO EG | |||||
NYU IG to PG Utah | |||||
FIU EG to GPO IG | |||||
FIU EG to GPO EG | |||||
FIU EG to PG Utah | |||||
MAX IG to GPO IG | 4.57 Mbits/sec | 20.6 Mbits/sec | 39.8 Mbits/sec | 100 Mbits/sec | 176.594/177.108/183.511/0.996 ms |
MAX IG to GPO EG | 4.45 Mbits/sec | 21.0 Mbits/sec | 42.8 Mbits/sec | 101 Mbits/sec | 176.571/176.973/178.118/0.484 ms |
MAX IG to PG Utah | 3.97 Mbits/sec | 10.5 Mbits/sec | 22.6 Mbits/sec | 73.5 Mbits/sec | 95.362/98.645/104.097/2.537 ms |
Cornell IG to GPO IG | |||||
Cornell IG to GPO EG | |||||
Cornell IG to PG Utah | |||||
Missouri IG to GPO IG | |||||
Missouri IG to GPO EG | |||||
Missouri IG to PG Utah | |||||
UKY IG to GPO IG | |||||
UKY IG to GPO EG | |||||
UKY IG to PG Utah | |||||
Illinois IG to GPO IG | |||||
Illinois IG to GPO EG | |||||
Illinois IG to PG Utah | |||||
Kansas IG to GPO IG | |||||
Kansas IG to GPO EG | |||||
Kansas IG to PG Utah | |||||
Princeton IG to GPO IG | |||||
Princeton IG to GPO EG | |||||
Princeton IG to PG Utah | |||||
SOX IG to GPO IG | |||||
SOX IG to GPO EG | |||||
SOX IG to PG Utah | |||||
UtahDDC IG to GPO IG | |||||
UtahDDC IG to GPO EG | |||||
UtahDDC IG to PG Utah | |||||
NYSERNet IG to GPO IG | |||||
NYSERNet IG to GPO EG | |||||
NYSERNet IG to PG Utah | |||||
Kettering IG to GPO IG | |||||
Kettering IG to GPO EG | |||||
Kettering IG to PG Utah | |||||
1.2 OpenFlow connection over AL2S Connection
End points | One Client(tcp) | 5 Clients(tcp) | 10 Clients(tcp) | 1 client(udp) | Ping rtt min/avg/max/mdev |
Clemson IG to GPO IG | |||||
Clemson IG to GPO EG | |||||
Clemson IG to PG Utah | |||||
Wisconsin IG to GPO IG | |||||
Wisconsin IG to GPO EG | |||||
Wisconsin IG to PG Utah | |||||
GATech IG to GPO IG | |||||
GATech IG to GPO EG | |||||
GATech IG to PG Utah | |||||
Northwestern IG to GPO IG | |||||
Northwestern IG to GPO EG | |||||
Northwestern IG to PG Utah | |||||
Utah IG to GPO IG | |||||
Utah IG to GPO EG | |||||
Utah IG to PG Utah | |||||
Stanford IG to GPO IG | |||||
Stanford IG to GPO EG | |||||
Stanford IG to PG Utah | |||||
NYU IG to GPO IG | |||||
NYU IG to GPO EG | |||||
NYU IG to PG Utah | |||||
FIU EG to GPO IG | |||||
FIU EG to GPO EG | |||||
FIU EG to PG Utah | |||||
1.3 GENI Network Stitching connections
Stitching Results Run1
Results collected 2014-01-10, 2014-01-15, 2014-01-16:
End points | One Client(tcp) | 5 Clients(tcp) | 10 Clients(tcp) | 1 client(udp) | Ping rtt min/avg/max/mdev |
Wisconsin IG to GPO IG | 96.3 Mbits/sec | 99.5 Mbits/sec | 101 Mbits/sec | 97.9 Mbits/sec | 49.455/49.525/50.067/0.253 ms |
GPO IG to Wisconsin IG | |||||
Wisconsin IG to GPO EG | |||||
GPO EG to Wisconsin IG | |||||
MAX IG to GPO IG | 100 Mbits/sec | 101 Mbits/sec | 101 Mbits/sec | 97.8 Mbits/sec | 11.528/11.619/11.828/0.105 ms |
GPO IG to MAX IG | |||||
MAX IG to GPO EG | 714 Kbits/sec(?) | 264 Kbits/sec | 203 Kbits/sec | 26.3 Mbits/sec | 11.561/11.661/11.946/0.161 ms |
GPO EG to MAX IG | |||||
NYSERnet IG to GPO IG | 99.6 Mbits/sec | 101 Mbits/sec | 101 Mbits/sec | (no ack) | 36.045/248.109/269.347/41.979 ms |
GPO IG to NYSERNet IG | 99.7 Mbits/sec | 101 Mbits/sec | 100 Mbits/sec | (no ack) | 11.152/12.469/84.158/9.334 ms |
NYSERnet IG to GPO EG | 97.4 Kbits/sec | 109 Kbits/sec | time-out | 11.288/11.374/11.814/0.156 ms | |
GPO EG to NYSERNet IG | 688 Kbits/sec (?) | 331 Kbits/sec | 349 Kbits/sec | 22.8 Mbits/sec | 11.263/11.388/11.610/0.161 ms |
Illinois IG to GPO IG | |||||
GPO IG to Illinois IG | |||||
Illinois IG to GPO EG | 1.23 Mbits/sec | 756 Kbits/sec | 583 Kbits/sec | (no ack) | 34.713/39.593/319.990/36.505 ms |
GPO EG to Illinois IG | 97.4 Kbits/sec(?) | 100 Kbits/sec | 15.5 Kbits/sec | 95.2 Kbits/sec | 34.682/34.827/35.224/0.117 ms |
Kentucky PG to GPO IG | 499 Kbits/sec | 2.43 Mbits/sec | 4.61 Mbits/sec | 92.9 Mbits/sec | 35.788/36.491/66.378/3.942 ms |
GPO IG to Kentucky IG | |||||
Kentucky PG to GPO EG | |||||
GPO EG to Kentucky PG | |||||
Missouri IG to GPO IG | |||||
GPO IG to Missouri IG | |||||
Missouri IG to GPO EG | |||||
GPO EG to Missouri EG | |||||
Utah IG to GPO IG | 51.8 Mbits/sec | 99.4 Mbits/sec | 99.8 Mbits/sec | (no ack) | 92.216/92.482/92.937/0.407 ms |
GPO IG to Utah IG | 45.9 Mbits/sec | 99.3 Mbits/sec | 99.9 Mbits/sec | (no ack) | 92.214/92.525/92.891/0.351 ms |
Utah IG to GPO EG | 6.54 Mbits/sec | 2.91 Mbits/sec | 878 Kbits/sec | (no ack) | 92.350/92.663/93.212/0.443 ms |
GPO EG to Utah IG | 93.3 Kbits/sec | 93.9 Kbits/sec | 77.4 Kbits/sec | (no ack) | 92.388/95.532/262.060/21.682 ms |
GPO IG to GPO EG | (1) | ||||
GPO EG to GPO IG | |||||
Notes: (1) Due to changes in the representation of port and links this no longer works. ExoGENI fix due week of 2014-01-13. (no ack) UDP iperf failed with "did not receive ack" for 100M, 50M and 25M. (?) related to poor performance on ExoGENI Nodes????
Stitching Results Run0
These results were collected 2013-12-06:
End points | One Client(tcp) | 5 Clients(tcp) | 10 Clients(tcp) | 1 client(udp) | Ping rtt min/avg/max/mdev |
GPO IG to Missouri IG | 98.3 Mbits/sec | 100 Mbits/sec | 100 Mbits/sec | 98.0 Mbits/sec | 45.583/45.678/46.016/0.260 ms |
Missouri IG to GPO IG | 99.4 Mbits/sec | 100 Mbits/sec | 100 Mbits/sec | 97.8 Mbits/sec | 45.605/46.493/92.008/5.931 ms |
GPO EG to Missouri IG | 97.2 Kbits/sec | 93.2 Kbits/sec | 120 Kbits/sec | 95.4 Kbits/sec | 45.664/45.827/46.500/0.279 ms |
Missouri IG to GPO EG | 7.30 Mbits/sec | 581 Kbits/sec | 431 Kbits/sec | 26.3 Mbits/sec | 45.688/45.809/46.319/0.221 ms |
GPO IG to NYSERNet IG | 99.8 Mbits/sec | 101 Mbits/sec | 101 Mbits/sec | 98.0 Mbits/sec | 11.137/11.218/11.532/0.092 ms |
NYSERNet IG to GPO IG | 100 Mbits/sec | 101 Mbits/sec | 101 Mbits/sec | 97.6 Mbits/sec | 11.191/11.238/11.546/0.097 ms |
GPO EG to NYSERNet IG | 96.4 Kbits/sec | 121 Kbits/sec | 75.0 Kbits/sec | 96.8 Kbits/sec | 11.213/11.418/15.838/0.589 ms |
NYSERNet IG to GPO EG | 689 Kbits/sec | 396 Kbits/sec | 171 Kbits/sec | 20.9 Mbits/sec | 11.200/11.402/12.017/0.161 ms |
GPO IG to Wisconsin IG | 99.3 Mbits/sec | 100 Mbits/sec | 102 Mbits/sec | 98.0 Mbits/sec | 36.616/36.733/36.942/0.070 ms |
Wisconsin IG to GPO IG | 95.0 Mbits/sec | 100 Mbits/sec | 101 Mbits/sec | 97.8 Mbits/sec | 36.655/36.752/37.063/0.232 ms |
GPO EG to Wisconsin IG | 97.3 Kbits/sec | 99.6 Kbits/sec | 88.4 Kbits/sec | 95.6 Kbits/sec | 36.807/36.967/37.688/0.153 ms |
Wisconsin IG to GPO EG | 1.38 Mbits/sec | 670 Kbits/sec | 337 Kbits/sec | 23.9 Mbits/sec | 36.789/37.015/40.590/0.527 ms |
GPO IG to MAX IG | 100 Mbits/sec | 100 Mbits/sec | 100 Mbits/sec | 97.9 Mbits/sec | 11.558/11.609/11.863/0.056 ms |
MAX IG to GPO IG | 100 Mbits/sec | 101 Mbits/sec | 101 Mbits/sec | 97.7 Mbits/sec | 11.526/11.606/11.946/0.159 ms |
GPO EG to MAX IG | 97.0 Kbits/sec | 118 Kbits/sec | 105 Kbits/sec | 96.6 Kbits/sec | 11.560/11.795/16.349/0.603 ms |
MAX IG to GPO EG | 719 Kbits/sec | 406 Kbits/sec | 190 Kbits/sec | 27.8 Mbits/sec | 11.539/11.716/12.407/0.198 ms |
2.0 Miscellaneous Information
2.1 Test Methodology
Test Characteristics:
- All test hosts are dedicate hosts (bare metal/raw-pc) unless otherwise stated
- All results are captured for default bandwidth allocation (100Mb/s shaped), unless otherwise stated.
- All results collected between January 2014
Iperf TCP measurements captured in this page have the following assumptions:
- All results are for a 60 second test run.
- For OpenFlow scenarios, traffic is exchanged before each of the measurements below to establish data flows:
- iperf '1 client' scenario command: 'iperf -c dest_host -t 60'
- iperf '5 clients' scenario command: 'iperf -c dest_host -t 60 -P 5'
- iperf '10 clients' scenario command: 'iperf -c dest_host -t 60 -P 10'
Iperf UDP measurements captured in this page have the following assumptions:
- Each test run is 60 seconds and traffic is exchanged before each of the measurements to establish a data flow.
- UDP measurements between racks requested a bandwidth of 100 Mbits/sec, if results showed that 100Mb/s was possible, then increased to 1Gb/s.
2.2 Historical Performance Data
Various effort have captured performance for GENI Racks, following is a list of earlier pages that have capture some aspect of performance with OpenVZ, Xen and dedicated hosts. These pages should be considered obsolete:
- Initial Performance Initial version of this page which includes incorrect 1 TCP, 1 UDP and max/mdev results for ICMP.
- InstaGENI Site Confirmation Performance
- Local OpenFlow Performance (xen/OpenVZ
- ExoGENI Site Confirmation Performance
- OESS Cross-connects Performance
- GENI Network Stitching Performance
Attachments (1)
- GENIRacks-Performance.xlsx (97.7 KB) - added by 10 years ago.
Download all attachments as: .zip