[[PageOutline]] = GENI Racks Performance = This page captures performance measurements for GENI Racks using !OpenFlow and Stitching Scenarios. The following topologies will be used with raw-pc/bare metal dedicated hosts to collect performance data: * Site Confirmations test !OpenFlow connections over Meso-scale: * New IG or EG Site to GPO IG, GPO EG, Utah PG * Site Confirmations test for !OpenFlow connection over AL2S: * New IG or EG Site to GPO IG, GPO EG, Utah PG * Site Stitching Confirmation test via stitched VLAN: * New IG or EG Site to GPO IG * New IG or EG Site to GPO EG Bare Metal For details about the performance test criteria see the [wiki:GENIRacksHome/Performance#TestMethodology Test Methodology] section. = 1.0 Performance Results = All results (meso-scale, AL2S, and stitching) captured on this page are also available in the attached [http://groups.geni.net/geni/attachment/wiki/GENIRacksHome/Performance/GENIRacks-Performance.xlsx GENI Racks Performance] Spreadsheet. == 1.1 !OpenFlow connections over Meso-scale Connection == === Meso-scale Run1 Results === Results were collected on 2014-01-21. ||'''End points''' ||'''One Client(tcp)'''||'''5 Clients(tcp)'''||'''10 Clients(tcp)'''||'''1 client(udp)'''||'''Ping rtt min/avg/max/mdev'''|| || Clemson IG to GPO IG || || || || || || || Clemson IG to GPO EG || || || || || || || Clemson IG to PG Utah || || || || || || || || || || || Wisconsin IG to GPO IG || || || || || || || Wisconsin IG to GPO EG || || || || || || || Wisconsin IG to PG Utah || || || || || || || || || GATech IG to GPO IG || || || || || || || GATech IG to GPO EG || || || || || || || GATech IG to PG Utah || || || || || || || || || || || Northwestern IG to GPO IG || || || || || || || Northwestern IG to GPO EG || || || || || || || Northwestern IG to PG Utah|| || || || || || || || || || || Utah IG to GPO IG || || || || || || || Utah IG to GPO EG || || || || || || || Utah IG to PG Utah || || || || || || || || || || || Stanford IG to GPO IG || || || || || || || Stanford IG to GPO EG || || || || || || || Stanford IG to PG Utah || || || || || || || || || || || NYU IG to GPO IG || || || || || || || NYU IG to GPO EG || || || || || || || NYU IG to PG Utah || || || || || || || || || || || FIU EG to GPO IG || || || || || || || FIU EG to GPO EG || || || || || || || FIU EG to PG Utah || || || || || || || || || || || MAX IG to GPO IG || || || || || || || MAX IG to GPO EG || || || || || || || MAX IG to PG Utah || || || || || || || || || || || Cornell IG to GPO IG || || || || || || || Cornell IG to GPO EG || || || || || || || Cornell IG to PG Utah || || || || || || || || || Missouri IG to GPO IG || || || || || || || Missouri IG to GPO EG || || || || || || || Missouri IG to PG Utah || || || || || || || || || || || UKY IG to GPO IG || || || || || || || UKY IG to GPO EG || || || || || || || UKY IG to PG Utah || || || || || || || || || || || Illinois IG to GPO IG || || || || || || || Illinois IG to GPO EG || || || || || || || Illinois IG to PG Utah || || || || || || || || || || || Kansas IG to GPO IG || || || || || || || Kansas IG to GPO EG || || || || || || || Kansas IG to PG Utah || || || || || || || || || || || Princeton IG to GPO IG || || || || || || || Princeton IG to GPO EG || || || || || || || Princeton IG to PG Utah || || || || || || || || || || || SOX IG to GPO IG || || || || || || || SOX IG to GPO EG || || || || || || || SOX IG to PG Utah || || || || || || || || || UtahDDC IG to GPO IG || || || || || || || UtahDDC IG to GPO EG || || || || || || || UtahDDC IG to PG Utah || || || || || || || || || || || NYSERNet IG to GPO IG || || || || || || || NYSERNet IG to GPO EG || || || || || || || NYSERNet IG to PG Utah || || || || || || || || || || || Kettering IG to GPO IG || || || || || || || Kettering IG to GPO EG || || || || || || || Kettering IG to PG Utah || || || || || || || || == 1.2 !OpenFlow connection over AL2S Connection == ||'''End points''' ||'''One Client(tcp)'''||'''5 Clients(tcp)'''||'''10 Clients(tcp)'''||'''1 client(udp)'''||'''Ping rtt min/avg/max/mdev''' || || Clemson IG to GPO IG || || || || || || || Clemson IG to GPO EG || || || || || || || Clemson IG to PG Utah || || || || || || || || || Wisconsin IG to GPO IG || || || || || || || Wisconsin IG to GPO EG || || || || || || || Wisconsin IG to PG Utah || || || || || || || || || GATech IG to GPO IG || || || || || || || GATech IG to GPO EG || || || || || || || GATech IG to PG Utah || || || || || || || || || Northwestern IG to GPO IG || || || || || || || Northwestern IG to GPO EG || || || || || || || Northwestern IG to PG Utah|| || || || || || || || || Utah IG to GPO IG || || || || || || || Utah IG to GPO EG || || || || || || || Utah IG to PG Utah || || || || || || || || || Stanford IG to GPO IG || || || || || || || Stanford IG to GPO EG || || || || || || || Stanford IG to PG Utah || || || || || || || || || NYU IG to GPO IG || || || || || || || NYU IG to GPO EG || || || || || || || NYU IG to PG Utah || || || || || || || || || FIU EG to GPO IG || || || || || || || FIU EG to GPO EG || || || || || || || FIU EG to PG Utah || || || || || || || || == 1.3 GENI Network Stitching connections == === Stitching Results Run1 === Results collected 2014-01-10, 2014-01-15, 2014-01-16: ||'''End points''' ||'''One Client(tcp)'''||'''5 Clients(tcp)'''||'''10 Clients(tcp)'''||'''1 client(udp)'''||'''Ping rtt min/avg/max/mdev'''|| || Wisconsin IG to GPO IG ||96.3 Mbits/sec || 99.5 Mbits/sec ||101 Mbits/sec ||97.9 Mbits/sec ||49.455/49.525/50.067/0.253 ms || || GPO IG to Wisconsin IG || || || || || || || Wisconsin IG to GPO EG || || || || || || || GPO EG to Wisconsin IG || || || || || || || || || MAX IG to GPO IG ||100 Mbits/sec ||101 Mbits/sec || 101 Mbits/sec || 97.8 Mbits/sec ||11.528/11.619/11.828/0.105 ms || || GPO IG to MAX IG || || || || || || || MAX IG to GPO EG ||714 Kbits/sec(?) ||264 Kbits/sec || 203 Kbits/sec || 26.3 Mbits/sec || 11.561/11.661/11.946/0.161 ms || || GPO EG to MAX IG || || || || || || || || || NYSERnet IG to GPO IG || 99.6 Mbits/sec ||101 Mbits/sec || 101 Mbits/sec || (no ack) ||36.045/248.109/269.347/41.979 ms || || GPO IG to NYSERNet IG || 99.7 Mbits/sec ||101 Mbits/sec || 100 Mbits/sec || (no ack) ||11.152/12.469/84.158/9.334 ms || || NYSERnet IG to GPO EG || 97.4 Kbits/sec ||109 Kbits/sec || time-out || ||11.288/11.374/11.814/0.156 ms || || GPO EG to NYSERNet IG || 688 Kbits/sec (?) ||331 Kbits/sec || 349 Kbits/sec || 22.8 Mbits/sec ||11.263/11.388/11.610/0.161 ms || || || || Illinois IG to GPO IG || || || || || || || GPO IG to Illinois IG || || || || || || || Illinois IG to GPO EG ||1.23 Mbits/sec ||756 Kbits/sec ||583 Kbits/sec || (no ack) ||34.713/39.593/319.990/36.505 ms|| || GPO EG to Illinois IG ||97.4 Kbits/sec(?) ||100 Kbits/sec ||15.5 Kbits/sec || 95.2 Kbits/sec ||34.682/34.827/35.224/0.117 ms|| || || || Kentucky PG to GPO IG || 499 Kbits/sec ||2.43 Mbits/sec || 4.61 Mbits/sec || 92.9 Mbits/sec ||35.788/36.491/66.378/3.942 ms || || GPO IG to Kentucky IG || || || || || || || Kentucky PG to GPO EG || || || || || || || GPO EG to Kentucky PG || || || || || || || || || Missouri IG to GPO IG || || || || || || || GPO IG to Missouri IG || || || || || || || Missouri IG to GPO EG || || || || || || || GPO EG to Missouri EG || || || || || || || || || Utah IG to GPO IG ||51.8 Mbits/sec || 99.4 Mbits/sec || 99.8 Mbits/sec || (no ack) ||92.216/92.482/92.937/0.407 ms || || GPO IG to Utah IG ||45.9 Mbits/sec || 99.3 Mbits/sec || 99.9 Mbits/sec || (no ack) ||92.214/92.525/92.891/0.351 ms || || Utah IG to GPO EG ||6.54 Mbits/sec || 2.91 Mbits/sec ||878 Kbits/sec || (no ack) ||92.350/92.663/93.212/0.443 ms || || GPO EG to Utah IG ||93.3 Kbits/sec || 93.9 Kbits/sec ||77.4 Kbits/sec || (no ack) ||92.388/95.532/262.060/21.682 ms|| || || || GPO IG to GPO EG || (1) || || || || || || GPO EG to GPO IG || || || || || || || || Notes: (1) Due to changes in the representation of port and links this no longer works. ExoGENI fix due week of 2014-01-13. (no ack) UDP iperf failed with "did not receive ack" for 100M, 50M and 25M. (?) related to poor performance on ExoGENI Nodes???? === Stitching Results Run0 === These results were collected 2013-12-06: ||'''End points''' ||'''One Client(tcp)'''||'''5 Clients(tcp)'''||'''10 Clients(tcp)'''||'''1 client(udp)'''||'''Ping rtt min/avg/max/mdev'''|| ||GPO IG to Missouri IG ||98.3 Mbits/sec || 100 Mbits/sec || 100 Mbits/sec || 98.0 Mbits/sec ||45.583/45.678/46.016/0.260 ms || ||Missouri IG to GPO IG ||99.4 Mbits/sec || 100 Mbits/sec || 100 Mbits/sec || 97.8 Mbits/sec ||45.605/46.493/92.008/5.931 ms || ||GPO EG to Missouri IG || 97.2 Kbits/sec || 93.2 Kbits/sec || 120 Kbits/sec || 95.4 Kbits/sec ||45.664/45.827/46.500/0.279 ms || ||Missouri IG to GPO EG || 7.30 Mbits/sec || 581 Kbits/sec || 431 Kbits/sec || 26.3 Mbits/sec ||45.688/45.809/46.319/0.221 ms || || || ||GPO IG to NYSERNet IG ||99.8 Mbits/sec || 101 Mbits/sec || 101 Mbits/sec || 98.0 Mbits/sec ||11.137/11.218/11.532/0.092 ms || ||NYSERNet IG to GPO IG ||100 Mbits/sec || 101 Mbits/sec || 101 Mbits/sec || 97.6 Mbits/sec ||11.191/11.238/11.546/0.097 ms || ||GPO EG to NYSERNet IG || 96.4 Kbits/sec || 121 Kbits/sec || 75.0 Kbits/sec || 96.8 Kbits/sec ||11.213/11.418/15.838/0.589 ms || ||NYSERNet IG to GPO EG || 689 Kbits/sec || 396 Kbits/sec || 171 Kbits/sec || 20.9 Mbits/sec ||11.200/11.402/12.017/0.161 ms || || || ||GPO IG to Wisconsin IG||99.3 Mbits/sec || 100 Mbits/sec || 102 Mbits/sec || 98.0 Mbits/sec ||36.616/36.733/36.942/0.070 ms || ||Wisconsin IG to GPO IG||95.0 Mbits/sec || 100 Mbits/sec || 101 Mbits/sec || 97.8 Mbits/sec ||36.655/36.752/37.063/0.232 ms || ||GPO EG to Wisconsin IG|| 97.3 Kbits/sec || 99.6 Kbits/sec || 88.4 Kbits/sec || 95.6 Kbits/sec ||36.807/36.967/37.688/0.153 ms || ||Wisconsin IG to GPO EG|| 1.38 Mbits/sec || 670 Kbits/sec || 337 Kbits/sec || 23.9 Mbits/sec ||36.789/37.015/40.590/0.527 ms || || || ||GPO IG to MAX IG ||100 Mbits/sec || 100 Mbits/sec || 100 Mbits/sec || 97.9 Mbits/sec ||11.558/11.609/11.863/0.056 ms || ||MAX IG to GPO IG ||100 Mbits/sec || 101 Mbits/sec || 101 Mbits/sec || 97.7 Mbits/sec ||11.526/11.606/11.946/0.159 ms || ||GPO EG to MAX IG || 97.0 Kbits/sec || 118 Kbits/sec || 105 Kbits/sec || 96.6 Kbits/sec ||11.560/11.795/16.349/0.603 ms || ||MAX IG to GPO EG ||719 Kbits/sec || 406 Kbits/sec || 190 Kbits/sec || 27.8 Mbits/sec ||11.539/11.716/12.407/0.198 ms || = 2.0 Miscellaneous Information = == 2.1 Test Methodology == Test Characteristics: - All test hosts are dedicate hosts (bare metal/raw-pc) unless otherwise stated - All results are captured for default bandwidth allocation (100Mb/s shaped), unless otherwise stated. - All results collected between January 2014 Iperf TCP measurements captured in this page have the following assumptions: - All results are for a 60 second test run. - For !OpenFlow scenarios, traffic is exchanged before each of the measurements below to establish data flows: - iperf '1 client' scenario command: 'iperf -c dest_host -t 60' - iperf '5 clients' scenario command: 'iperf -c dest_host -t 60 -P 5' - iperf '10 clients' scenario command: 'iperf -c dest_host -t 60 -P 10' Iperf UDP measurements captured in this page have the following assumptions: - Each test run is 60 seconds and traffic is exchanged before each of the measurements to establish a data flow. - UDP measurements between racks requested a bandwidth of 100 Mbits/sec, if results showed that 100Mb/s was possible, then increased to 1Gb/s. == 2.2 Historical Performance Data == Various effort have captured performance for GENI Racks, following is a list of earlier pages that have capture some aspect of performance with OpenVZ, Xen and dedicated hosts. These pages should be considered obsolete: - [http://groups.geni.net/geni/wiki/GENIRacksHome/Performance-old Initial Performance] Initial version of this page which includes incorrect 1 TCP, 1 UDP and max/mdev results for ICMP. - [http://groups.geni.net/geni/wiki/GENIRacksHome/InstageniRacks/ConfirmationTestStatus/InstageniPerformance InstaGENI Site Confirmation Performance] - [http://groups.geni.net/geni/wiki/GENIRacksHome/InstageniRacks/ConfirmationTestStatus/InstageniPerformanceOF Local OpenFlow Performance (xen/OpenVZ] - [http://groups.geni.net/geni/wiki/GENIRacksHome/ExogeniRacks/ConfirmationTestStatus/ExogeniPerformance ExoGENI Site Confirmation Performance] - [http://groups.geni.net/geni/wiki/GENIOESSTopologiesPerformance OESS Cross-connects Performance] - [http://groups.geni.net/geni/wiki/GeniNetworkStitchingConfirmationTestStatus/Performance GENI Network Stitching Performance]