[[PageOutline]] = Confirmation Tests Performance Measurements = This page captures all performance measurements results captured during InstaGENI New Site Confirmation tests. For test details see the '''[wiki:GENIRacksHome/InstageniRacks/SiteConfirmationTests InstaGENI Confirmation Tests]''' page. For test status see the '''[wiki:GENIRacksHome/InstageniRacks/ConfirmationTestStatus InstaGENI New Site Confirmation Tests Status]''' page. == Test Methodology == Test Characteristics: - All VMs at one site are on the same VM server, unless otherwise stated. - All results are captured for default bandwidth allocation (100Mb/s shaped), unless otherwise stated. - All results are captured for default OS (Fedora 15 STD). - All results collected between 2013-03-01 through 2013-03-07, unless otherwise stated. Iperf TCP measurements captured in this page have the following assumptions: - All result are for a 60 seconds test run. - for !OpenFlow scenarios, traffic is exchanged to establish data flows before measurement test run are executed. - iperf '1 client' scenario command: 'iperf -c dest_host -t 60' - iperf '5 clients' scenario command: 'iperf -c dest_host -t 60 -P 5' - iperf '10 clients' scenario command: iiperf -c dest_host -t 60 -P 10' Iperf UDP measurements captured in this page have the following assumptions: - Each test run is 10 seconds. - UDP measurements within a rack requested a bandwidth of 1Gbits/sec for test run - UDP measurements between racks requested a bandwidth of 100 Mbits/sec, if results showed that 100Mb/s possible, then increased to 1Gb/s. == Performance Results == == VM to VM measurements within one rack (IG-CT-1 - Access to New Site VM resources) == ||'''End points'''||'''One Client(tcp)'''||'''5 Clients(tcp)'''||'''10 Clients(tcp)'''||'''1 client(udp)'''||'''Ping rtt min/avg/max/mdev'''|| || GPO ||96.9 Mbits/sec ||97.8 Mbits/sec ||99.3 Mbits/sec || 95.7 Mbits/sec || 0.026/0.030/0.040/0.004 ms || || Utah ||96.9 Mbits/sec ||97.7 Mbits/sec ||99.1 Mbits/sec || 96.7 Mbits/sec || 0.028/0.031/0.053/0.008 ms || ||Northwestern ||96.9 Mbits/sec ||97.9 Mbits/sec ||99.2 Mbits/sec || 97.4 Mbits/sec || 0.025/0.033/0.248/0.028 ms || == VM to VM measurements within one rack (VMs on separate VM servers) (no specific test case exist) == Even though not part of planned tests, ran an experiment with 2 VMs each on a separate VM servers to capture performance between VM nodes on different servers within the same rack. ||'''End points'''||'''One Client(tcp)'''||'''5 Clients(tcp)'''||'''10 Clients(tcp)'''||'''1 client(udp)'''||'''Ping rtt min/avg/max/mdev'''|| || GPO || 101 Mbits/sec || 101 Mbits/sec || 101 Mbits/sec || 96.7 Mbits/sec || 0.134/0.165/0.184/0.014 ms || == PC to VM measurements within one rack (IG-CT-2 - Access to New Site Raw PC and VM resources) == ||'''End points'''||'''One Client(tcp)'''||'''5 Clients(tcp)'''||'''10 Clients(tcp)'''||'''1 client(udp)'''||'''Ping rtt min/avg/max/mdev'''|| || GPO || 101 Mbits/sec || 101 Mbits/sec || 101 Mbits/sec || 96.8 Mbits/sec || 0.123/0.132/0.161/0.015 ms || || Northwestern* || 101 Mbits/sec || 101 Mbits/sec || 101 Mbits/sec || ---- Mbits/sec || 0.175/0.189/0.238/0.014 ms || || Utah || 101 Mbits/sec || 101 Mbits/sec || 101 Mbits/sec || 96.8 Mbits/sec || 0.118/0.133/0.170/0.015 ms || '' (*) need to re-execute when raw-pc is available - results collected on 2013-02-20'' == VM to PC measurements within one rack (IG-CT-2 - Access to New Site Raw PC and VM resources) == ||'''End points'''||'''One Client(tcp)'''||'''5 Clients(tcp)'''||'''10 Clients(tcp)'''||'''1 client(udp)'''||'''Ping rtt min/avg/max/mdev'''|| || GPO || 101 Mbits/sec || 101 Mbits/sec || 102 Mbits/sec || 98.0 Mbits/sec || 0.134/0.148/0.168/0.016 ms || || Northwestern* || ----- || ----- || ----- || ----- || ----- || || Utah || 101 Mbits/sec || 101 Mbits/sec || 102 Mbits/sec || 98.0 Mbits/sec || 0.104/0.139/0.146/0.017 ms || '' (*) need to capture when raw-pc is available - no results have been collected for this in past test runs'' == PC to PC measurements within one rack (no specific test case exist) == ||'''End points'''||'''One Client(tcp)'''||'''5 Clients(tcp)'''||'''10 Clients(tcp)'''||'''1 client(udp)'''||'''Ping rtt min/avg/max/mdev'''|| || GPO || 941 Mbits/sec || 942 Mbits/sec || 942 Mbits/sec || 1.05 Mbits/sec || 0.139/0.183/0.229/0.015 ms || ||Northwestern (*)|| 942 Mbits/sec || 942 Mbits/sec || 942 Mbits/sec || --- Mbits/sec || 0.123/0.134/0.149/0.010 ms || (*) Collected on 2013-02-20 - need to re-capture when raw-pcs are available after demo. == One Gbits/sec Links within one rack == For this test case, each link was requested with a speed of 1 Gb/s. All tests were conducted in the GPO Rack on 2013-03-01. ||'''End points''' || ''One Client(tcp)'''||'''5 Clients(tcp)'''||'''10 Clients(tcp)'''||'''1 client(udp)'''||'''Ping rtt min/avg/max/mdev'''|| ||VM to VM (1 VM server) ||962 Mbits/sec || 962 Mbits/sec || 964 Mbits/sec || ---- Mbits/sec || 0.022/0.026/0.036/0.004 ms || ||VM (server1) to VM (server2)||929 Mbits/sec || 935 Mbits/sec || 935 Mbits/sec || ---- Mbits/sec || 0.108/0.145/0.165/0.010 ms || ||PC to VM ||939 Mbits/sec || 940 Mbits/sec || 940 Mbits/sec || ---- Mbits/sec || 0.123/0.175/0.215/0.017 msi || ||VM to PC ||939 Mbits/sec || 938 Mbits/sec || 936 Mbits/sec || ---- Mbits/sec || 0.138/0.144/0.160/0.016 ms || ||PC to PC ||941 Mbits/sec || 942 Mbits/sec || 942 Mbits/sec || ---- Mbits/sec || 0.136/0.174/0.192/0.012 ms || == VM to remote VM measurements between two non-OF sites (IG-CT-3 - Multiple Sites experiment) == ||'''End points''' ||'''One Client(tcp)'''||'''5 Clients(tcp)'''||'''10 Clients(tcp)'''||'''1 client(udp)'''||'''Ping rtt min/avg/max/mdev'''|| ||Utah IG to GPO IG || 5.12 Mbits/sec || 22.5 Mbits/sec || 27.2 Mbits/sec || 74.6 Mbits/sec || 59.270/62.294/71.982/3.371 ms || ||GPO IG to Utah IG || 19.5 Mbits/sec || 39.8 Mbits/sec || 46.2 Mbits/sec || 69.3 Mbits/sec || 59.187/62.125/71.587/3.282 ms || ||GPO IG to Northwestern|| 27.5 Mbits/sec || 51.3 Mbits/sec || 64.5 Mbits/sec || 74.2 Mbits/sec || 24.136/27.096/36.095/2.587 ms || ||Northwestern to GPO IG|| 10.2 Mbits/sec || 24.7 Mbits/sec || 30.5 Mbits/sec || 67.5 Mbits/sec || 24.127/29.711/56.317/5.606 ms || == VM to remote OF VM measurements between multiple !OpenFlow sites (IG-CT-4 - Multiple sites '''OpenFlow''' experiment and interoperability) == All !OpenFlow combination use default Operating System and default link bandwidth. ||'''End points''' ||'''One Client(tcp)'''||'''5 Clients(tcp)'''||'''10 Clients(tcp)'''||'''1 client(udp)'''||'''Ping rtt min/avg/max/mdev'''|| ||GPO IG to GPO IG ||926 Mbits/sec || 932 Mbits/sec || 936 Mbits/sec || 810 Mbits/sec || 0.066/0.181/6.499/0.822 ms || ||Northwestern to Northwestern||939 Mbits/sec || 938 Mbits/sec || 935 Mbits/sec || 809 Mbits/sec || 0.066/1.044/58.357/7.461 ms || ||Utah IG to Utah IG ||934 Mbits/sec || 933 Mbits/sec || 934 Mbits/sec || 812 Mbits/sec || 0.069/2.123/122.830/15.714 ms || || || ||GPO IG to Northwestern ||13.1 Mbits/sec || 55.8 Mbits/sec || 110 Mbits/sec || 101 Mbits/sec || 24.267/30.973/422.718/51.000 ms || ||Northwestern to GPO IG ||890 Mbits/sec || 864 Mbits/sec || 832 Mbits/sec || 808 Mbits/sec || 24.320/31.271/439.747/53.179 ms || || || ||GPO IG to Utah IG (*) || 28.1 Mbits/se || 34.6 Mbits/sec || 44.1 Mbits/sec || 95.4 Mbits/sec || 270.577/420.450/3926.879/614.078 ms|| ||GPO IG to Utah IG (**) || 41.3 Mbits/sec || 56.4 Mbits/sec || 68.3 Mbits/sec || 95.5 Mbits/sec || 85.995/107.969/1232.550/147.996 ms || || || ||Utah IG to GPO IG (*) || 32.4 Mbits/sec || 67.6 Mbits/sec || 67.7 Mbits/sec || 95.7 Mbits/sec || 270.624/384.656/3385.019/496.738 ms|| ||Utah IG to GPO IG (**) || 77.7 Mbits/sec || 87.1 Mbits/sec || 91.2 Mbits/sec || 95.5 Mbits/sec || 85.990/104.017/1097.500/129.613 ms || || || ||GPO IG to Utah PG || 23.8 Mbits/sec || 43.6 Mbits/sec || 45.9 Mbits/sec || 932 Kbits/sec || 270.547/379.351/3300.089/482.218 ms || ||Northwestern to Utah PG || 34.1 Mbits/sec || 38.0 Mbits/sec || 49.0 Mbits/sec || 95.0 Mbits/sec || 246.707/343.387/3153.966/457.641 ms|| ||Utah IG to Utah PG || 933 Mbits/sec || 928 Mbits/sec || 936 Mbits/sec || 808 Mbits/sec || 0.157/2.285/123.481/15.778 ms || || || ||GPO IG to GPO EG || 854 Mbits/sec || 865 Mbits/sec || 861 Mbits/sec || 808 Mbits/sec || 0.155/1.294/48.102/6.194 ms || ||Utah IG to GPO EG || 3.79 Mbits/sec || 18.6 Mbits/sec || 35.2 Mbits/sec || 95.7 Mbits/sec || 270.673/391.340/3453.525/510.477 ms|| ||Utah PG to GPO EG || 3.82 Mbits/sec || 18.2 Mbits/sec || 35.1 Mbits/sec || 96.4 Mbits/sec || 270.619/381.588/3371.182/493.036 ms|| ||Northwestern to RENCI EG || 6.93 Mbits/sec || 34.3 Mbits/sec || 68.6 Mbits/sec || 806 Mbits/sec || 147.632/214.587/2465.440/341.732 ms|| || || ||Northwestern to WAPG Rutgers||130 Mbits/sec || 547 Mbits/sec || 850 Mbits/sec || 805 Mbits/sec || 155.140/227.661/2577.212/361.250 ms|| ||GPO IG to WAPG Rutgers || 112 Mbits/sec || 492 Mbits/sec || 815 Mbits/sec || 101 Mbits/sec || 179.018/243.752/2410.066/330.414 ms|| ||Utah IG to WAPG Rutgers || 74.1 Mbits/sec || 84.1 Mbits/sec || 89.7 Mbits/sec || 101 Mbits/sec || 100.676/122.137/1227.486/145.294 ms|| || || || Utah PG to Utah IG || 928 Mbits/sec || 932 Mbits/sec || 933 Mbits/sec || 806 Mbits/sec || 0.167/22.625/134.880/50.201 ms || || Utah PG to GPO IG (*) || 34.1 Mbits/sec || 64.1 Mbits/sec || 69.8 Mbits/sec || 96.0 Mbits/sec || 270.547/352.256/2868.660/397.82 ms || [[BR]] (*) Longest Path: GPO IG ->NLR CHIC->NLR DENV->NLR SEAT->NLR SUN->NLR ATLA->I2 ATLA->I2 WASH->I2 NEWY->I2 LOSA->UTAH IG [[BR]] (**) Shortest Path: GPO IG ->I2 NEWY->I2 LOSA-> UTAH IG