wiki:GENIRacksHome/InstageniRacks/ConfirmationTestStatus/InstageniPerformance

Version 76 (modified by lnevers@bbn.com, 6 years ago) (diff)

--

Confirmation Tests Performance Measurements

This page captures all performance measurements results captured during InstaGENI New Site Confirmation tests. For test details see the InstaGENI Confirmation Tests page. For test status see the InstaGENI New Site Confirmation Tests Status page.

Test Methodology

Test Characteristics:

  • All VMs at one site are on the same VM server, unless otherwise stated.
  • All results are captured for default bandwidth allocation (100Mb/s shaped), unless otherwise stated.
  • All results are captured for default OS (Fedora 15 STD).
  • All results collected between 2013-03-01 through 2013-03-07, unless otherwise stated.

Iperf TCP measurements captured in this page have the following assumptions:

  • All results are for a 60 second test run.
  • for OpenFlow scenarios, traffic is exchanged to establish data flows before measurement test runs are executed.
  • iperf '1 client' scenario command: 'iperf -c dest_host -t 60'
  • iperf '5 clients' scenario command: 'iperf -c dest_host -t 60 -P 5'
  • iperf '10 clients' scenario command: 'iperf -c dest_host -t 60 -P 10'

Iperf UDP measurements captured in this page have the following assumptions:

  • Each test run is 60 seconds.
  • UDP measurements within a rack requested a bandwidth of 1Gbits/sec for test run
  • UDP measurements between racks requested a bandwidth of 100 Mbits/sec, if results showed that 100Mb/s was possible, then increased to 1Gb/s.

Performance Results

VM to VM measurements within one rack (IG-CT-1 - Access to New Site VM resources)

End pointsOne Client(tcp)5 Clients(tcp)10 Clients(tcp)1 client(udp)Ping rtt min/avg/max/mdev
GPO 96.9 Mbits/sec 97.8 Mbits/sec 99.3 Mbits/sec 95.7 Mbits/sec 0.026/0.030/0.040/0.004 ms
Utah 96.9 Mbits/sec 97.7 Mbits/sec 99.1 Mbits/sec 96.7 Mbits/sec 0.028/0.031/0.053/0.008 ms
Northwestern 96.9 Mbits/sec 97.9 Mbits/sec 99.2 Mbits/sec 97.4 Mbits/sec 0.025/0.033/0.248/0.028 ms
Kentucky 96.9 Mbits/sec 98.0 Mbits/sec 98.9 Mbits/sec 95.2 Mbits/sec 0.025/0.082/3.229/0.409 ms
GATech 96.9 Mbits/sec 98.0 Mbits/sec 99.2 Mbits/sec 98.0 Mbits/sec 0.026/0.030/0.047/0.005 ms
Kettering 96.0 Mbits/sec 96.1 Mbits/sec 95.9 Mbits/sec 98.0 Mbits/sec 0.037/0.046/0.081/0.006 ms
Princeton 96.0 Mbits/sec 95.9 Mbits/sec 95.9 Mbits/sec 98.0 Mbits/sec 0.026/0.044/0.066/0.008 ms

VM to VM measurements within one rack (VMs on separate VM servers) (no specific test case exists)

Even though not part of planned tests, ran an experiment with 2 VMs each on a separate VM server to capture performance between VM nodes on different servers within the same rack.

End pointsOne Client(tcp)5 Clients(tcp)10 Clients(tcp)1 client(udp)Ping rtt min/avg/max/mdev
GPO 101 Mbits/sec 101 Mbits/sec 101 Mbits/sec 96.7 Mbits/sec 0.134/0.165/0.184/0.014 ms

PC to VM measurements within one rack (IG-CT-2 - Access to New Site Raw PC and VM resources)

End pointsOne Client(tcp)5 Clients(tcp)10 Clients(tcp)1 client(udp)Ping rtt min/avg/max/mdev
GPO 101 Mbits/sec 101 Mbits/sec 101 Mbits/sec 96.8 Mbits/sec 0.123/0.132/0.161/0.015 ms
Northwestern* 101 Mbits/sec 101 Mbits/sec 101 Mbits/sec 98.0 Mbits/sec 0.175/0.189/0.238/0.014 ms
Utah 101 Mbits/sec 101 Mbits/sec 101 Mbits/sec 96.8 Mbits/sec 0.118/0.133/0.170/0.015 ms
Kentucky 101 Mbits/sec 101 Mbits/sec 101 Mbits/sec 96.8 Mbits/sec 0.158/0.188/0.224/0.013 ms
GATech 101 Mbits/sec 101 Mbits/sec 100 Mbits/sec 97.9 Mbits/sec 0.120/0.139/0.153/0.017 ms
Kettering 99.7 Mbits/sec 99.6 Mbits/sec 99.5 Mbits/sec 97.8 Mbits/sec 0.149/0.193/0.255/0.022 ms
Princeton 99.6 Mbits/sec 99.5 Mbits/sec 99.5 Mbits/sec 97.8 Mbits/sec 0.171/0.184/0.233/0.020 ms

VM to PC measurements within one rack (IG-CT-2 - Access to New Site Raw PC and VM resources)

End pointsOne Client(tcp)5 Clients(tcp)10 Clients(tcp)1 client(udp)Ping rtt min/avg/max/mdev
GPO 101 Mbits/sec 101 Mbits/sec 102 Mbits/sec 98.0 Mbits/sec 0.134/0.148/0.168/0.016 ms
Northwestern* 101 Mbits/sec 101 Mbits/sec 101 Mbits/sec 98.0 Mbits/sec 0.137/0.157/0.177/0.017 ms
Utah 101 Mbits/sec 101 Mbits/sec 102 Mbits/sec 98.0 Mbits/sec 0.104/0.139/0.146/0.017 ms
Kentucky 101 Mbits/sec 101 Mbits/sec 102 Mbits/sec 96.2 Mbits/sec 0.146/0.157/0.174/0.006 ms
Kettering 95.9 Mbits/sec 96.1 Mbits/sec 96.0 Mbits/sec 98.0 Mbits/sec 0.171/0.182/0.199/0.015 ms
Princeton 95.9 Mbits/sec 96.1 Mbits/sec 95.8 Mbits/sec 97.8 Mbits/sec 0.154/0.166/0.199/0.009 ms

PC to PC measurements within one rack (no specific test case exist)

End pointsOne Client(tcp)5 Clients(tcp)10 Clients(tcp)1 client(udp)Ping rtt min/avg/max/mdev
GPO 941 Mbits/sec 942 Mbits/sec 942 Mbits/sec 806 Mbits/sec 0.139/0.183/0.229/0.015 ms
Northwestern 942 Mbits/sec 942 Mbits/sec 942 Mbits/sec 806 Mbits/sec 0.123/0.134/0.149/0.010 ms
GATech 941 Mbits/sec 942 Mbits/sec 942 Mbits/sec 807 Mbits/sec 0.108/0.134/0.145/0.016 ms
Kettering 941 Mbits/sec 942 Mbits/sec 942 Mbits/sec 808 Mbits/sec 0.093/0.183/0.224/0.025 ms
Princeton 942 Mbits/sec 942 Mbits/sec 942 Mbits/sec 807 Mbits/sec 0.119/0.126/0.159/0.014 ms

One Gbits/sec Links within one rack

For this test case, each link was requested with a speed of 1 Gbits/s. All tests were conducted in the GPO Rack on 2013-03-01.

End points One Client(tcp)5 Clients(tcp)10 Clients(tcp)1 client(udp)Ping rtt min/avg/max/mdev
VM to VM (1 VM server) 962 Mbits/sec 962 Mbits/sec 964 Mbits/sec 808 Mbits/sec 0.022/0.026/0.036/0.004 ms
VM (server1) to VM (server2)929 Mbits/sec 935 Mbits/sec 935 Mbits/sec 809 Mbits/sec 0.108/0.145/0.165/0.010 ms
PC to VM 939 Mbits/sec 940 Mbits/sec 940 Mbits/sec 806 Mbits/sec 0.123/0.175/0.215/0.017 ms
VM to PC 939 Mbits/sec 938 Mbits/sec 936 Mbits/sec 808 Mbits/sec 0.138/0.144/0.160/0.016 ms
PC to PC 941 Mbits/sec 942 Mbits/sec 942 Mbits/sec 806 Mbits/sec 0.136/0.174/0.192/0.012 ms

VM to remote VM measurements between two non-OF sites (IG-CT-3 - Multiple Sites experiment)

End points One Client(tcp)5 Clients(tcp)10 Clients(tcp)1 client(udp)Ping rtt min/avg/max/mdev
Utah IG to GPO IG 5.12 Mbits/sec 22.5 Mbits/sec 27.2 Mbits/sec 74.6 Mbits/sec 59.270/62.294/71.982/3.371 ms
GPO IG to Utah IG 19.5 Mbits/sec 39.8 Mbits/sec 46.2 Mbits/sec 69.3 Mbits/sec 59.187/62.125/71.587/3.282 ms
GPO IG to Northwestern 27.5 Mbits/sec 51.3 Mbits/sec 64.5 Mbits/sec 74.2 Mbits/sec 24.136/27.096/36.095/2.587 ms
Northwestern to GPO IG 10.2 Mbits/sec 24.7 Mbits/sec 30.5 Mbits/sec 67.5 Mbits/sec 24.127/29.711/56.317/5.606 ms
Kentucky to GPO 41.2 Mbits/sec 54.6 Mbits/sec 56.6 Mbits/sec 72.7 Mbits/sec 40.820/41.786/50.091/1.570 ms
GPO to Kentucky 53.4 Mbits/sec 65.7 Mbits/sec 64.7 Mbits/sec 75.2 Mbits/sec 40.736/41.645/51.870/2.115 ms
GATech to GPO 57.6 Mbits/sec 58.3 Mbits/sec 61.8 Mbits/sec 49.8 Mbits/sec 31.373/32.682/40.452/1.832 ms
GPO to GAtech 18.7 Mbits/sec 47.3 Mbits/sec 62.9 Mbits/sec 49.7 Mbits/sec 31.271/35.747/91.012/9.132 ms
Kettering to GPO 67.0 Mbits/sec 72.0 Mbits/sec 66.2 Mbits/sec 76.3 Mbits/sec 34.710/47.134/70.725/9.802 ms
GPO to Kettering 15.2 Mbits/sec 26.0 Mbits/sec 32.0 Mbits/sec 30.3 Mbits/sec 38.117/49.983/91.408/10.998 ms
Princeton to GPO 51.8 Mbits/sec 63.1 Mbits/sec 64.0 Mbits/sec 74.4 Mbits/sec 11.218/12.030/14.803/0.867 ms
GPO to Princeton 42.2 Mbits/sec 68.1 Mbits/sec 71.1 Mbits/sec 75.3 Mbits/sec 11.291/12.408/19.252/1.600 ms

VM to remote OF VM measurements between multiple OpenFlow sites (IG-CT-4 - Multiple sites OpenFlow experiment and interoperability)

All OpenFlow combination use default Operating System and default link bandwidth.

Local End points Date Rack Type One Client(tcp)5 Clients(tcp)10 Clients(tcp)1 client(udp)Ping rtt min/avg/max/mdev
GPO IG to GPO IG 2013-03-07 G7 926 Mbits/sec 932 Mbits/sec 936 Mbits/sec 810 Mbits/sec 0.066/0.181/6.499/0.822 ms
Northwestern to Northwestern2013-03-01 G7 939 Mbits/sec 938 Mbits/sec 935 Mbits/sec 809 Mbits/sec 0.066/1.044/58.357/7.461 ms
Utah IG to Utah IG 2013-03-07 G7 934 Mbits/sec 933 Mbits/sec 934 Mbits/sec 812 Mbits/sec 0.069/2.123/122.830/15.714 ms
UKY IG to UKY IG 2013-03-03 G7 930 Mbits/sec 934 Mbits/sec 935 Mbits/sec 808 Mbits/sec 0.069/1.567/89.650/11.467 ms
GA TECH IG to GA Tech IG (1)2013-05-07 G7 5.09 Gbits/sec 17.9 Gbits/sec 17.2 Gbits/sec 804 Mbits/sec 0.019/0.021/0.046/0.004 ms
GPO IG to GPO IG (1)2013-05-07 G7 5.35 Gbits/sec 18.2 Gbits/sec 16.5 Gbits/sec 806 Mbits/sec 0.022/0.023/0.035/0.004 ms
Utah IG to Utah IG (1)2013-05-07 G7 7.65 Gbits/sec 18.4 Gbits/sec 19.1 Gbits/sec 806 Mbits/sec 0.015/0.023/0.041/0.007 ms
Kettering IG to Kettering IG2013-05-21 G7 1.93 Gbits/sec 8.97 Gbits/sec 12.5 Gbits/sec 659 Mbits/sec 0.026/0.031/0.047/0.003 ms
Princeton IG to Princeton IG2013-05-24 G7 1.82 Gbits/sec 9.11 Gbits/sec 12.3 Gbits/sec 808 Mbits/sec 0.018/0.030/0.042/0.003 ms
UtahDDC IG to UtahDDC IG 2013-08-14 G8 1.39 Gbits/sec 5.12 Gbits/sec 8.59 Gbits/sec ?? 0.037/0.045/0.069/0.005 ms
Clemson IG to Clemson IG 2013-08-28 G7 1.81 Gbits/sec 8.65 Gbits/sec 12.2 Gbits/sec ?? 0.027/0.031/0.045/0.003 ms
NYU IG to NYU IG 2013-08-21 G7 1.89 Gbits/sec 8.60 Gbits/sec 12.6 Gbits/sec ?? 0.025/0.030/0.052/0.008 ms
NYSERNet IG to NYSERNET IG 2013-09-16 G8 1.28 Gbits/sec 5.03 Gbits/sec 8.52 Gbits/sec ?? 0.045/0.047/0.080/0.008 ms
MAX IG to MAX IG 2013-09-17 G8 1.26 Gbits/sec 5.06 Gbits/sec 8.56 Gbits/sec ?? 0.037/0.048/0.071/0.005 ms
Missouri IG to Missouri IG 2013-10-11 G7 1.24 Gbits/sec 4.99 Gbits/sec 8.77 Gbits/sec ?? 0.037/0.045/0.071/0.004 ms


End points One Client(tcp)5 Clients(tcp)10 Clients(tcp)1 client(udp)Ping rtt min/avg/max/mdev
GPO IG to Northwestern 13.1 Mbits/sec 55.8 Mbits/sec 110 Mbits/sec 101 Mbits/sec 24.267/30.973/422.718/51.000 ms
Northwestern to GPO IG 890 Mbits/sec 864 Mbits/sec 832 Mbits/sec 808 Mbits/sec 24.320/31.271/439.747/53.179 ms
GPO IG to Utah IG (*) 28.1 Mbits/se 34.6 Mbits/sec 44.1 Mbits/sec 95.4 Mbits/sec 270.577/420.450/3926.879/614.078 ms
GPO IG to Utah IG () 41.3 Mbits/sec 56.4 Mbits/sec 68.3 Mbits/sec 95.5 Mbits/sec 85.995/107.969/1232.550/147.996 ms
Utah IG to GPO IG (*) 32.4 Mbits/sec 67.6 Mbits/sec 67.7 Mbits/sec 95.7 Mbits/sec 270.624/384.656/3385.019/496.738 ms
Utah IG to GPO IG () 77.7 Mbits/sec 87.1 Mbits/sec 91.2 Mbits/sec 95.5 Mbits/sec 85.990/104.017/1097.500/129.613 ms
UKY IG to GPO IG 66.2 Mbits/sec 253 Mbits/sec 249 Mbits/sec 809 Mbits/sec 174.400/235.158/2376.246/320.207 ms
GPO IG to UKY IG 121 Mbits/sec 605 Mbits/sec 587 Mbits/sec 809 Mbits/sec 174.405/232.141/2286.578/305.249 ms
GPO IG to Utah PG 23.8 Mbits/sec 43.6 Mbits/sec 45.9 Mbits/sec 932 Kbits/sec 270.547/379.351/3300.089/482.218 ms
Northwestern to Utah PG 34.1 Mbits/sec 38.0 Mbits/sec 49.0 Mbits/sec 95.0 Mbits/sec 246.707/343.387/3153.966/457.641 ms
Utah IG to Utah PG 933 Mbits/sec 928 Mbits/sec 936 Mbits/sec 808 Mbits/sec 0.157/2.285/123.481/15.778 ms
UKY IG to Utah PG 47.4 Mbits/sec 56.9 Mbits/sec 70.9 Mbits/sec 95.5 Mbits/sec 121.731/148.954/1430.618/171.832 ms
GPO IG to GPO EG 854 Mbits/sec 865 Mbits/sec 861 Mbits/sec 808 Mbits/sec 0.155/1.294/48.102/6.194 ms
Utah IG to GPO EG 3.79 Mbits/sec 18.6 Mbits/sec 35.2 Mbits/sec 95.7 Mbits/sec 270.673/391.340/3453.525/510.477 ms
Utah PG to GPO EG 3.82 Mbits/sec 18.2 Mbits/sec 35.1 Mbits/sec 96.4 Mbits/sec 270.619/381.588/3371.182/493.036 ms
Northwestern to RENCI EG 6.93 Mbits/sec 34.3 Mbits/sec 68.6 Mbits/sec 806 Mbits/sec 147.632/214.587/2465.440/341.732 ms
UKY IG to RENCI EG 4.00 Mbits/sec 22.7 Mbits/sec 46.0 Mbits/sec 102 Mbits/sec 174.456/246.732/2609.205/363.068 ms
Northwestern to WAPG Rutgers130 Mbits/sec 547 Mbits/sec 850 Mbits/sec 805 Mbits/sec 155.140/227.661/2577.212/361.250 ms
GPO IG to WAPG Rutgers 112 Mbits/sec 492 Mbits/sec 815 Mbits/sec 101 Mbits/sec 179.018/243.752/2410.066/330.414 ms
Utah IG to WAPG Rutgers 74.1 Mbits/sec 84.1 Mbits/sec 89.7 Mbits/sec 101 Mbits/sec 100.676/122.137/1227.486/145.294 ms
UKY IG to WAPG Rutgers 672 Mbits/sec 780 Mbits/sec 742 Mbits/sec 736 Mbits/sec 30.161/39.489/586.414/71.203 ms
Utah PG to Utah IG 928 Mbits/sec 932 Mbits/sec 933 Mbits/sec 806 Mbits/sec 0.167/22.625/134.880/50.201 ms
Utah PG to GPO IG (*) 34.1 Mbits/sec 64.1 Mbits/sec 69.8 Mbits/sec 96.0 Mbits/sec 270.547/352.256/2868.660/397.82 ms
GA Tech IG to GPO IG 125 Mbits/sec 657 Mbits/sec 520 Mbits/sec 808 Mbits/sec 162.022/224.885/2401.036/326.559 ms
GA Tech IG to Utah PG 48.6 Mbits/sec 48.2 Mbits/sec 61.5 Mbits/sec 95.3 Mbits/sec 108.163/134.009/1379.099/165.783 ms
GA Tech IG to GPO EG 6.27 Mbits/sec 31.4 Mbits/sec 63.0 Mbits/sec 808 Mbits/sec 162.131/236.184/2632.436/369.881 ms
GA Tech IG to Rutgers WAPG 920 Mbits/sec 932 Mbits/sec 937 Mbits/sec 808 Mbits/sec 17.690/28.846/643.180/80.139 ms
Kettering IG to GPO IG 2.83 Mbits/sec 12.5 Mbits/sec 19.8 Mbits/sec 659 Mbits/sec 31.827/39.530/491.006/58.777 ms
Kettering IG to Utah PG 1.65 Mbits/sec 6.57 Mbits/sec 9.99 Mbits/sec 94.9 Mbits/sec 248.327/337.385/2795.285/390.845 ms
Kettering IG to RENCI EG 31.1 Kbits/sec 496 Kbits/sec 931 Kbits/sec 8.62 Mbits/sec 155.188/229.932/2618.225/371.394 ms
Kettering IG to WAPG Rutgers1.33 Mbits/sec 5.94 Mbits/sec 11.4 Mbits/sec 559 Mbits/sec 162.682/228.815/2440.697/335.288 ms
Princeton IG to GPO IG 63.8 Mbits/sec 196 Mbits/sec 201 Mbits/sec ? 178.951/229.494/2213.896/288.025 ms
Princeton IG to Utah PG 11.5 Mbits/sec 47.7 Mbits/sec 57.4 Mbits/sec ? 94.629/111.203/1033.517/120.084 ms
Princeton IG to RENCI EG 364 Kbits/sec 1.99 Mbits/sec 4.21 Mbits/sec 8.61 Mbits/sec 27.348/45.917/1076.022/134.316 ms
Princeton IG to WAPG Rutgers200 Mbits/sec 255 Mbits/sec 416 Mbits/sec ? 9.033/13.697/287.493/35.645 ms |


(*) Longest Path: GPO IG ->NLR CHIC->NLR DENV->NLR SEAT->NLR SUN->NLR ATLA->I2 ATLA->I2 WASH->I2 NEWY->I2 LOSA->UTAH IG
() Shortest Path: GPO IG ->I2 NEWY->I2 LOSA-> UTAH IG (1) Results changed on 2013-05-07 test run, looking for answer on instageni-design mail list.