Changes between Version 25 and Version 26 of GENIRacksHome/InstageniRacks/ConfirmationTestStatus/InstageniPerformance


Ignore:
Timestamp:
03/04/13 12:51:18 (11 years ago)
Author:
lnevers@bbn.com
Comment:

--

Legend:

Unmodified
Added
Removed
Modified

  • GENIRacksHome/InstageniRacks/ConfirmationTestStatus/InstageniPerformance

    v25 v26  
    33= Confirmation Tests Performance Measurements =
    44
    5 This page captures all performance measurements captured during InstaGENI New Site Confirmation tests. For test details  see the '''[wiki:GENIRacksHome/InstageniRacks/SiteConfirmationTests InstaGENI Confirmation Tests]''' page. For test status see the '''[wiki:GENIRacksHome/InstageniRacks/ConfirmationTestStatus InstaGENI New Site Confirmation Tests Status]''' page.
     5This page captures all performance measurements results captured during InstaGENI New Site Confirmation tests. For test details  see the '''[wiki:GENIRacksHome/InstageniRacks/SiteConfirmationTests InstaGENI Confirmation Tests]''' page. For test status see the '''[wiki:GENIRacksHome/InstageniRacks/ConfirmationTestStatus InstaGENI New Site Confirmation Tests Status]''' page.
    66
    7 '''Note1:''' All results are captured for default bandwidth allocation, unless otherwise stated. [[BR]]
    8 '''Note2:''' If interface speed is not specified, bandwidth is shaped to 100 Mb/sec.
     7Test Characteristics:
     8 - All VMs at site are on the same VM server, unless otherwise stated.
     9 - All results are captured for default bandwidth allocation, unless otherwise stated.
     10 - All results are captured for default OS (Fedora 15 STD).
     11 - All results collected on 2013-03-01 and 2013-03-04, unless otherwise stated.
    912
    1013== VM to VM measurements within one rack (IG-CT-1 - Access to New Site VM resources) ==
    1114
    1215||'''End points'''||'''One Client(tcp)'''||'''5 Clients(tcp)'''||'''10 Clients(tcp)'''||'''1 client(udp)'''||'''Ping rtt min/avg/max/mdev'''||
    13 ||    GPO         ||96.9 Mbits/sec       ||97.8 Mbits/sec      ||99.5 Mbits/sec       || 1.04 Mbits/sec    || 0.020/0.030/0.047/0.005 ms ||
    14 ||    Utah        ||96.9 Mbits/sec       ||98.1 Mbits/sec      ||99.1 Mbits/sec       || 1.07 Mbits/sec    || 0.029/0.034/0.053/0.009 ms ||
    15 ||Northwestern    ||96.9 Mbits/sec       ||97.9 Mbits/sec      ||99.1 Mbits/sec       || 1.07 Mbits/sec    || 0.025/0.030/0.038/0.003 ms ||
     16||    GPO         ||96.9 Mbits/sec       ||97.8 Mbits/sec      ||99.3 Mbits/sec       || 1.07 Mbits/sec    || 0.026/0.030/0.040/0.004 ms ||
     17||    Utah        ||96.9 Mbits/sec       ||97.7 Mbits/sec      ||99.1 Mbits/sec       || 1.07 Mbits/sec    || 0.028/0.031/0.053/0.008 ms ||
     18||Northwestern    ||96.9 Mbits/sec       ||97.9 Mbits/sec      ||99.2 Mbits/sec       || 1.05 Mbits/sec    || 0.025/0.033/0.248/0.028 ms ||
     19
     20
     21== VM to VM measurements within one rack (VMs on separate VM servers) (no specific test case exist) ==
     22Even though not part of planned tests, ran an experiment with 2 VMs each on a separate VM servers to capture performance between VM nodes on different servers within the same rack.
     23||'''End points'''||'''One Client(tcp)'''||'''5 Clients(tcp)'''||'''10 Clients(tcp)'''||'''1 client(udp)'''||'''Ping rtt min/avg/max/mdev'''||
     24||    GPO         ||  101 Mbits/sec      || 101 Mbits/sec      || 101 Mbits/sec       || 1.05 Mbits/sec    || 0.134/0.165/0.184/0.014 ms    ||
     25
     26
     27== PC to VM  measurements within one rack (IG-CT-2 - Access to New Site Raw PC and VM resources)  ==
     28
     29||'''End points'''||'''One Client(tcp)'''||'''5 Clients(tcp)'''||'''10 Clients(tcp)'''||'''1 client(udp)'''||'''Ping rtt min/avg/max/mdev'''||
     30||     GPO          ||  101 Mbits/sec    || 101 Mbits/sec      || 101 Mbits/sec       || 1.05 Mbits/sec    || 0.123/0.132/0.161/0.015 ms ||
     31||  Northwestern*   ||  101 Mbits/sec    || 101 Mbits/sec      || 101 Mbits/sec       || 1.05 Mbits/sec    || 0.175/0.189/0.238/0.014 ms ||
     32||  Utah            ||  101 Mbits/sec    || 101 Mbits/sec      || 101 Mbits/sec       || 1.05 Mbits/sec    || 0.118/0.133/0.170/0.015 ms ||
     33 
     34'' (*) need to re-execute when raw-pc is available - results collected on 2013-02-20''
    1635
    1736== VM to PC measurements within one rack (IG-CT-2 - Access to New Site Raw PC and VM resources)  ==
    1837
    1938||'''End points'''||'''One Client(tcp)'''||'''5 Clients(tcp)'''||'''10 Clients(tcp)'''||'''1 client(udp)'''||'''Ping rtt min/avg/max/mdev'''||
    20 ||     GPO          ||  101 Mbits/sec    || 101 Mbits/sec   || 101 Mbits/sec    || 1.05 Mbits/sec|| 0.147/0.174/0.194/0.017 ms ||
    21 ||  Northwestern*   ||  101 Mbits/sec    || 101 Mbits/sec   || 101 Mbits/sec    || 1.05 Mbits/sec|| 0.175/0.189/0.238/0.014 ms ||
    22 ||  Utah            ||  939 Mbits/sec    || 940 Mbits/sec   || 940 Mbits/sec    || 1.05 Mbits/sec|| 0.118/0.147/0.351/0.049 ms ||
     39||     GPO          ||  101 Mbits/sec    || 101 Mbits/sec      || 102 Mbits/sec       || 1.05 Mbits/sec    || 0.134/0.148/0.168/0.016 ms ||
     40||  Northwestern*   ||  -----            || -----              || -----               || -----             || -----                      ||
     41||  Utah            ||  101 Mbits/sec    || 101 Mbits/sec      || 102 Mbits/sec       || 1.06 Mbits/sec    || 0.104/0.139/0.146/0.017 ms ||
    2342 
    24 '' (* need to re-execute when raw-pc is available)''
     43'' (*) need to capture when raw-pc is available - no results have been collected for this in past test runs''
     44
    2545
    2646== PC to PC measurements within one rack (no specific test case exist) ==
     47
    2748||'''End points'''||'''One Client(tcp)'''||'''5 Clients(tcp)'''||'''10 Clients(tcp)'''||'''1 client(udp)'''||'''Ping rtt min/avg/max/mdev'''||
    28 || Northwestern   || 942 Mbits/sec       || 942 Mbits/sec      || 942 Mbits/sec       || 1.05 Mbits/sec    || 0.123/0.134/0.149/0.010 ms    ||
     49||    GPO         || 941 Mbits/sec       || 942 Mbits/sec      || 942 Mbits/sec       || 1.05 Mbits/sec    || 0.139/0.183/0.229/0.015 ms    ||
     50||Northwestern (*)|| 942 Mbits/sec       || 942 Mbits/sec      || 942 Mbits/sec       || 1.05 Mbits/sec    || 0.123/0.134/0.149/0.010 ms    ||
    2951
     52 (*) Collected on 2013-02-20 - need to re-capture when raw-pcs are available after demo.
    3053
    31 == VM to VM measurements within one rack (VMs on separate VM servers) (no specific test case exist) ==
    32 ||'''End points'''||'''One Client(tcp)'''||'''5 Clients(tcp)'''||'''10 Clients(tcp)'''||'''1 client(udp)'''||'''Ping rtt min/avg/max/mdev'''||
    33 || GPO            ||  101 Mbits/sec      || 101 Mbits/sec      || 102 Mbits/sec       || 1.05 Mbits/sec    ||0.128/0.151/0.164/0.011 ms     ||
     54== One Gbits/sec Links within one rack ==
    3455
    35 == One Gb/s Links within one rack ==
     56For this test case, each link was requested with a speed of 1 Gb/s.  All tests were conducted in the GPO Rack on 2013-03-01.
    3657
    37 For this test case, each link was requested with a speed of 1 Gb/s.  All tests were conducted in the GPO Rack on 2013-02-26.
    38 
    39 ||'''End points'''     ||'''One Client(tcp)'''||'''5 Clients(tcp)'''||'''10 Clients(tcp)'''||'''1 client(udp)'''||'''Ping rtt min/avg/max/mdev'''||
    40 ||VM to VM (1 VM server)      ||931 Mbits/sec || 936 Mbits/sec      || 933 Mbits/sec       || 1.05 Mbits/sec    || 0.062/0.070/0.117/0.009 ms  ||
    41 ||VM (server1) to VM (server2)||930 Mbits/sec || 934 Mbits/sec      || 935 Mbits/sec       || 1.05 Mbits/sec    || 0.139/0.145/0.163/0.010 ms  ||
    42 ||PC to VM                    ||939 Mbits/sec || 940 Mbits/sec      || 940 Mbits/sec       || 1.05 Mbits/sec    || 0.170/0.183/0.202/0.017 ms  ||
    43 ||PC to PC                    ||942 Mbits/sec || 942 Mbits/sec      || 942 Mbits/sec       || 1.05 Mbits/sec    || 0.123/0.172/0.220/0.027 ms  ||
     58||'''End points'''        ''One Client(tcp)'''||'''5 Clients(tcp)'''||'''10 Clients(tcp)'''||'''1 client(udp)'''||'''Ping rtt min/avg/max/mdev'''||
     59||VM to VM (1 VM server)      ||962 Mbits/sec || 962 Mbits/sec      || 964 Mbits/sec       || 1.05 Mbits/sec    || 0.022/0.026/0.036/0.004 ms  ||
     60||VM (server1) to VM (server2)||929 Mbits/sec || 935 Mbits/sec      || 935 Mbits/sec       || 1.05 Mbits/sec    || 0.108/0.145/0.165/0.010 ms  ||
     61||PC to VM                    ||939 Mbits/sec || 940 Mbits/sec      || 940 Mbits/sec       || 1.05 Mbits/sec    || 0.123/0.175/0.215/0.017 msi  ||
     62||VM to PC                    ||939 Mbits/sec || 938 Mbits/sec      || 936 Mbits/sec       || 1.05 Mbits/sec    || 0.138/0.144/0.160/0.016 ms  ||
     63||PC to PC                    ||941 Mbits/sec || 942 Mbits/sec      || 942 Mbits/sec       || 1.05 Mbits/sec    || 0.136/0.174/0.192/0.012 ms  ||
    4464
    4565== VM to remote VM measurements between two non-OF sites (IG-CT-3 - Multiple Sites experiment)  ==
    4666
    47 ||'''End points'''||'''One Client(tcp)'''||'''5 Clients(tcp)'''||'''10 Clients(tcp)'''||'''1 client(udp)'''||'''Ping rtt min/avg/max/mdev'''||
    48 ||Utah IG to GPO IG     ||  84.5 Mbits/sec   || 80.5 Mbits/sec  || 84.1 Mbits/sec   || 1.05 Mbits/sec|| 70.470/70.645/71.089/0.276 ms ||
    49 ||GPO IG to Northwestern||  69.5 Mbits/sec   || 80.8 Mbits/sec  || 78.2 Mbits/sec   || 1.04 Mbits/sec|| 24.241/24.526/25.391/0.325 ms ||
     67||'''End points'''      ||'''One Client(tcp)'''||'''5 Clients(tcp)'''||'''10 Clients(tcp)'''||'''1 client(udp)'''||'''Ping rtt min/avg/max/mdev'''||
     68||Utah IG to GPO IG     ||  5.12 Mbits/sec     || 22.5 Mbits/sec     || 27.2 Mbits/sec      || 1.05 Mbits/sec    || 59.270/62.294/71.982/3.371 ms ||
     69||GPO IG to Utah IG     ||  19.5 Mbits/sec     || 39.8 Mbits/sec     || 46.2 Mbits/sec      || 1.05 Mbits/sec    || 59.187/62.125/71.587/3.282 ms ||
     70||GPO IG to Northwestern||  27.5 Mbits/sec     || 51.3 Mbits/sec     || 64.5 Mbits/sec      || 1.05 Mbits/sec    || 24.136/27.096/36.095/2.587 ms ||
     71||Northwestern to GPO IG||  10.2 Mbits/sec     || 24.7 Mbits/sec     || 30.5 Mbits/sec      || 1.04 Mbits/sec    || 24.127/29.711/56.317/5.606 ms ||
     72
     73== VM to remote OF VM measurements between multiple OF sites (IG-CT-4 - Multiple sites '''OpenFlow''' experiment and interoperability)  ==
     74All !OpenFlow combination use default OS and link bandwidth.
    5075
    5176
    52 == VM to remote OF VM measurements between multiple OF sites (IG-CT-4 - Multiple sites '''OpenFlow''' experiment and interoperability)  ==
     77||'''End points'''        ||'''One Client(tcp)'''||'''5 Clients(tcp)'''||'''10 Clients(tcp)'''||'''1 client(udp)'''||'''Ping rtt min/avg/max/mdev'''||
     78||GPO IG to GPO IG            ||926 Mbits/sec    || 932 Mbits/sec      ||  936 Mbits/sec      || 1.05 Mbits/sec    || 0.066/0.181/6.499/0.822 ms    ||
     79||Northwestern to Northwestern||939 Mbits/sec    || 938 Mbits/sec      ||  935 Mbits/sec      || 1.05 Mbits/sec    || 0.066/1.044/58.357/7.461 ms   ||
     80||Utah IG to Utah IG          ||934 Mbits/sec    || 933 Mbits/sec      ||  934 Mbits/sec      || 1.05 Mbits/sec    || 0.069/2.123/122.830/15.714 ms ||
     81||GPO IG to Northwestern      ||6.88 Mbits/sec   || 35.5 Mbits/sec     ||  88.5 Mbits/sec     || 1.05 Mbits/sec    || 24.299/31.538/456.451/55.319 ms ||
     82||Northwestern to GPO IG      ||890 Mbits/sec    || 864 Mbits/sec      ||  832 Mbits/sec      || 1.05 Mbits/sec    || 24.320/31.271/439.747/53.179 ms ||
     83||Utah IG to Utah PG          ||  933 Mbits/sec  || 928 Mbits/sec      ||  936 Mbits/sec      || 1.05 Mbits/sec    || 0.157/2.285/123.481/15.778 ms ||
     84||GPO IG to WAPG Rutgers      || 112 Mbits/sec   || 472 Mbits/sec      ||  805 Mbits/sec      || 1.07 Mbits/sec    || 179.018/243.752/2410.066/330.414 ms||
     85||Northwestern to RENCI EG    || 6.93 Mbits/sec  || 34.3 Mbits/sec     || 68.6 Mbits/sec      || 1.07 Mbits/sec    || 147.632/214.587/2465.440/341.732 ms||
     86||GPO IG to Utah IG (*)       || 16.6 Mbits/sec  || 33.3 Mbits/sec     || 44.1 Mbits/sec      || 1.05 Mbits/sec    || 270.577/420.450/3926.879/614.078 ms||
     87||Utah IG to GPO IG (*)       || 28.9 Mbits/sec  || 61.6 Mbits/sec     || 67.4 Mbits/sec      || 1.07 Mbits/sec    || 270.624/384.656/3385.019/496.738 ms||
     88||GPO IG to Utah IG (**)      ||   ---  ||---   || --- || --- || --- ||
     89||Utah IG to GPO IG (**)      ||  ---  ||---   || --- || --- || --- ||
     90||GPO IG to Utah PG (*)       || 23.8 Mbits/sec  || 43.6 Mbits/sec || 44.8 Mbits/sec || 1.06 Mbits/sec  || 270.547/379.351/3300.089/482.218 ms ||
     91||GPO IG to GPO EG            || 852 Mbits/sec   || 859 Mbits/sec      || 858 Mbits/sec      || 1.05 Mbits/sec     || 0.155/1.294/48.102/6.194 ms ||
     92||Northwestern to WAPG Rutgers||130 Mbits/sec    || 526 Mbits/sec      || 850 Mbits/sec      || 1.07 Mbits/sec     || 155.140/227.661/2577.212/361.250 ms||
     93||Northwestern to Utah PG     || 34.1 Mbits/sec  || 38.0 Mbits/sec     || 49.0 Mbits/sec     || 1.06 Mbits/sec     || 246.707/343.387/3153.966/457.641 ms||
     94||Utah IG to GPO EG           || 3.79 Mbits/sec  || 16.9 Mbits/sec     || 35.6 Mbits/sec     || 1.07 Mbits/sec     || 270.673/391.340/3453.525/510.477 ms||
     95||Utah PG to GPO EG           || 3.82 Mbits/sec  || 18.2 Mbits/sec     || 35.1 Mbits/sec     || 1.08 Mbits/sec     || 270.619/381.588/3371.182/493.036 ms||
     96||Utah IG to WAPG Rutgers     || 73.2 Mbits/sec  || 84.1 Mbits/sec     || 89.7 Mbits/sec     || 1.06 Mbits/sec     || 100.676/122.137/1227.486/145.294 ms||
    5397
    54 ||'''End points'''       ||'''One Client(tcp)'''||'''5 Clients(tcp)'''||'''10 Clients(tcp)'''||'''1 client(udp)'''||'''Ping rtt min/avg/max/mdev'''||
    55 ||GPO IG to GPO IG       ||939 Mbits/sec    || 941 Mbits/sec   || 940 Mbits/sec    || 1.04 Mbits/sec|| 0.072/0.185/6.738/0.853 ms          ||
    56 ||GPO IG to Utah IG      || 11.2 Mbits/sec  || 21.7 Mbits/sec  || 41.5 Mbits/sec   || 1.04 Mbits/sec|| 288.700/375.296/3010.292/417.964 ms ||
    57 ||GPO IG to Utah PG      || 10.7 Mbits/sec  || 25.2 Mbits/sec  || 36.7 Mbits/sec   || 1.05 Mbits/sec|| 288.657/393.405/3311.733/477.873 ms ||
    58 ||GPO IG to GPO EG       || 863 Mbits/sec   || 883 Mbits/sec   || 885 Mbits/sec    || 1.05 Mbits/sec|| 0.291/0.804/17.784/2.257 ms         ||
    59 ||GPO IG to WAPG Rutgers ||  112 Mbits/sec  || 558 Mbits/sec   || 904 Mbits/sec    || 1.07 Mbits/sec|| 179.010/221.195/1923.656/243.338 ms||
    60 ||Northwestern to Northwestern||939 Mbits/sec    || 939 Mbits/sec   || 940 Mbits/sec    || 1.05 Mbits/sec|| 0.072/1.048/58.480/7.477 ms ||
    61 ||Northwestern to GPO IG || 890 Mbits/sec   || 892 Mbits/sec   || 915 Mbits/sec    || 1.06 Mbits/sec|| 24.293/37.867/835.825/103.885 ms    ||
    62 ||Northwestern to Utah PG|| 33.5 Mbits/sec  || 37.5 Mbits/sec  || 47.3 Mbits/sec   || 1.06 Mbits/sec|| 255.749/358.511/3220.139/471.969 ms ||
    63 ||Northwestern to RENCI EG|| ---  ||---   || --- || --- || --- ||
    64 ||Northwestern IG to WAPG Rutgers  ||  129 Mbits/sec    || 645 Mbits/sec   || 906 Mbits/sec    || 1.07 Mbits/sec|| 155.135/218.759/2397.769/327.645 ms||
    65 ||Utah IG to Utah IG     || 939 Mbits/sec   || 940 Mbits/sec   || 940 Mbits/sec    || 1.05 Mbits/sec|| 0.068/2.220/128.164/16.396 ms ||
    66 ||Utah IG to GPO IG      || 35.0 Mbits/sec  || 68.2 Mbits/sec  || 71.3 Mbits/sec   || 1.07 Mbits/sec|| 279.685/310.530/1607.045/183.129 ms ||
    67 ||Utah IG to Utah PG     || 904 Mbits/sec   || 905 Mbits/sec   || 905 Mbits/sec    || 1.05 Mbits/sec|| 0.158/1.287/66.300/8.324 ms ||
    68 ||Utah IG to GPO EG      || 3.55 Mbits/sec  || 17.3 Mbits/sec  || 32.8 Mbits/sec   || 1.07 Mbits/sec|| 288.919/383.758/3041.091/430.253 ms||
    69 ||Utah PG to GPO EG      || 3.56 Mbits/sec  || 17.4 Mbits/sec  || 33.6 Mbits/sec   || 1.07 Mbits/sec|| 288.861/367.581/2837.850/387.586 ms||
    70 ||Utah IG to WAPG Rutgers||  74.8 Mbits/sec   || 84.0 Mbits/sec  || 87.2 Mbits/sec   ||1.06 Mbits/sec || 109.729/131.565/1246.176/146.617 ms||
    71 
    72 
     98(*) Longest Path: GPO IG ->NLR CHIC->NLR DENV->NLR SEAT->NLR SUN->NLR ATLA->I2 ATLA->I2 WASH->I2 NEWY->I2 LOSA->UTAH IG  [[BR]]
     99(**) Shortest Path: GPO IG ->I2 NEWY->I2 LOSA-> UTAH IG