[[PageOutline]] = Continuation Round 3 = In this round, I ran plastic-104, plastic-105, and plastic-106, for about 24 hours, with a somewhat higher data rate for plastic-106. The raw logs are at http://www.gpolab.bbn.com/plastic-slices/continuation/round-3/. = plastic-104 = [ggw:PlasticSlices/Experiments#SteadyPerfUDP SteadyPerf UDP], using port=5104, time=518400, rate=3, and this table of client/server pairs: || '''client''' || '''server''' || '''server address''' || || ganel.gpolab.bbn.com || wings-openflow-2.wail.wisc.edu || server=10.42.104.95 || || wings-openflow-3.wail.wisc.edu || orbitplc2.orbit-lab.org || server=10.42.104.112 || || orbitplc1.orbit-lab.org || pl4.myplc.grnoc.iu.edu || server=10.42.104.72 || || pl5.myplc.grnoc.iu.edu || sardis.gpolab.bbn.com || server=10.42.104.53 || == One-time prep commands run on each client and server == {{{ sudo yum -y install iperf }}} == Commands run on each server == {{{ server= nice -n 19 iperf -u -B $server -p 5104 -s -i 1 }}} == Commands run on each client == {{{ server= nice -n 19 iperf -u -c $server -p 5104 -t 518400 -b 3M }}} == Results == Generated with {{{ subnet=104 for host in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt | sed -r -e 's/.+@//') ; do echo -e "$host:\n\n{{{" ; grep -A 10 -B 1 "Client connecting" pgenigpolabbbncom_plastic$subnet\@$host.log ; echo -e "}}}\n" ; done }}} and then edited slightly to remove artifacts (like control characters, my prompt, etc). ganel.gpolab.bbn.com: {{{ ------------------------------------------------------------ Client connecting to 10.42.104.95, UDP port 5104 Sending 1470 byte datagrams UDP buffer size: 110 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.104.51 port 35659 connected with 10.42.104.95 port 5104 [ 3] 0.0-419705.3 sec 147 GBytes 3.00 Mbits/sec [ 3] Sent 107067685 datagrams [ 3] Server Report: [ 3] 0.0-419704.5 sec 147 GBytes 3.00 Mbits/sec 0.038 ms 4813/107067685 (0.0045%) [ 3] 0.0-419704.5 sec 382 datagrams received out-of-order }}} wings-openflow-3.wail.wisc.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.104.112, UDP port 5104 Sending 1470 byte datagrams UDP buffer size: 110 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.104.96 port 42153 connected with 10.42.104.112 port 5104 [ ID] Interval Transfer Bandwidth [ 3] 0.0-419706.4 sec 147 GBytes 3.00 Mbits/sec [ 3] Sent 107067959 datagrams [ 3] Server Report: [ 3] 0.0-419704.2 sec 147 GBytes 3.00 Mbits/sec 0.032 ms 12488/107067958 (0.012%) [ 3] 0.0-419704.2 sec 324 datagrams received out-of-order }}} orbitplc1.orbit-lab.org: {{{ ------------------------------------------------------------ Client connecting to 10.42.104.72, UDP port 5104 Sending 1470 byte datagrams UDP buffer size: 110 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.104.111 port 60665 connected with 10.42.104.72 port 5104 [ 3] 0.0-419708.5 sec 147 GBytes 3.00 Mbits/sec [ 3] Sent 107068503 datagrams [ 3] Server Report: [ 3] 0.0-419707.2 sec 147 GBytes 3.00 Mbits/sec 0.007 ms 4427/107068503 (0.0041%) [ 3] 0.0-419707.2 sec 14579 datagrams received out-of-order }}} pl5.myplc.grnoc.iu.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.104.53, UDP port 5104 Sending 1470 byte datagrams UDP buffer size: 110 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.104.73 port 52812 connected with 10.42.104.53 port 5104 [ 3] 0.0-419710.3 sec 147 GBytes 3.00 Mbits/sec [ 3] Sent 107068943 datagrams [ 3] Server Report: [ 3] 0.0-419708.3 sec 147 GBytes 3.00 Mbits/sec 0.015 ms 3567/107068943 (0.0033%) [ 3] 0.0-419708.3 sec 1269 datagrams received out-of-order }}} == Analysis == All data seems to have been sent successfully (up to three or four nines, anyway). = plastic-105 = [ggw:PlasticSlices/Experiments#SteadyPerfTCP SteadyPerf TCP], using port=5105, time=518400, and this table of client/server pairs: || '''client''' || '''server''' || '''server address''' || || wings-openflow-2.wail.wisc.edu || planetlab5.clemson.edu || server=10.42.105.105 || || planetlab4.clemson.edu || navis.gpolab.bbn.com || server=10.42.105.55 || || bain.gpolab.bbn.com || plnode2.cip.gatech.edu || server=10.42.105.101 || || plnode1.cip.gatech.edu || wings-openflow-3.wail.wisc.edu || server=10.42.105.96 || == One-time prep commands run on each client and server == {{{ sudo yum -y install iperf }}} == Commands run on each server == {{{ server= nice -n 19 iperf -B $server -p 5105 -s -i 1 }}} == Commands run on each client == {{{ server= nice -n 19 iperf -c $server -p 5105 -t 518400 }}} == Results == Generated with {{{ subnet=105 for host in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt | sed -r -e 's/.+@//') ; do echo -e "$host:\n\n{{{" ; grep -A 5 -B 1 "Client connecting" pgenigpolabbbncom_plastic$subnet\@$host.log ; echo -e "}}}\n" ; done }}} and then edited slightly to remove artifacts (like control characters, my prompt, etc). wings-openflow-2.wail.wisc.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.105.105, TCP port 5105 TCP window size: 16.0 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.105.95 port 35647 connected with 10.42.105.105 port 5105 [ ID] Interval Transfer Bandwidth [ 3] 0.0-419705.2 sec 588 GBytes 12.0 Mbits/sec }}} planetlab4.clemson.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.105.55, TCP port 5105 TCP window size: 16.0 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.105.104 port 50228 connected with 10.42.105.55 port 5105 [ ID] Interval Transfer Bandwidth [ 3] 0.0-418795.8 sec 309 GBytes 6.34 Mbits/sec }}} bain.gpolab.bbn.com: {{{ ------------------------------------------------------------ Client connecting to 10.42.105.101, TCP port 5105 TCP window size: 16.0 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.105.54 port 38101 connected with 10.42.105.101 port 5105 [ 3] 0.0-419708.3 sec 244 GBytes 4.98 Mbits/sec }}} plnode1.cip.gatech.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.105.96, TCP port 5105 TCP window size: 16.0 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.105.100 port 40071 connected with 10.42.105.96 port 5105 [ 3] 0.0-419709.8 sec 91.2 GBytes 1.87 Mbits/sec }}} == Analysis == A fair bit of variability in transfer speeds, correlating somewhat with latency. Wisconsin - Clemson only goes through two NLR switches (Chicago to Atlanta); Clemson - BBN follows the same path in the core, but has to go from Chicago all the way to Boston, so that makes sense. The results that include GT are harder to explain: BBN - GT is slower than BBN - Clemson, where you might expect it to be faster; and GT - Wisconsin is slowest of all, a factor of six worse than Wisconsin - Clemson. What's up there? = plastic-106 = [ggw:PlasticSlices/Experiments#SteadyPerfUDP SteadyPerf UDP], using port=5106, time=518400, rate=30, and this table of client/server pairs: || '''client''' || '''server''' || '''server address''' || || planetlab5.clemson.edu || wings-openflow-2.wail.wisc.edu || server=10.42.106.95 || || wings-openflow-3.wail.wisc.edu || plnode1.cip.gatech.edu || server=10.42.106.100 || || plnode2.cip.gatech.edu || bain.gpolab.bbn.com || server=10.42.106.54 || || navis.gpolab.bbn.com || planetlab4.clemson.edu || server=10.42.106.104 || == One-time prep commands run on each client and server == {{{ sudo yum -y install iperf }}} == Commands run on each server == {{{ server= nice -n 19 iperf -u -B $server -p 5106 -s -i 1 }}} == Commands run on each client == {{{ server= nice -n 19 iperf -u -c $server -p 5106 -t 518400 -b 30M }}} == Results == Generated with {{{ subnet=106 for host in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt | sed -r -e 's/.+@//') ; do echo -e "$host:\n\n{{{" ; grep -A 10 -B 1 "Client connecting" pgenigpolabbbncom_plastic$subnet\@$host.log ; echo -e "}}}\n" ; done }}} and then edited slightly to remove artifacts (like control characters, my prompt, etc). planetlab5.clemson.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.106.95, UDP port 5106 Sending 1470 byte datagrams UDP buffer size: 110 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.106.105 port 41280 connected with 10.42.106.95 port 5106 [ ID] Interval Transfer Bandwidth [ 3] 0.0-419322.8 sec 1572460575840 bits 30.0 Mbits/sec [ 3] Sent 1069701072 datagrams [ 3] Server Report: [ 3] 0.0-419322.2 sec 1572384115260 bits 30.0 Mbits/sec 0.017 ms 52013/1069701071 (0.0049%) [ 3] 0.0-419322.2 sec 1007 datagrams received out-of-order }}} wings-openflow-3.wail.wisc.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.106.100, UDP port 5106 Sending 1470 byte datagrams UDP buffer size: 110 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.106.96 port 56629 connected with 10.42.106.100 port 5106 [ ID] Interval Transfer Bandwidth [ 3] 0.0-419316.3 sec 1572435738720 bits 30.0 Mbits/sec [ 3] Sent 1069684176 datagrams [ 3] Server Report: [ 3] 0.0-419315.7 sec 1572337244310 bits 30.0 Mbits/sec 0.665 ms 67002/1069684175 (0.0063%) [ 3] 0.0-419315.7 sec 974 datagrams received out-of-order }}} plnode2.cip.gatech.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.106.54, UDP port 5106 Sending 1470 byte datagrams UDP buffer size: 122 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.106.101 port 53570 connected with 10.42.106.54 port 5106 [ 3] 0.0-419059.7 sec 1569792559650 bits 30.0 Mbits/sec [ 3] Sent 1067886095 datagrams [ 3] Server Report: [ 3] 0.0-419059.1 sec 1452686435550 bits 27.7 Mbits/sec 0.147 ms 79664030/1067886095 (7.5%) [ 3] 0.0-419059.1 sec 891 datagrams received out-of-order }}} navis.gpolab.bbn.com: {{{ ------------------------------------------------------------ Client connecting to 10.42.106.104, UDP port 5106 Sending 1470 byte datagrams UDP buffer size: 110 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.106.55 port 47163 connected with 10.42.106.104 port 5106 [ 3] 0.0-418994.1 sec 1571221703940 bits 30.0 Mbits/sec [ 3] Sent 1068858302 datagrams [ 3] Server Report: [ 3] 0.0-418993.5 sec 1571147854080 bits 30.0 Mbits/sec 0.011 ms 50238/1068858302 (0.0047%) [ 3] 0.0-418993.5 sec 786 datagrams received out-of-order }}} == Analysis == With one exception, all data seems to have been sent successfully (up to four nines, anyway). The exception: GT - Wisconsin, which had 7.5% packet loss. Could this (which also included plnode1) be related to the poor results with plnode1 in plastic-105?