[[PageOutline]] = Continuation Round 9 = In this round, the plan was to run all ten slices on all seven sites, for a week. Wisconsin suffered a major outage in the middle of the week, affecting all of the slices that they're a part of. The raw logs are at http://www.gpolab.bbn.com/plastic-slices/continuation/round-9/. = plastic-101 = [ggw:PlasticSlices/Experiments#SteadyPing SteadyPing], using interval=.005, and this table of client/server pairs: || '''client''' || '''server''' || '''server address''' || || ganel.gpolab.bbn.com || planetlab5.clemson.edu || server=10.42.101.105 || || planetlab4.clemson.edu || plnode2.cip.gatech.edu || server=10.42.101.101 || || plnode1.cip.gatech.edu || pl5.myplc.grnoc.iu.edu || server=10.42.101.73 || || pl4.myplc.grnoc.iu.edu || of-planet2.stanford.edu || server=10.42.101.91 || || of-planet1.stanford.edu || pl02.cs.washington.edu || server=10.42.101.81 || || pl01.cs.washington.edu || wings-openflow-3.wail.wisc.edu || server=10.42.101.96 || || wings-openflow-2.wail.wisc.edu || gardil.gpolab.bbn.com || server=10.42.101.52 || == Commands run on each client == {{{ echo "server=$server" sudo ping -q -i .005 -s $((1500-8-20)) $server }}} == Results == Generated from the logs with {{{ subnet=101 for host in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt | sed -r -e 's/.+@//') ; do echo -e "$host:\n\n{{{" ; grep -A 2 statistics pgenigpolabbbncom_plastic$subnet\@$host.log ; echo -e "}}}\n" ; done }}} ganel.gpolab.bbn.com: {{{ --- 10.42.101.105 ping statistics --- 60616348 packets transmitted, 60101723 received, +4555 errors, 0% packet loss, time 603873971ms rtt min/avg/max/mdev = 137.979/138.803/29421.397/74.601 ms, pipe 3868 }}} planetlab4.clemson.edu: {{{ --- 10.42.101.101 ping statistics --- 60428426 packets transmitted, 54618968 received, +4576 errors, 9% packet loss, time 604322150ms rtt min/avg/max/mdev = 5.320/56.341/24832.987/38.795 ms, pipe 2486 }}} plnode1.cip.gatech.edu: {{{ --- 10.42.101.73 ping statistics --- 63749841 packets transmitted, 63177150 received, +4782 errors, 0% packet loss, time 603992529ms rtt min/avg/max/mdev = 37.118/38.150/42375.436/75.287 ms, pipe 4211 }}} pl4.myplc.grnoc.iu.edu: {{{ --- 10.42.101.91 ping statistics --- 60563865 packets transmitted, 59943291 received, +5993 errors, 1% packet loss, time 603979365ms rtt min/avg/max/mdev = 102.673/102.975/14960.036/33.122 ms, pipe 1414 }}} of-planet1.stanford.edu: {{{ --- 10.42.101.81 ping statistics --- 59627849 packets transmitted, 58755149 received, +6237 errors, 1% packet loss, time 603972071ms rtt min/avg/max/mdev = 153.075/154.404/13256.334/43.909 ms, pipe 1356 }}} pl01.cs.washington.edu: {{{ --- 10.42.101.96 ping statistics --- 57466511 packets transmitted, 32971249 received, +257541 errors, 42% packet loss, time 603931891ms rtt min/avg/max/mdev = 59.706/61.876/10494.960/37.911 ms, pipe 1009 }}} wings-openflow-2.wail.wisc.edu: {{{ }}} == Comments == We didn't get any log data from wings-openflow-2.wail.wisc.edu, and high packet loss from pl01.cs.washington.edu to 1042.101.96 (on wings-openflow-3.wail.wisc.edu), due to the outage at Wisconsin. The 9% packet loss from planetlab4.clemson.edu to 10.42.101.101 (on plnode2.cip.gatech.edu) is unexpectedly high; we haven't investigated the cause. = plastic-102 = [ggw:PlasticSlices/Experiments#SteadyPing SteadyPing], using interval=.005, and this table of client/server pairs: || '''client''' || '''server''' || '''server address''' || || navis.gpolab.bbn.com || planetlab4.clemson.edu || server=10.42.102.104 || || planetlab5.clemson.edu || plnode1.cip.gatech.edu || server=10.42.102.100 || || plnode2.cip.gatech.edu || pl4.myplc.grnoc.iu.edu || server=10.42.102.72 || || pl5.myplc.grnoc.iu.edu || of-planet2.stanford.edu || server=10.42.102.91 || || of-planet1.stanford.edu || pl01.cs.washington.edu || server=10.42.102.80 || || pl02.cs.washington.edu || wings-openflow-2.wail.wisc.edu || server=10.42.102.95 || || wings-openflow-3.wail.wisc.edu || bain.gpolab.bbn.com || server=10.42.102.54 || == Commands run on each client == {{{ echo "server=$server" sudo ping -q -i .005 -s $((1500-8-20)) $server }}} == Results == Generated from the logs with {{{ subnet=102 for host in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt | sed -r -e 's/.+@//') ; do echo -e "$host:\n\n{{{" ; grep -A 2 statistics pgenigpolabbbncom_plastic$subnet\@$host.log ; echo -e "}}}\n" ; done }}} navis.gpolab.bbn.com: {{{ --- 10.42.102.104 ping statistics --- 60388197 packets transmitted, 59890888 received, +4716 errors, 0% packet loss, time 603564330ms rtt min/avg/max/mdev = 165.433/165.715/19394.280/32.904 ms, pipe 1793 }}} planetlab5.clemson.edu: {{{ --- 10.42.102.100 ping statistics --- 99111985 packets transmitted, 98010857 received, +4419 errors, 1% packet loss, time 603621429ms rtt min/avg/max/mdev = 4.902/6.045/4318.493/7.668 ms, pipe 687 }}} plnode2.cip.gatech.edu: {{{ --- 10.42.102.72 ping statistics --- 36404450 packets transmitted, 35859984 received, +4773 errors, 1% packet loss, time 603602380ms rtt min/avg/max/mdev = 143.039/175.294/17996.136/56.039 ms, pipe 1080 }}} pl5.myplc.grnoc.iu.edu: {{{ --- 10.42.102.91 ping statistics --- 62114299 packets transmitted, 61520938 received, +5814 errors, 0% packet loss, time 603590568ms rtt min/avg/max/mdev = 77.454/77.687/16509.553/22.526 ms, pipe 1475 }}} of-planet1.stanford.edu: {{{ --- 10.42.102.80 ping statistics --- 57598200 packets transmitted, 56930142 received, +5607 errors, 1% packet loss, time 603580960ms rtt min/avg/max/mdev = 20.442/21.395/13855.638/14.768 ms, pipe 1274 }}} pl02.cs.washington.edu: {{{ --- 10.42.102.95 ping statistics --- 56998165 packets transmitted, 31861651 received, +257001 errors, 44% packet loss, time 603573426ms rtt min/avg/max/mdev = 59.711/61.799/17626.355/39.431 ms, pipe 1535 }}} wings-openflow-3.wail.wisc.edu: {{{ }}} == Comments == We didn't get any log data from wings-openflow-3.wail.wisc.edu, and high packet loss from pl02.cs.washington.edu to 1042.101.95 (on wings-openflow-2.wail.wisc.edu), due to the outage at Wisconsin. The absence of packet loss between Clemson and GT here, compared to plastic-101, is somewhat unexpected; we haven't investigated it. = plastic-103 = [ggw:PlasticSlices/Experiments#SteadyPerfTCP SteadyPerf TCP], using port=5103, time=518400, and this table of client/server pairs: || '''client''' || '''server''' || '''server address''' || || sardis.gpolab.bbn.com || of-planet1.stanford.edu || server=10.42.103.90 || || of-planet2.stanford.edu || pl01.cs.washington.edu || server=10.42.103.80 || || pl02.cs.washington.edu || ganel.gpolab.bbn.com || server=10.42.103.51 || == One-time prep commands run on each client and server == {{{ sudo yum -y install iperf }}} == Commands run on each server == {{{ echo "server=$server" nice -n 19 iperf -B $server -p 5103 -s -i 1 }}} == Commands run on each client == {{{ echo "server=$server" nice -n 19 iperf -c $server -p 5103 -t 518400 }}} == Results == Generated with {{{ subnet=103 for host in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt | sed -r -e 's/.+@//') ; do echo -e "$host:\n\n{{{" ; grep -a -A 5 -B 1 "Client connecting" pgenigpolabbbncom_plastic$subnet\@$host.log ; echo -e "}}}\n" ; done }}} and then edited slightly to remove artifacts (like control characters, my prompt, etc). sardis.gpolab.bbn.com: {{{ ------------------------------------------------------------ Client connecting to 10.42.103.90, TCP port 5103 TCP window size: 16.0 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.103.53 port 60939 connected with 10.42.103.90 port 5103 write2 failed: No route to host [ 3] 0.0-359374.0 sec 104 GBytes 2.48 Mbits/sec -- ------------------------------------------------------------ Client connecting to 10.42.103.90, TCP port 5103 TCP window size: 16.0 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.103.53 port 48795 connected with 10.42.103.90 port 5103 write2 failed: No route to host [ 3] 0.0-62326.2 sec 17.6 GBytes 2.43 Mbits/sec }}} of-planet2.stanford.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.103.80, TCP port 5103 TCP window size: 16.0 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.103.91 port 36826 connected with 10.42.103.80 port 5103 [ ID] Interval Transfer Bandwidth [ 3] 0.0-423883.1 sec 17561894255500267520 bits 0.00 (null)s/sec -- ------------------------------------------------------------ Client connecting to 10.42.103.80, TCP port 5103 TCP window size: 16.0 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.103.91 port 34411 connected with 10.42.103.80 port 5103 [ ID] Interval Transfer Bandwidth [ 3] 0.0-179565.0 sec 13485676214369468416 bits 0.00 (null)s/sec }}} pl02.cs.washington.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.103.51, TCP port 5103 TCP window size: 16.0 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.103.81 port 46683 connected with 10.42.103.51 port 5103 write2 failed: No route to host [ 3] 0.0-486223.7 sec 127 GBytes 2.23 Mbits/sec }}} == Comments == We've seen the "0.00 (null)s/sec" business from iperf TCP summaries before; traffic is clearly flowing, so we're not sure what causes that. None of these ran to completion, due to temporary network failures (the "no route to host" errors). It'd be nice to have a more resilient TCP traffic generator. = plastic-104 = [ggw:PlasticSlices/Experiments#SteadyPerfUDP SteadyPerf UDP], using port=5104, time=518400, rate=11, and this table of client/server pairs: || '''client''' || '''server''' || '''server address''' || || ganel.gpolab.bbn.com || wings-openflow-2.wail.wisc.edu || server=10.42.104.95 || || pl5.myplc.grnoc.iu.edu || sardis.gpolab.bbn.com || server=10.42.104.53 || == One-time prep commands run on each client and server == {{{ sudo yum -y install iperf }}} == Commands run on each server == {{{ echo "server=$server" nice -n 19 iperf -u -B $server -p 5104 -s -i 1 }}} == Commands run on each client == {{{ echo "server=$server" nice -n 19 iperf -u -c $server -p 5104 -t 518400 -b 11M }}} == Results == Generated with {{{ subnet=104 for host in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt | sed -r -e 's/.+@//') ; do echo -e "$host:\n\n{{{" ; grep -A 10 -B 1 "Client connecting" pgenigpolabbbncom_plastic$subnet\@$host.log ; echo -e "}}}\n" ; done }}} and then edited slightly to remove artifacts (like control characters, my prompt, etc). ganel.gpolab.bbn.com: {{{ ------------------------------------------------------------ Client connecting to 10.42.104.95, UDP port 5104 Sending 1470 byte datagrams UDP buffer size: 110 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.104.51 port 41464 connected with 10.42.104.95 port 5104 [ 3] 0.0-518400.0 sec 664 GBytes 11.0 Mbits/sec [ 3] Sent 484931597 datagrams [ 3] WARNING: did not receive ack of last datagram after 10 tries. }}} pl5.myplc.grnoc.iu.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.104.53, UDP port 5104 Sending 1470 byte datagrams UDP buffer size: 110 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.104.73 port 54328 connected with 10.42.104.53 port 5104 [ 3] 0.0-518400.0 sec 664 GBytes 11.0 Mbits/sec [ 3] Sent 484932280 datagrams [ 3] Server Report: [ 3] 0.0-518390.2 sec 657 GBytes 10.9 Mbits/sec 0.017 ms 5368914/484932279 (1.1%) [ 3] 0.0-518390.2 sec 16126 datagrams received out-of-order }}} == Comments == We didn't get back a server report from ganel.gpolab.bbn.com, due to the outage at Wisconsin. (It was connecting to 10.42.104.95.) We haven't analyzed whether the packet loss from Indiana to BBN was consistent throughout the run, or due to a single outage, or what. = plastic-105 = [ggw:PlasticSlices/Experiments#SteadyPerfUDP SteadyPerf UDP], using port=5105, time=518400, rate=6, and this table of client/server pairs: || '''client''' || '''server''' || '''server address''' || || wings-openflow-2.wail.wisc.edu || planetlab5.clemson.edu || server=10.42.105.105 || || planetlab4.clemson.edu || navis.gpolab.bbn.com || server=10.42.105.55 || || bain.gpolab.bbn.com || plnode2.cip.gatech.edu || server=10.42.105.101 || || plnode1.cip.gatech.edu || wings-openflow-3.wail.wisc.edu || server=10.42.105.96 || == One-time prep commands run on each client and server == {{{ sudo yum -y install iperf }}} == Commands run on each server == {{{ echo "server=$server" nice -n 19 iperf -u -B $server -p 5105 -s -i 1 }}} == Commands run on each client == {{{ echo "server=$server" nice -n 19 iperf -u -c $server -p 5105 -t 518400 -b 6M }}} == Results == Generated with {{{ subnet=105 for host in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt | sed -r -e 's/.+@//') ; do echo -e "$host:\n\n{{{" ; grep -A 10 -B 1 "Client connecting" pgenigpolabbbncom_plastic$subnet\@$host.log ; echo -e "}}}\n" ; done }}} and then edited slightly to remove artifacts (like control characters, my prompt, etc). wings-openflow-2.wail.wisc.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.105.105, UDP port 5105 Sending 1470 byte datagrams UDP buffer size: 110 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.105.95 port 60158 connected with 10.42.105.105 port 5105 }}} planetlab4.clemson.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.105.55, UDP port 5105 Sending 1470 byte datagrams UDP buffer size: 110 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.105.104 port 41408 connected with 10.42.105.55 port 5105 [ ID] Interval Transfer Bandwidth [ 3] 0.0-518400.0 sec 362 GBytes 6.00 Mbits/sec [ 3] Sent 264489797 datagrams [ 3] Server Report: [ 3] 0.0-518394.5 sec 358 GBytes 5.94 Mbits/sec 0.010 ms 2818608/264489796 (1.1%) [ 3] 0.0-518394.5 sec 8277 datagrams received out-of-order }}} bain.gpolab.bbn.com: {{{ ------------------------------------------------------------ Client connecting to 10.42.105.101, UDP port 5105 Sending 1470 byte datagrams UDP buffer size: 110 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.105.54 port 37129 connected with 10.42.105.101 port 5105 [ 3] 0.0-518400.0 sec 362 GBytes 6.00 Mbits/sec [ 3] Sent 264487534 datagrams [ 3] Server Report: [ 3] 0.0-518396.4 sec 357 GBytes 5.92 Mbits/sec 3.197 ms 3455085/264487534 (1.3%) [ 3] 0.0-518396.4 sec 7492 datagrams received out-of-order }}} plnode1.cip.gatech.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.105.96, UDP port 5105 Sending 1470 byte datagrams UDP buffer size: 122 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.105.100 port 47829 connected with 10.42.105.96 port 5105 [ 3] 0.0-518400.0 sec 362 GBytes 6.00 Mbits/sec [ 3] Sent 264473352 datagrams [ 3] WARNING: did not receive ack of last datagram after 10 tries. }}} == Comments == We didn't get any log data from wings-openflow-2.wail.wisc.edu, due to the outage at Wisconsin. We didn't get back a server report from plnode1.cip.gatech.edu, due to the outage at Wisconsin. (It was connecting to 10.42.104.96.) We haven't analyzed whether the packet loss in the others was consistent throughout the run, or due to a single outage, or what. = plastic-106 = [ggw:PlasticSlices/Experiments#SteadyPerfTCP SteadyPerf TCP], using port=5106, time=518400, and this table of client/server pairs: || '''client''' || '''server''' || '''server address''' || || planetlab5.clemson.edu || wings-openflow-2.wail.wisc.edu || server=10.42.106.95 || || wings-openflow-3.wail.wisc.edu || plnode1.cip.gatech.edu || server=10.42.106.100 || || plnode2.cip.gatech.edu || bain.gpolab.bbn.com || server=10.42.106.54 || || navis.gpolab.bbn.com || planetlab4.clemson.edu || server=10.42.106.104 || == One-time prep commands run on each client and server == {{{ sudo yum -y install iperf }}} == Commands run on each server == {{{ echo "server=$server" nice -n 19 iperf -B $server -p 5106 -s -i 1 }}} == Commands run on each client == {{{ echo "server=$server" nice -n 19 iperf -c $server -p 5106 -t 518400 }}} == Results == Generated with {{{ subnet=106 for host in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt | sed -r -e 's/.+@//') ; do echo -e "$host:\n\n{{{" ; grep -A 5 -B 1 "Client connecting" pgenigpolabbbncom_plastic$subnet\@$host.log ; echo -e "}}}\n" ; done }}} and then edited slightly to remove artifacts (like control characters, my prompt, etc). planetlab5.clemson.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.106.95, TCP port 5106 TCP window size: 16.0 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.106.105 port 55591 connected with 10.42.106.95 port 5106 [ ID] Interval Transfer Bandwidth [ 3] 0.0-518400.0 sec 14017702187097243648 bits 0.00 (null)s/sec }}} wings-openflow-3.wail.wisc.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.106.100, TCP port 5106 TCP window size: 16.0 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.106.96 port 32950 connected with 10.42.106.100 port 5106 }}} plnode2.cip.gatech.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.106.54, TCP port 5106 TCP window size: 16.0 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.106.101 port 46041 connected with 10.42.106.54 port 5106 write2 failed: No route to host [ 3] 0.0-486087.3 sec 16.7 GBytes 296 Kbits/sec }}} navis.gpolab.bbn.com: {{{ ------------------------------------------------------------ Client connecting to 10.42.106.104, TCP port 5106 TCP window size: 16.0 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.106.55 port 60960 connected with 10.42.106.104 port 5106 write2 failed: No route to host [ 3] 0.0-486070.0 sec 171 GBytes 3.02 Mbits/sec }}} == Comments == We've seen the "0.00 (null)s/sec" business from iperf TCP summaries before; traffic is clearly flowing, so we're not sure what causes that. We didn't get any log data from wings-openflow-3.wail.wisc.edu, due to the outage at Wisconsin. Neither of the others ran to completion, due to temporary network failures (the "no route to host" errors). It'd be nice to have a more resilient TCP traffic generator. = plastic-107 = [ggw:PlasticSlices/Experiments#SteadyPerfTCP SteadyPerf TCP], using port=5107, time=518400, and this table of client/server pairs: || '''client''' || '''server''' || '''server address''' || || planetlab5.clemson.edu || pl4.myplc.grnoc.iu.edu || server=10.42.107.72 || || pl5.myplc.grnoc.iu.edu || plnode2.cip.gatech.edu || server=10.42.107.101 || || plnode1.cip.gatech.edu || pl02.cs.washington.edu || server=10.42.107.81 || || pl01.cs.washington.edu || planetlab4.clemson.edu || server=10.42.107.104 || == One-time prep commands run on each client and server == {{{ sudo yum -y install iperf }}} == Commands run on each server == {{{ echo "server=$server" nice -n 19 iperf -B $server -p 5107 -s -i 1 }}} == Commands run on each client == {{{ echo "server=$server" nice -n 19 iperf -c $server -p 5107 -t 518400 }}} == Results == Generated with {{{ subnet=107 for host in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt | sed -r -e 's/.+@//') ; do echo -e "$host:\n\n{{{" ; grep -A 5 -B 1 "Client connecting" pgenigpolabbbncom_plastic$subnet\@$host.log ; echo -e "}}}\n" ; done }}} and then edited slightly to remove artifacts (like control characters, my prompt, etc). planetlab5.clemson.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.107.72, TCP port 5107 TCP window size: 16.0 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.107.105 port 50196 connected with 10.42.107.72 port 5107 [ ID] Interval Transfer Bandwidth [ 3] 0.0-518400.0 sec 9618427753724442624 bits 0.00 (null)s/sec }}} pl5.myplc.grnoc.iu.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.107.101, TCP port 5107 TCP window size: 16.0 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.107.73 port 38928 connected with 10.42.107.101 port 5107 write2 failed: No route to host [ 3] 0.0-486026.4 sec 143 GBytes 2.53 Mbits/sec }}} plnode1.cip.gatech.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.107.81, TCP port 5107 TCP window size: 16.0 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.107.100 port 55218 connected with 10.42.107.81 port 5107 write2 failed: No route to host [ 3] 0.0-486028.4 sec 255 GBytes 4.51 Mbits/sec }}} pl01.cs.washington.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.107.104, TCP port 5107 TCP window size: 16.0 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.107.80 port 57380 connected with 10.42.107.104 port 5107 write2 failed: No route to host [ 3] 0.0-486023.2 sec 279 GBytes 4.92 Mbits/sec }}} == Comments == We've seen the "0.00 (null)s/sec" business from iperf TCP summaries before; traffic is clearly flowing, so we're not sure what causes that. None of the others ran to completion, due to temporary network failures (the "no route to host" errors). It'd be nice to have a more resilient TCP traffic generator. = plastic-108 = [ggw:PlasticSlices/Experiments#SteadyPerfUDP SteadyPerf UDP], using port=5108, time=518400, rate=8, and this table of client/server pairs: || '''client''' || '''server''' || '''server address''' || || wings-openflow-3.wail.wisc.edu || of-planet2.stanford.edu || server=10.42.108.91 || || of-planet1.stanford.edu || pl5.myplc.grnoc.iu.edu || server=10.42.108.73 || || pl4.myplc.grnoc.iu.edu || wings-openflow-2.wail.wisc.edu || server=10.42.108.95 || == One-time prep commands run on each client and server == {{{ sudo yum -y install iperf }}} == Commands run on each server == {{{ echo "server=$server" nice -n 19 iperf -u -B $server -p 5108 -s -i 1 }}} == Commands run on each client == {{{ echo "server=$server" nice -n 19 iperf -u -c $server -p 5108 -t 518400 -b 8M }}} == Results == Generated with {{{ subnet=108 for host in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt | sed -r -e 's/.+@//') ; do echo -e "$host:\n\n{{{" ; grep -A 10 -B 1 "Client connecting" pgenigpolabbbncom_plastic$subnet\@$host.log ; echo -e "}}}\n" ; done }}} and then edited slightly to remove artifacts (like control characters, my prompt, etc). wings-openflow-3.wail.wisc.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.108.91, UDP port 5108 Sending 1470 byte datagrams UDP buffer size: 110 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.108.96 port 46435 connected with 10.42.108.91 port 5108 }}} of-planet1.stanford.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.108.73, UDP port 5108 Sending 1470 byte datagrams UDP buffer size: 110 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.108.90 port 60229 connected with 10.42.108.73 port 5108 [ ID] Interval Transfer Bandwidth [ 3] 0.0-518400.0 sec 483 GBytes 8.00 Mbits/sec [ 3] Sent 352626691 datagrams [ 3] Server Report: [ 3] 0.0-518393.7 sec 476 GBytes 7.88 Mbits/sec 0.027 ms 5105757/352626690 (1.4%) [ 3] 0.0-518393.7 sec 16667 datagrams received out-of-order }}} pl4.myplc.grnoc.iu.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.108.95, UDP port 5108 Sending 1470 byte datagrams UDP buffer size: 110 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.108.72 port 46159 connected with 10.42.108.95 port 5108 [ 3] 0.0-518400.0 sec 483 GBytes 8.00 Mbits/sec [ 3] Sent 352649481 datagrams [ 3] WARNING: did not receive ack of last datagram after 10 tries. }}} == Comments == We didn't get any log data from wings-openflow-3.wail.wisc.edu, due to the outage at Wisconsin. We didn't get back a server report from pl4.myplc.grnoc.iu.edu, due to the outage at Wisconsin. (It was connecting to 10.42.108.95.) We haven't analyzed whether the packet loss in the other was consistent throughout the run, or due to a single outage, or what. = plastic-109 = [ggw:PlasticSlices/Experiments#SteadyPerfUDP SteadyPerf UDP], using port=5109, time=518400, rate=4, and this table of client/server pairs: || '''client''' || '''server''' || '''server address''' || || gardil.gpolab.bbn.com || pl5.myplc.grnoc.iu.edu || server=10.42.109.73 || || pl4.myplc.grnoc.iu.edu || pl02.cs.washington.edu || server=10.42.109.81 || || pl01.cs.washington.edu || planetlab5.clemson.edu || server=10.42.109.105 || || planetlab4.clemson.edu || of-planet1.stanford.edu || server=10.42.109.90 || || of-planet2.stanford.edu || wings-openflow-3.wail.wisc.edu || server=10.42.109.96 || || wings-openflow-2.wail.wisc.edu || ganel.gpolab.bbn.com || server=10.42.109.51 || == One-time prep commands run on each client and server == {{{ sudo yum -y install iperf }}} == Commands run on each server == {{{ echo "server=$server" nice -n 19 iperf -u -B $server -p 5109 -s -i 1 }}} == Commands run on each client == {{{ echo "server=$server" nice -n 19 iperf -u -c $server -p 5109 -t 518400 -b 4M }}} == Results == Generated with {{{ subnet=109 for host in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt | sed -r -e 's/.+@//') ; do echo -e "$host:\n\n{{{" ; grep -A 10 -B 1 "Client connecting" pgenigpolabbbncom_plastic$subnet\@$host.log ; echo -e "}}}\n" ; done }}} and then edited slightly to remove artifacts (like control characters, my prompt, etc). gardil.gpolab.bbn.com: {{{ ------------------------------------------------------------ Client connecting to 10.42.109.73, UDP port 5109 Sending 1470 byte datagrams UDP buffer size: 110 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.109.52 port 34116 connected with 10.42.109.73 port 5109 [ 3] 0.0-518400.0 sec 241 GBytes 4.00 Mbits/sec [ 3] Sent 176326532 datagrams [ 3] Server Report: [ 3] 0.0-518397.1 sec 239 GBytes 3.96 Mbits/sec 0.005 ms 1921335/176326532 (1.1%) [ 3] 0.0-518397.1 sec 8568 datagrams received out-of-order }}} pl4.myplc.grnoc.iu.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.109.81, UDP port 5109 Sending 1470 byte datagrams UDP buffer size: 110 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.109.72 port 42414 connected with 10.42.109.81 port 5109 [ 3] 0.0-518400.0 sec 241 GBytes 4.00 Mbits/sec [ 3] Sent 176326102 datagrams [ 3] Server Report: [ 3] 0.0-518397.2 sec 239 GBytes 3.96 Mbits/sec 0.891 ms 1925666/176326102 (1.1%) [ 3] 0.0-518397.2 sec 79755 datagrams received out-of-order }}} pl01.cs.washington.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.109.105, UDP port 5109 Sending 1470 byte datagrams UDP buffer size: 110 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.109.80 port 57597 connected with 10.42.109.105 port 5109 [ 3] 0.0-518400.0 sec 241 GBytes 4.00 Mbits/sec [ 3] Sent 176247368 datagrams [ 3] Server Report: [ 3] 0.0-518395.7 sec 238 GBytes 3.95 Mbits/sec 0.100 ms 2084033/176247368 (1.2%) [ 3] 0.0-518395.7 sec 24113 datagrams received out-of-order }}} planetlab4.clemson.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.109.90, UDP port 5109 Sending 1470 byte datagrams UDP buffer size: 110 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.109.104 port 38981 connected with 10.42.109.90 port 5109 [ ID] Interval Transfer Bandwidth [ 3] 0.0-518400.0 sec 241 GBytes 4.00 Mbits/sec [ 3] Sent 176326532 datagrams [ 3] Server Report: [ 3] 0.0-518397.4 sec 238 GBytes 3.94 Mbits/sec 0.019 ms 2472993/176326531 (1.4%) [ 3] 0.0-518397.4 sec 10171 datagrams received out-of-order }}} of-planet2.stanford.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.109.96, UDP port 5109 Sending 1470 byte datagrams UDP buffer size: 110 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.109.91 port 43669 connected with 10.42.109.96 port 5109 [ ID] Interval Transfer Bandwidth [ 3] 0.0-518400.0 sec 241 GBytes 4.00 Mbits/sec [ 3] Sent 176324610 datagrams [ 3] WARNING: did not receive ack of last datagram after 10 tries. }}} wings-openflow-2.wail.wisc.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.109.51, UDP port 5109 Sending 1470 byte datagrams UDP buffer size: 110 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.109.95 port 59778 connected with 10.42.109.51 port 5109 }}} == Comments == We didn't get back a server report from of-planet2.stanford.edu, due to the outage at Wisconsin. (It was connecting to 10.42.109.96.) We didn't get any log data from wings-openflow-2.wail.wisc.edu, due to the outage at Wisconsin. We haven't analyzed whether the packet loss in the others was consistent throughout the run, or due to a single outage, or what. = plastic-110 = [ggw:PlasticSlices/Experiments#SteadyPerfTCP SteadyPerf TCP], using port=5110, time=518400, and this table of client/server pairs: || '''client''' || '''server''' || '''server address''' || || bain.gpolab.bbn.com || pl01.cs.washington.edu || server=10.42.110.80 || || pl02.cs.washington.edu || of-planet1.stanford.edu || server=10.42.110.90 || || of-planet2.stanford.edu || pl4.myplc.grnoc.iu.edu || server=10.42.110.72 || || pl5.myplc.grnoc.iu.edu || plnode1.cip.gatech.edu || server=10.42.110.100 || || plnode2.cip.gatech.edu || navis.gpolab.bbn.com || server=10.42.110.55 || == One-time prep commands run on each client and server == {{{ sudo yum -y install iperf }}} == Commands run on each server == {{{ echo "server=$server" nice -n 19 iperf -B $server -p 5110 -s -i 1 }}} == Commands run on each client == {{{ echo "server=$server" nice -n 19 iperf -c $server -p 5110 -t 518400 }}} == Results == Generated with {{{ subnet=110 for host in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt | sed -r -e 's/.+@//') ; do echo -e "$host:\n\n{{{" ; grep -A 5 -B 1 "Client connecting" pgenigpolabbbncom_plastic$subnet\@$host.log ; echo -e "}}}\n" ; done }}} and then edited slightly to remove artifacts (like control characters, my prompt, etc). bain.gpolab.bbn.com: {{{ ------------------------------------------------------------ Client connecting to 10.42.110.80, TCP port 5110 TCP window size: 16.0 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.110.54 port 59225 connected with 10.42.110.80 port 5110 write2 failed: No route to host [ 3] 0.0-485821.8 sec 346 GBytes 6.12 Mbits/sec }}} pl02.cs.washington.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.110.90, TCP port 5110 TCP window size: 16.0 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.110.81 port 46991 connected with 10.42.110.90 port 5110 write2 failed: No route to host [ 3] 0.0-359034.3 sec 937 GBytes 22.4 Mbits/sec -- ------------------------------------------------------------ Client connecting to 10.42.110.90, TCP port 5110 TCP window size: 16.0 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.110.81 port 55111 connected with 10.42.110.90 port 5110 write2 failed: No route to host [ 3] 0.0-63692.8 sec 170 GBytes 22.9 Mbits/sec }}} of-planet2.stanford.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.110.72, TCP port 5110 TCP window size: 16.0 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.110.91 port 59670 connected with 10.42.110.72 port 5110 [ ID] Interval Transfer Bandwidth [ 3] 0.0-422191.7 sec 17205709671801458688 bits 0.00 (null)s/sec -- ------------------------------------------------------------ Client connecting to 10.42.110.72, TCP port 5110 TCP window size: 16.0 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.110.91 port 57556 connected with 10.42.110.72 port 5110 [ ID] Interval Transfer Bandwidth [ 3] 0.0-179228.7 sec 13026921957609984000 bits 0.00 (null)s/sec }}} pl5.myplc.grnoc.iu.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.110.100, TCP port 5110 TCP window size: 16.0 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.110.73 port 34143 connected with 10.42.110.100 port 5110 write2 failed: No route to host [ 3] 0.0-134175.6 sec 45.2 GBytes 2.89 Mbits/sec -- ------------------------------------------------------------ Client connecting to 10.42.110.100, TCP port 5110 TCP window size: 16.0 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.110.73 port 55400 connected with 10.42.110.100 port 5110 write2 failed: No route to host [ 3] 0.0-240750.2 sec 83.3 GBytes 2.97 Mbits/sec }}} plnode2.cip.gatech.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.110.55, TCP port 5110 TCP window size: 16.0 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.110.101 port 52109 connected with 10.42.110.55 port 5110 write2 failed: No route to host [ 3] 0.0-134135.9 sec 8.72 GBytes 559 Kbits/sec -- ------------------------------------------------------------ Client connecting to 10.42.110.55, TCP port 5110 TCP window size: 16.0 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.110.101 port 35891 connected with 10.42.110.55 port 5110 write2 failed: No route to host [ 3] 0.0-240675.2 sec 14.1 GBytes 503 Kbits/sec }}} == Comments == We've seen the "0.00 (null)s/sec" business from iperf TCP summaries before; traffic is clearly flowing, so we're not sure what causes that. None of the others ran to completion, due to temporary network failures (the "no route to host" errors). It'd be nice to have a more resilient TCP traffic generator.