[[PageOutline]] = Continuation Round 8 = In this round, the plan was to run all ten slices on all seven sites (down from eight, because MyPLC at Rutgers is no longer available), for a week. However, MyPLC and Stanford and Washington also went down, and the slivers there were destroyed after four days. We ended the round at that point, and summarized the results for the hostpairs that don't include Stanford or Washington. The raw logs are at http://www.gpolab.bbn.com/plastic-slices/continuation/round-8/. = plastic-101 = [ggw:PlasticSlices/Experiments#SteadyPing SteadyPing], using interval=.005, and this table of client/server pairs: || '''client''' || '''server''' || '''server address''' || || ganel.gpolab.bbn.com || planetlab5.clemson.edu || server=10.42.101.105 || || planetlab4.clemson.edu || plnode2.cip.gatech.edu || server=10.42.101.101 || || plnode1.cip.gatech.edu || pl5.myplc.grnoc.iu.edu || server=10.42.101.73 || || pl4.myplc.grnoc.iu.edu || of-planet2.stanford.edu || server=10.42.101.91 || || of-planet1.stanford.edu || pl02.cs.washington.edu || server=10.42.101.81 || || pl01.cs.washington.edu || wings-openflow-3.wail.wisc.edu || server=10.42.101.96 || || wings-openflow-2.wail.wisc.edu || gardil.gpolab.bbn.com || server=10.42.101.52 || == Commands run on each client == {{{ server= sudo ping -i .005 -s $((1500-8-20)) $server }}} == Results == Generated from the logs with {{{ subnet=101 for host in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt | sed -r -e 's/.+@//') ; do echo -e "$host:\n\n{{{" ; grep -A 2 statistics pgenigpolabbbncom_plastic$subnet\@$host.log ; echo -e "}}}\n" ; done }}} ganel.gpolab.bbn.com: {{{ }}} planetlab4.clemson.edu: {{{ }}} plnode1.cip.gatech.edu: {{{ --- 10.42.101.73 ping statistics --- 45637004 packets transmitted, 45611948 received, 0% packet loss, time 433704732ms rtt min/avg/max/mdev = 37.113/37.959/10464.370/22.181 ms, pipe 1115 }}} pl4.myplc.grnoc.iu.edu: {{{ }}} of-planet1.stanford.edu: {{{ }}} pl01.cs.washington.edu: {{{ }}} wings-openflow-2.wail.wisc.edu: {{{ }}} == Comments == The logs for most of the hostpairs were truncated, presumably because they were still being written to disk when the sliver was shut down. Handling the ping logs in this way is proving problematic, and will need to be revisited. = plastic-102 = [ggw:PlasticSlices/Experiments#SteadyPing SteadyPing], using interval=.005, and this table of client/server pairs: || '''client''' || '''server''' || '''server address''' || || navis.gpolab.bbn.com || planetlab4.clemson.edu || server=10.42.102.104 || || planetlab5.clemson.edu || plnode1.cip.gatech.edu || server=10.42.102.100 || || plnode2.cip.gatech.edu || pl4.myplc.grnoc.iu.edu || server=10.42.102.72 || || pl5.myplc.grnoc.iu.edu || of-planet2.stanford.edu || server=10.42.102.91 || || of-planet1.stanford.edu || pl01.cs.washington.edu || server=10.42.102.80 || || pl02.cs.washington.edu || wings-openflow-2.wail.wisc.edu || server=10.42.102.95 || || wings-openflow-3.wail.wisc.edu || bain.gpolab.bbn.com || server=10.42.102.54 || == Commands run on each client == {{{ server= sudo ping -i .005 -s $((1500-8-20)) $server }}} == Results == Generated from the logs with {{{ subnet=102 for host in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt | sed -r -e 's/.+@//') ; do echo -e "$host:\n\n{{{" ; grep -A 2 statistics pgenigpolabbbncom_plastic$subnet\@$host.log ; echo -e "}}}\n" ; done }}} navis.gpolab.bbn.com: {{{ }}} planetlab5.clemson.edu: {{{ }}} plnode2.cip.gatech.edu: {{{ --- 10.42.102.72 ping statistics --- 26026129 packets transmitted, 25994426 received, +15 errors, 0% packet loss, time 433756822ms rtt min/avg/max/mdev = 143.012/174.997/7253.623/32.581 ms, pipe 434 }}} pl5.myplc.grnoc.iu.edu: {{{ }}} of-planet1.stanford.edu: {{{ }}} pl02.cs.washington.edu: {{{ }}} wings-openflow-3.wail.wisc.edu: {{{ }}} == Comments == The logs for most of the hostpairs were truncated, presumably because they were still being written to disk when the sliver was shut down. Handling the ping logs in this way is proving problematic, and will need to be revisited. = plastic-103 = [ggw:PlasticSlices/Experiments#SteadyPerfTCP SteadyPerf TCP], using port=5103, time=518400, and this table of client/server pairs: || '''client''' || '''server''' || '''server address''' || || sardis.gpolab.bbn.com || of-planet1.stanford.edu || server=10.42.103.90 || || of-planet2.stanford.edu || pl01.cs.washington.edu || server=10.42.103.80 || || pl02.cs.washington.edu || ganel.gpolab.bbn.com || server=10.42.103.51 || == One-time prep commands run on each client and server == {{{ sudo yum -y install iperf }}} == Commands run on each server == {{{ server= nice -n 19 iperf -B $server -p 5103 -s -i 1 }}} == Commands run on each client == {{{ server= nice -n 19 iperf -c $server -p 5103 -t 518400 }}} == Results == Generated with {{{ subnet=103 for host in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt | sed -r -e 's/.+@//') ; do echo -e "$host:\n\n{{{" ; grep -a -A 5 -B 1 "Client connecting" pgenigpolabbbncom_plastic$subnet\@$host.log ; echo -e "}}}\n" ; done }}} and then edited slightly to remove artifacts (like control characters, my prompt, etc). sardis.gpolab.bbn.com: {{{ ------------------------------------------------------------ Client connecting to 10.42.103.90, TCP port 5103 TCP window size: 16.0 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.103.53 port 33248 connected with 10.42.103.90 port 5103 [ 3] 0.0-301551.2 sec 83.7 GBytes 2.38 Mbits/sec }}} of-planet2.stanford.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.103.80, TCP port 5103 TCP window size: 16.0 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.103.91 port 54003 connected with 10.42.103.80 port 5103 }}} pl02.cs.washington.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.103.51, TCP port 5103 TCP window size: 16.0 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.103.81 port 39353 connected with 10.42.103.51 port 5103 [ 3] 0.0-301576.8 sec 78.3 GBytes 2.23 Mbits/sec }}} == Comments == Since of-planet2.stanford.edu was connected to pl01.cs.washington.edu, the server log at Washington also doesn't have a summary of stats, although one could in theory be generated from the raw log. = plastic-104 = [ggw:PlasticSlices/Experiments#SteadyPerfUDP SteadyPerf UDP], using port=5104, time=518400, rate=11, and this table of client/server pairs: || '''client''' || '''server''' || '''server address''' || || ganel.gpolab.bbn.com || wings-openflow-2.wail.wisc.edu || server=10.42.104.95 || || pl5.myplc.grnoc.iu.edu || sardis.gpolab.bbn.com || server=10.42.104.53 || == One-time prep commands run on each client and server == {{{ sudo yum -y install iperf }}} == Commands run on each server == {{{ server= nice -n 19 iperf -u -B $server -p 5104 -s -i 1 }}} == Commands run on each client == {{{ server= nice -n 19 iperf -u -c $server -p 5104 -t 518400 -b 11M }}} == Results == Generated with {{{ subnet=104 for host in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt | sed -r -e 's/.+@//') ; do echo -e "$host:\n\n{{{" ; grep -A 10 -B 1 "Client connecting" pgenigpolabbbncom_plastic$subnet\@$host.log ; echo -e "}}}\n" ; done }}} and then edited slightly to remove artifacts (like control characters, my prompt, etc). ganel.gpolab.bbn.com: {{{ ------------------------------------------------------------ Client connecting to 10.42.104.95, UDP port 5104 Sending 1470 byte datagrams UDP buffer size: 110 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.104.51 port 49122 connected with 10.42.104.95 port 5104 [ 3] 0.0-433744.2 sec 555 GBytes 11.0 Mbits/sec [ 3] Sent 405738814 datagrams [ 3] Server Report: [ 3] 0.0-433738.2 sec 551 GBytes 10.9 Mbits/sec 0.063 ms 3519647/405738814 (0.87%) [ 3] 0.0-433738.2 sec 18324 datagrams received out-of-order }}} pl5.myplc.grnoc.iu.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.104.53, UDP port 5104 Sending 1470 byte datagrams UDP buffer size: 110 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.104.73 port 59644 connected with 10.42.104.53 port 5104 [ 3] 0.0-433756.3 sec 555 GBytes 11.0 Mbits/sec [ 3] Sent 405753021 datagrams [ 3] Server Report: [ 3] 0.0-433752.7 sec 551 GBytes 10.9 Mbits/sec 0.046 ms 3525373/405753021 (0.87%) [ 3] 0.0-433752.7 sec 22602 datagrams received out-of-order }}} == Comments == There was a blip at Clemson during the run, which might account for the nearly 1% packet loss. (Which isn't a *lot*, but is a little higher than expected.) = plastic-105 = [ggw:PlasticSlices/Experiments#SteadyPerfUDP SteadyPerf UDP], using port=5105, time=518400, rate=6, and this table of client/server pairs: || '''client''' || '''server''' || '''server address''' || || wings-openflow-2.wail.wisc.edu || planetlab5.clemson.edu || server=10.42.105.105 || || planetlab4.clemson.edu || navis.gpolab.bbn.com || server=10.42.105.55 || || bain.gpolab.bbn.com || plnode2.cip.gatech.edu || server=10.42.105.101 || || plnode1.cip.gatech.edu || wings-openflow-3.wail.wisc.edu || server=10.42.105.96 || == One-time prep commands run on each client and server == {{{ sudo yum -y install iperf }}} == Commands run on each server == {{{ server= nice -n 19 iperf -u -B $server -p 5105 -s -i 1 }}} == Commands run on each client == {{{ server= nice -n 19 iperf -u -c $server -p 5105 -t 518400 -b 6M }}} == Results == Generated with {{{ subnet=105 for host in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt | sed -r -e 's/.+@//') ; do echo -e "$host:\n\n{{{" ; grep -A 10 -B 1 "Client connecting" pgenigpolabbbncom_plastic$subnet\@$host.log ; echo -e "}}}\n" ; done }}} and then edited slightly to remove artifacts (like control characters, my prompt, etc). wings-openflow-2.wail.wisc.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.105.105, UDP port 5105 Sending 1470 byte datagrams UDP buffer size: 110 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.105.95 port 57076 connected with 10.42.105.105 port 5105 [ ID] Interval Transfer Bandwidth [ 3] 0.0-433697.3 sec 303 GBytes 6.00 Mbits/sec [ 3] Sent 221274146 datagrams [ 3] Server Report: [ 3] 0.0-433695.4 sec 300 GBytes 5.95 Mbits/sec 0.059 ms 2017562/221274145 (0.91%) [ 3] 0.0-433695.4 sec 4284 datagrams received out-of-order }}} planetlab4.clemson.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.105.55, UDP port 5105 Sending 1470 byte datagrams UDP buffer size: 110 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.105.104 port 60671 connected with 10.42.105.55 port 5105 [ ID] Interval Transfer Bandwidth [ 3] 0.0-433717.2 sec 303 GBytes 6.00 Mbits/sec [ 3] Sent 221284274 datagrams [ 3] Server Report: [ 3] 0.0-433710.2 sec 300 GBytes 5.95 Mbits/sec 0.012 ms 2013248/221284273 (0.91%) [ 3] 0.0-433710.2 sec 4842 datagrams received out-of-order }}} bain.gpolab.bbn.com: {{{ ------------------------------------------------------------ Client connecting to 10.42.105.101, UDP port 5105 Sending 1470 byte datagrams UDP buffer size: 110 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.105.54 port 44291 connected with 10.42.105.101 port 5105 [ 3] 0.0-433725.6 sec 303 GBytes 6.00 Mbits/sec [ 3] Sent 221286908 datagrams [ 3] Server Report: [ 3] 0.0-433719.1 sec 303 GBytes 6.00 Mbits/sec 2.297 ms 179780/221286908 (0.081%) [ 3] 0.0-433719.1 sec 3779 datagrams received out-of-order }}} plnode1.cip.gatech.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.105.96, UDP port 5105 Sending 1470 byte datagrams UDP buffer size: 122 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.105.100 port 37502 connected with 10.42.105.96 port 5105 [ 3] 0.0-433750.9 sec 303 GBytes 6.00 Mbits/sec [ 3] Sent 221274622 datagrams [ 3] Server Report: [ 3] 0.0-433742.9 sec 298 GBytes 5.90 Mbits/sec 0.117 ms 3482557/221274622 (1.6%) [ 3] 0.0-433742.9 sec 4588 datagrams received out-of-order }}} == Comments == There was a blip at Clemson during the run, which might account for the nearly 1% packet loss there. (Which isn't a *lot*, but is a little higher than expected.) Sending data from GT plnodes is known to have some issues, which probably accounts for the 1.6% packet loss there. = plastic-106 = [ggw:PlasticSlices/Experiments#SteadyPerfTCP SteadyPerf TCP], using port=5106, time=518400, and this table of client/server pairs: || '''client''' || '''server''' || '''server address''' || || planetlab5.clemson.edu || wings-openflow-2.wail.wisc.edu || server=10.42.106.95 || || wings-openflow-3.wail.wisc.edu || plnode1.cip.gatech.edu || server=10.42.106.100 || || plnode2.cip.gatech.edu || bain.gpolab.bbn.com || server=10.42.106.54 || || navis.gpolab.bbn.com || planetlab4.clemson.edu || server=10.42.106.104 || == One-time prep commands run on each client and server == {{{ sudo yum -y install iperf }}} == Commands run on each server == {{{ server= nice -n 19 iperf -B $server -p 5106 -s -i 1 }}} == Commands run on each client == {{{ server= nice -n 19 iperf -c $server -p 5106 -t 518400 }}} == Results == Generated with {{{ subnet=106 for host in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt | sed -r -e 's/.+@//') ; do echo -e "$host:\n\n{{{" ; grep -A 5 -B 1 "Client connecting" pgenigpolabbbncom_plastic$subnet\@$host.log ; echo -e "}}}\n" ; done }}} and then edited slightly to remove artifacts (like control characters, my prompt, etc). planetlab5.clemson.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.106.95, TCP port 5106 TCP window size: 16.0 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.106.105 port 42612 connected with 10.42.106.95 port 5106 [ ID] Interval Transfer Bandwidth [ 3] 0.0-262786.5 sec 2572392441075410944 bits 0.00 (null)s/sec -- ------------------------------------------------------------ Client connecting to 10.42.106.95, TCP port 5106 TCP window size: 16.0 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.106.105 port 58034 connected with 10.42.106.95 port 5106 [ ID] Interval Transfer Bandwidth [ 3] 0.0-170932.7 sec 58.0 GBytes 2.91 Mbits/sec }}} wings-openflow-3.wail.wisc.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.106.100, TCP port 5106 TCP window size: 16.0 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.106.96 port 55284 connected with 10.42.106.100 port 5106 [ ID] Interval Transfer Bandwidth [ 3] 0.0-433738.5 sec 132 GBytes 2.61 Mbits/sec }}} plnode2.cip.gatech.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.106.54, TCP port 5106 TCP window size: 16.0 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.106.101 port 41257 connected with 10.42.106.54 port 5106 [ 3] 0.0-433755.2 sec 8.74 GBytes 173 Kbits/sec }}} navis.gpolab.bbn.com: {{{ ------------------------------------------------------------ Client connecting to 10.42.106.104, TCP port 5106 TCP window size: 16.0 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.106.55 port 42707 connected with 10.42.106.104 port 5106 write2 failed: No route to host [ 3] 0.0-130042.3 sec 45.9 GBytes 3.03 Mbits/sec -- ------------------------------------------------------------ Client connecting to 10.42.106.104, TCP port 5106 TCP window size: 16.0 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.106.55 port 58769 connected with 10.42.106.104 port 5106 [ 3] 0.0-170833.5 sec 60.1 GBytes 3.02 Mbits/sec }}} == Comments == The raw log for GT had 2438 identical copies of the summary, I think because I accidentally reconnected to the screen session within the screen session at one point. I trimmed them down to the one shown above. The bandwidth from GT to BBN is unusually low, even given the known issue with GT's plnodes. = plastic-107 = [ggw:PlasticSlices/Experiments#SteadyPerfTCP SteadyPerf TCP], using port=5107, time=518400, and this table of client/server pairs: || '''client''' || '''server''' || '''server address''' || || planetlab5.clemson.edu || pl4.myplc.grnoc.iu.edu || server=10.42.107.72 || || pl5.myplc.grnoc.iu.edu || plnode2.cip.gatech.edu || server=10.42.107.101 || || plnode1.cip.gatech.edu || pl02.cs.washington.edu || server=10.42.107.81 || || pl01.cs.washington.edu || planetlab4.clemson.edu || server=10.42.107.104 || == One-time prep commands run on each client and server == {{{ sudo yum -y install iperf }}} == Commands run on each server == {{{ server= nice -n 19 iperf -B $server -p 5107 -s -i 1 }}} == Commands run on each client == {{{ server= nice -n 19 iperf -c $server -p 5107 -t 518400 }}} == Results == Generated with {{{ subnet=107 for host in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt | sed -r -e 's/.+@//') ; do echo -e "$host:\n\n{{{" ; grep -A 5 -B 1 "Client connecting" pgenigpolabbbncom_plastic$subnet\@$host.log ; echo -e "}}}\n" ; done }}} and then edited slightly to remove artifacts (like control characters, my prompt, etc). planetlab5.clemson.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.107.72, TCP port 5107 TCP window size: 16.0 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.107.105 port 38845 connected with 10.42.107.72 port 5107 [ ID] Interval Transfer Bandwidth [ 3] 0.0-262512.9 sec 2513573969281897984 bits 0.00 (null)s/sec -- ------------------------------------------------------------ Client connecting to 10.42.107.72, TCP port 5107 TCP window size: 16.0 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.107.105 port 40331 connected with 10.42.107.72 port 5107 [ ID] Interval Transfer Bandwidth [ 3] 0.0-171297.9 sec 156 GBytes 7.84 Mbits/sec }}} pl5.myplc.grnoc.iu.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.107.101, TCP port 5107 TCP window size: 16.0 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.107.73 port 44290 connected with 10.42.107.101 port 5107 [ 3] 0.0-433822.3 sec 129 GBytes 2.55 Mbits/sec }}} plnode1.cip.gatech.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.107.81, TCP port 5107 TCP window size: 16.0 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.107.100 port 32891 connected with 10.42.107.81 port 5107 write2 failed: Broken pipe [ 3] 0.0-348624.7 sec 184 GBytes 4.53 Mbits/sec }}} pl01.cs.washington.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.107.104, TCP port 5107 TCP window size: 16.0 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.107.80 port 46690 connected with 10.42.107.104 port 5107 write2 failed: No route to host [ 3] 0.0-130027.1 sec 74.6 GBytes 4.93 Mbits/sec -- ------------------------------------------------------------ Client connecting to 10.42.107.104, TCP port 5107 TCP window size: 16.0 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.107.80 port 36229 connected with 10.42.107.104 port 5107 }}} == Comments == The server log for planetlab4.clemson.edu, which pl01.cs.washington.edu was connected to, had this summary at the bottom: {{{ [ 5] 0.0-348621.8 sec 49.4 GBytes 1.22 Mbits/sec [SUM] 0.0-348621.8 sec 49.4 GBytes 1.22 Mbits/sec }}} = plastic-108 = [ggw:PlasticSlices/Experiments#SteadyPerfUDP SteadyPerf UDP], using port=5108, time=518400, rate=8, and this table of client/server pairs: || '''client''' || '''server''' || '''server address''' || || wings-openflow-3.wail.wisc.edu || of-planet2.stanford.edu || server=10.42.108.91 || || of-planet1.stanford.edu || pl5.myplc.grnoc.iu.edu || server=10.42.108.73 || || pl4.myplc.grnoc.iu.edu || wings-openflow-2.wail.wisc.edu || server=10.42.108.95 || == One-time prep commands run on each client and server == {{{ sudo yum -y install iperf }}} == Commands run on each server == {{{ server= nice -n 19 iperf -u -B $server -p 5108 -s -i 1 }}} == Commands run on each client == {{{ server= nice -n 19 iperf -u -c $server -p 5108 -t 518400 -b 8M }}} == Results == Generated with {{{ subnet=108 for host in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt | sed -r -e 's/.+@//') ; do echo -e "$host:\n\n{{{" ; grep -A 10 -B 1 "Client connecting" pgenigpolabbbncom_plastic$subnet\@$host.log ; echo -e "}}}\n" ; done }}} and then edited slightly to remove artifacts (like control characters, my prompt, etc). wings-openflow-3.wail.wisc.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.108.91, UDP port 5108 Sending 1470 byte datagrams UDP buffer size: 110 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.108.96 port 33977 connected with 10.42.108.91 port 5108 [ ID] Interval Transfer Bandwidth [ 3] 0.0-433814.4 sec 135519079565040 bits 2.50 Gbits/sec [ 3] Sent 295111862 datagrams read failed: Connection refused [ 3] WARNING: did not receive ack of last datagram after 2 tries. }}} of-planet1.stanford.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.108.73, UDP port 5108 Sending 1470 byte datagrams UDP buffer size: 110 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.108.90 port 41236 connected with 10.42.108.73 port 5108 }}} pl4.myplc.grnoc.iu.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.108.95, UDP port 5108 Sending 1470 byte datagrams UDP buffer size: 110 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.108.72 port 47671 connected with 10.42.108.95 port 5108 [ 3] 0.0-433817.5 sec 404 GBytes 8.00 Mbits/sec [ 3] Sent 295110461 datagrams [ 3] Server Report: [ 3] 0.0-433816.5 sec 404 GBytes 8.00 Mbits/sec 0.035 ms 93725/295110461 (0.032%) [ 3] 0.0-433816.5 sec 1610 datagrams received out-of-order }}} == Comments == The "2.50 Gbits/sec" number from Wisconsin to Stanford is obviously not right. The log for of-planet2.stanford.edu ends with {{{ [ 3] 344333.0-344334.0 sec 976 KBytes 8.00 Mbits/sec 0.019 ms 0/ 680 (0%) [ 3] 344334.0-344335.0 sec 975 KBytes 7.99 Mbits/sec 0.023 ms 1/ 680 (0.15%) [ 3] 344335.0-344336.0 sec 976 KBytes 8.00 Mbits/sec 0.027 ms 0/ 680 (0%) [ 3] 344336.0-344337.0 sec 976 KBytes 8.00 Mbits/sec 0.036 ms 1/ 681 (0.15%) }}} and that 8 Mbits/sec number is as expected. The server log for pl5.myplc.grnoc.iu.edu, which of-planet1.stanford.edu was connected to, had this summary at the bottom: {{{ [ 3] 0.0-402590.4 sec 374 GBytes 7.97 Mbits/sec 0.021 ms 880273/273854026 (0.32%) [ 3] 0.0-402590.4 sec 13364 datagrams received out-of-order }}} = plastic-109 = [ggw:PlasticSlices/Experiments#SteadyPerfUDP SteadyPerf UDP], using port=5109, time=518400, rate=4, and this table of client/server pairs: || '''client''' || '''server''' || '''server address''' || || gardil.gpolab.bbn.com || pl5.myplc.grnoc.iu.edu || server=10.42.109.73 || || pl4.myplc.grnoc.iu.edu || pl02.cs.washington.edu || server=10.42.109.81 || || pl01.cs.washington.edu || planetlab5.clemson.edu || server=10.42.109.105 || || planetlab4.clemson.edu || of-planet1.stanford.edu || server=10.42.109.90 || || of-planet2.stanford.edu || wings-openflow-3.wail.wisc.edu || server=10.42.109.96 || || wings-openflow-2.wail.wisc.edu || ganel.gpolab.bbn.com || server=10.42.109.51 || == One-time prep commands run on each client and server == {{{ sudo yum -y install iperf }}} == Commands run on each server == {{{ server= nice -n 19 iperf -u -B $server -p 5109 -s -i 1 }}} == Commands run on each client == {{{ server= nice -n 19 iperf -u -c $server -p 5109 -t 518400 -b 4M }}} == Results == Generated with {{{ subnet=109 for host in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt | sed -r -e 's/.+@//') ; do echo -e "$host:\n\n{{{" ; grep -A 10 -B 1 "Client connecting" pgenigpolabbbncom_plastic$subnet\@$host.log ; echo -e "}}}\n" ; done }}} and then edited slightly to remove artifacts (like control characters, my prompt, etc). gardil.gpolab.bbn.com: {{{ ------------------------------------------------------------ Client connecting to 10.42.109.73, UDP port 5109 Sending 1470 byte datagrams UDP buffer size: 110 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.109.52 port 53746 connected with 10.42.109.73 port 5109 [ 3] 0.0-433793.1 sec 202 GBytes 4.00 Mbits/sec [ 3] Sent 147548681 datagrams [ 3] Server Report: [ 3] 0.0-433790.7 sec 201 GBytes 3.97 Mbits/sec 0.004 ms 983731/147548681 (0.67%) [ 3] 0.0-433790.7 sec 9337 datagrams received out-of-order }}} pl4.myplc.grnoc.iu.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.109.81, UDP port 5109 Sending 1470 byte datagrams UDP buffer size: 110 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.109.72 port 39551 connected with 10.42.109.81 port 5109 write2 failed: Connection refused [ 3] 0.0-348511.9 sec 162 GBytes 4.00 Mbits/sec [ 3] Sent 118541205 datagrams read failed: Connection refused [ 3] WARNING: did not receive ack of last datagram after 1 tries. }}} pl01.cs.washington.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.109.105, UDP port 5109 Sending 1470 byte datagrams UDP buffer size: 110 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.109.80 port 43885 connected with 10.42.109.105 port 5109 }}} planetlab4.clemson.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.109.90, UDP port 5109 Sending 1470 byte datagrams UDP buffer size: 110 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.109.104 port 57468 connected with 10.42.109.90 port 5109 [ ID] Interval Transfer Bandwidth [ 3] 0.0-433803.5 sec 135096008515530 bits 2.49 Gbits/sec [ 3] Sent 147552209 datagrams read failed: Connection refused [ 3] WARNING: did not receive ack of last datagram after 2 tries. }}} of-planet2.stanford.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.109.96, UDP port 5109 Sending 1470 byte datagrams UDP buffer size: 110 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.109.91 port 44570 connected with 10.42.109.96 port 5109 }}} wings-openflow-2.wail.wisc.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.109.51, UDP port 5109 Sending 1470 byte datagrams UDP buffer size: 110 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.109.95 port 58015 connected with 10.42.109.51 port 5109 [ ID] Interval Transfer Bandwidth [ 3] 0.0-433807.8 sec 202 GBytes 4.00 Mbits/sec [ 3] Sent 147553686 datagrams [ 3] Server Report: [ 3] 0.0-433802.6 sec 201 GBytes 3.97 Mbits/sec 0.040 ms 978284/147553685 (0.66%) [ 3] 0.0-433802.6 sec 10543 datagrams received out-of-order }}} == Comments == The "2.49 Gbits/sec" number from Clemson to Stanford is obviously not right. The log for of-planet1.stanford.edu ends with {{{ [ 3] 344235.0-344236.0 sec 488 KBytes 4.00 Mbits/sec 0.029 ms 0/ 340 (0%) [ 3] 344236.0-344237.0 sec 488 KBytes 4.00 Mbits/sec 0.046 ms 0/ 340 (0%) [ 3] 344237.0-344238.0 sec 488 KBytes 4.00 Mbits/sec 0.047 ms 0/ 340 (0%) [ 3] 344238.0-344239.0 sec 490 KBytes 4.01 Mbits/sec 0.026 ms 0/ 341 (0%) }}} and that 4 Mbits/sec number is as expected. The server log for planetlab5.clemson.edu, which pl01.cs.washington.edu was connected to, had this summary at the bottom: {{{ [ 3] 0.0-348503.1 sec 160 GBytes 3.95 Mbits/sec 0.122 ms 1515509/118510107 (1.3%) [ 3] 0.0-348503.1 sec 14898 datagrams received out-of-order }}} The server log for wings-openflow-3.wail.wisc.edu, which of-planet2.stanford.edu was connected to, had this summary at the bottom: {{{ [ 3] 0.0-402506.6 sec 187 GBytes 3.99 Mbits/sec 0.111 ms 221552/136906806 (0.16%) [ 3] 0.0-402506.6 sec 6383 datagrams received out-of-order }}} = plastic-110 = [ggw:PlasticSlices/Experiments#SteadyPerfTCP SteadyPerf TCP], using port=5110, time=518400, and this table of client/server pairs: || '''client''' || '''server''' || '''server address''' || || bain.gpolab.bbn.com || pl01.cs.washington.edu || server=10.42.110.80 || || pl02.cs.washington.edu || of-planet1.stanford.edu || server=10.42.110.90 || || of-planet2.stanford.edu || pl4.myplc.grnoc.iu.edu || server=10.42.110.72 || || pl5.myplc.grnoc.iu.edu || plnode1.cip.gatech.edu || server=10.42.110.100 || || plnode2.cip.gatech.edu || navis.gpolab.bbn.com || server=10.42.110.55 || == One-time prep commands run on each client and server == {{{ sudo yum -y install iperf }}} == Commands run on each server == {{{ server= nice -n 19 iperf -B $server -p 5110 -s -i 1 }}} == Commands run on each client == {{{ server= nice -n 19 iperf -c $server -p 5110 -t 518400 }}} == Results == Generated with {{{ subnet=110 for host in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt | sed -r -e 's/.+@//') ; do echo -e "$host:\n\n{{{" ; grep -A 5 -B 1 "Client connecting" pgenigpolabbbncom_plastic$subnet\@$host.log ; echo -e "}}}\n" ; done }}} and then edited slightly to remove artifacts (like control characters, my prompt, etc). bain.gpolab.bbn.com: {{{ ------------------------------------------------------------ Client connecting to 10.42.110.80, TCP port 5110 TCP window size: 16.0 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.110.54 port 46265 connected with 10.42.110.80 port 5110 write2 failed: Connection reset by peer [ 3] 0.0-348394.1 sec 248 GBytes 6.12 Mbits/sec }}} pl02.cs.washington.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.110.90, TCP port 5110 TCP window size: 16.0 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.110.81 port 36323 connected with 10.42.110.90 port 5110 }}} of-planet2.stanford.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.110.72, TCP port 5110 TCP window size: 16.0 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.110.91 port 41437 connected with 10.42.110.72 port 5110 }}} pl5.myplc.grnoc.iu.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.110.100, TCP port 5110 TCP window size: 16.0 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.110.73 port 51910 connected with 10.42.110.100 port 5110 [ 3] 0.0-433718.6 sec 147 GBytes 2.91 Mbits/sec }}} plnode2.cip.gatech.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.110.55, TCP port 5110 TCP window size: 16.0 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.110.101 port 38696 connected with 10.42.110.55 port 5110 [ 3] 0.0-433742.2 sec 28.5 GBytes 565 Kbits/sec }}} == Comments == Since pl02.cs.washington.edu was connected to of-planet2.stanford.edu, the server log at Stanford also doesn't have a summary of stats, although one could in theory be generated from the raw log. The server log for pl4.myplc.grnoc.iu.edu, which of-planet2.stanford.edu was connected to, had this summary at the bottom: {{{ [ 4] 0.0-402383.5 sec 307 GBytes 6.56 Mbits/sec }}}