[[PageOutline]] = Continuation Week 03 = This is the third of a set of week-long continuation runs. It's similar to [wiki:PlasticSlices/Continuation/Weekly02 Week 02], but drops Washington MyPLC (which had been unreliable recently) and adds Utah ProtoGENI. The hostpair tables list hostnames when they're short, or SSH aliases (from my ~/.ssh/config file) when they're not. The ssh config aliases are in the log directory below. There was an outage during this run when the system where I run my OpenFlow controllers needed to be rebooted for OS updates. The iperf clients in the [ggw:PlasticSlices/Experiments#SteadyPerfTCP SteadyPerf TCP] slices (plastic-103 - plastic-106) all either died or hung as a result, and had to be restarted, which is why there are two sets of results for each of them. The raw logs are at http://www.gpolab.bbn.com/plastic-slices/continuation/weekly-03/. = plastic-101 = [ggw:PlasticSlices/Experiments#SteadyPing SteadyPing], using interval=.005, and this table of client/server pairs: || '''client''' || '''server''' || '''server address''' || || ganel.gpolab.bbn.com || planetlab5.clemson.edu || server=10.42.101.105 || || planetlab4.clemson.edu || utah-pg-plastic-101-b || server=10.42.101.27 || || plnode1.cip.gatech.edu || of-planet2.stanford.edu || server=10.42.101.91 || || pl4.myplc.grnoc.iu.edu || plnode2.cip.gatech.edu || server=10.42.101.101 || || of-planet1.stanford.edu || gardil.gpolab.bbn.com || server=10.42.101.52 || || utah-pg-plastic-101-a || pl5.myplc.grnoc.iu.edu || server=10.42.101.73 || == Commands run on each client == {{{ server= sudo ping -q -i .005 -s $((1500-8-20)) $server }}} == Results == Generated from the logs with {{{ subnet=101 for login in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt) do user=$(echo $login | sed -r -e 's/@.+//') host=$(echo $login | sed -r -e 's/.+@//') echo -e "$host:\n\n{{{" ; grep -A 2 statistics $user\@$host.log ; echo -e "}}}\n" done }}} ganel.gpolab.bbn.com: {{{ --- 10.42.101.105 ping statistics --- 52912352 packets transmitted, 52625407 received, +2182 errors, 0% packet loss, time 525285486ms rtt min/avg/max/mdev = 137.966/138.131/10556.125/18.894 ms, pipe 1226 }}} planetlab4.clemson.edu: {{{ --- 10.42.101.27 ping statistics --- 59304093 packets transmitted, 58925698 received, +2196 errors, 0% packet loss, time 525345062ms rtt min/avg/max/mdev = 82.694/84.777/9713.411/20.931 ms, pipe 965 }}} plnode1.cip.gatech.edu: {{{ --- 10.42.101.91 ping statistics --- 54627481 packets transmitted, 54002781 received, +5322 errors, 1% packet loss, time 525329638ms rtt min/avg/max/mdev = 67.189/70.033/11352.405/19.352 ms, pipe 1174 }}} pl4.myplc.grnoc.iu.edu: {{{ --- 10.42.101.101 ping statistics --- 55309178 packets transmitted, 52825622 received, +5265 errors, 4% packet loss, time 525309417ms rtt min/avg/max/mdev = 37.416/38.717/11372.391/29.549 ms, pipe 1184 }}} of-planet1.stanford.edu: {{{ --- 10.42.101.52 ping statistics --- 55991355 packets transmitted, 55590872 received, +2505 errors, 0% packet loss, time 525298229ms rtt min/avg/max/mdev = 201.710/202.998/15193.378/41.534 ms, pipe 1569 }}} utah-pg-plastic-101-a: {{{ --- 10.42.101.73 ping statistics --- 54985862 packets transmitted, 54603195 received, +2172 errors, 0% packet loss, time 525292180ms rtt min/avg/max/mdev = 116.647/118.720/18826.632/35.162 ms, pipe 1859 }}} == Comments == Indiana -> GT had a lot of packet loss, and GT -> Stanford had some as well. = plastic-102 = [ggw:PlasticSlices/Experiments#SteadyPing SteadyPing], using interval=.005, and this table of client/server pairs: || '''client''' || '''server''' || '''server address''' || || ganel.gpolab.bbn.com || plnode2.cip.gatech.edu || server=10.42.102.101 || || planetlab5.clemson.edu || gardil.gpolab.bbn.com || server=10.42.102.52 || || plnode1.cip.gatech.edu || utah-pg-plastic-102-a || server=10.42.102.26 || || pl5.myplc.grnoc.iu.edu || of-planet2.stanford.edu || server=10.42.102.91 || || of-planet1.stanford.edu || pl4.myplc.grnoc.iu.edu || server=10.42.102.72 || || utah-pg-plastic-102-b || planetlab4.clemson.edu || server=10.42.102.104 || == Commands run on each client == {{{ server= sudo ping -q -i .005 -s $((1500-8-20)) $server }}} == Results == Generated from the logs with {{{ subnet=102 for login in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt) do user=$(echo $login | sed -r -e 's/@.+//') host=$(echo $login | sed -r -e 's/.+@//') echo -e "$host:\n\n{{{" ; grep -A 2 statistics $user\@$host.log ; echo -e "}}}\n" done }}} ganel.gpolab.bbn.com: {{{ --- 10.42.102.101 ping statistics --- 56322663 packets transmitted, 53814596 received, +6163 errors, 4% packet loss, time 525288395ms rtt min/avg/max/mdev = 24.620/25.861/9819.198/20.373 ms, pipe 884 }}} planetlab5.clemson.edu: {{{ --- 10.42.102.52 ping statistics --- 58117224 packets transmitted, 57811428 received, +2229 errors, 0% packet loss, time 525507418ms rtt min/avg/max/mdev = 27.016/27.184/10009.308/17.413 ms, pipe 1077 }}} plnode1.cip.gatech.edu: {{{ --- 10.42.102.26 ping statistics --- 54496109 packets transmitted, 53694530 received, +6204 errors, 1% packet loss, time 525493972ms rtt min/avg/max/mdev = 117.559/120.989/11362.959/23.518 ms, pipe 1127 }}} pl5.myplc.grnoc.iu.edu: {{{ --- 10.42.102.91 ping statistics --- 58080188 packets transmitted, 57808597 received, +2361 errors, 0% packet loss, time 525476457ms rtt min/avg/max/mdev = 78.318/79.711/6480.512/16.264 ms, pipe 592 }}} of-planet1.stanford.edu: {{{ --- 10.42.102.72 ping statistics --- 58668048 packets transmitted, 58318385 received, +2400 errors, 0% packet loss, time 525467981ms rtt min/avg/max/mdev = 78.335/79.536/20525.339/35.694 ms, pipe 2374 }}} utah-pg-plastic-102-b: {{{ --- 10.42.102.104 ping statistics --- 54624483 packets transmitted, 53876310 received, +2208 errors, 1% packet loss, time 525448716ms rtt min/avg/max/mdev = 119.938/121.951/12206.465/22.701 ms, pipe 1240 }}} == Comments == BBN -> GT had a lot of packet loss, and GT -> Utah had some as well. = plastic-103 = [ggw:PlasticSlices/Experiments#SteadyPerfTCP SteadyPerf TCP], using port=5103, time=518400, and this table of client/server pairs: || '''client''' || '''server''' || '''server address''' || || gardil.gpolab.bbn.com || plnode1.cip.gatech.edu || server=10.42.103.100 || || planetlab4.clemson.edu || ganel.gpolab.bbn.com || server=10.42.103.51 || || plnode2.cip.gatech.edu || utah-pg-plastic-103-b || server=10.42.103.27 || || pl4.myplc.grnoc.iu.edu || of-planet1.stanford.edu || server=10.42.103.90 || || of-planet2.stanford.edu || pl5.myplc.grnoc.iu.edu || server=10.42.103.73 || || utah-pg-plastic-103-a || planetlab5.clemson.edu || server=10.42.103.105 || == Commands run on each server == {{{ server= nice -n 19 iperf -B $server -p 5103 -s -i 1 -w 1m }}} == Commands run on each client == {{{ server= nice -n 19 iperf -c $server -p 5103 -t 518400 -w 1m }}} == Results == Generated with {{{ subnet=103 for login in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt) do user=$(echo $login | sed -r -e 's/@.+//') host=$(echo $login | sed -r -e 's/.+@//') echo -e "$host:\n\n{{{" ; grep -a -A 5 -B 1 "Client connecting" $user\@$host.log ; echo -e "}}}\n" done }}} and then edited slightly to remove artifacts (like control characters, my prompt, etc). gardil.gpolab.bbn.com: {{{ ------------------------------------------------------------ Client connecting to 10.42.103.100, TCP port 5103 TCP window size: 256 KByte (WARNING: requested 1.00 MByte) ------------------------------------------------------------ [ 3] local 10.42.103.52 port 60886 connected with 10.42.103.100 port 5103 write2 failed: No route to host [ 3] 0.0-371094.0 sec 434 GBytes 10.0 Mbits/sec -- ------------------------------------------------------------ Client connecting to 10.42.103.100, TCP port 5103 TCP window size: 256 KByte (WARNING: requested 1.00 MByte) ------------------------------------------------------------ [ 3] local 10.42.103.52 port 60031 connected with 10.42.103.100 port 5103 write2 failed: No route to host [ 3] 0.0-6754.9 sec 6.76 GBytes 8.60 Mbits/sec }}} planetlab4.clemson.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.103.51, TCP port 5103 TCP window size: 256 KByte (WARNING: requested 1.00 MByte) ------------------------------------------------------------ [ 3] local 10.42.103.104 port 49457 connected with 10.42.103.51 port 5103 [ ID] Interval Transfer Bandwidth [ 3] 0.0-439460.5 sec 1872893339255434496 bits 0.00 (null)s/sec -- ------------------------------------------------------------ Client connecting to 10.42.103.51, TCP port 5103 TCP window size: 256 KByte (WARNING: requested 1.00 MByte) ------------------------------------------------------------ [ 3] local 10.42.103.104 port 50430 connected with 10.42.103.51 port 5103 [ ID] Interval Transfer Bandwidth [ 3] 0.0-85977.8 sec 35.9 GBytes 3.59 Mbits/sec }}} plnode2.cip.gatech.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.103.27, TCP port 5103 TCP window size: 256 KByte (WARNING: requested 1.00 MByte) ------------------------------------------------------------ [ 3] local 10.42.103.101 port 60598 connected with 10.42.103.27 port 5103 write2 failed: No route to host [ 3] 0.0-371067.6 sec 39.3 GBytes 911 Kbits/sec -- ------------------------------------------------------------ Client connecting to 10.42.103.27, TCP port 5103 TCP window size: 256 KByte (WARNING: requested 1.00 MByte) ------------------------------------------------------------ [ 3] local 10.42.103.101 port 45427 connected with 10.42.103.27 port 5103 write2 failed: No route to host [ 3] 0.0-6289.2 sec 748 MBytes 997 Kbits/sec }}} pl4.myplc.grnoc.iu.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.103.90, TCP port 5103 TCP window size: 256 KByte (WARNING: requested 1.00 MByte) ------------------------------------------------------------ [ 3] local 10.42.103.72 port 34451 connected with 10.42.103.90 port 5103 write2 failed: No route to host [ 3] 0.0-371081.2 sec 309 GBytes 7.14 Mbits/sec -- ------------------------------------------------------------ Client connecting to 10.42.103.90, TCP port 5103 TCP window size: 256 KByte (WARNING: requested 1.00 MByte) ------------------------------------------------------------ [ 3] local 10.42.103.72 port 48334 connected with 10.42.103.90 port 5103 [ 3] 0.0-85974.8 sec 82.3 GBytes 8.22 Mbits/sec }}} of-planet2.stanford.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.103.73, TCP port 5103 TCP window size: 256 KByte (WARNING: requested 1.00 MByte) ------------------------------------------------------------ [ 3] local 10.42.103.91 port 54556 connected with 10.42.103.73 port 5103 [ ID] Interval Transfer Bandwidth [ 3] 0.0-439495.4 sec 180079025129797024 bits 0.00 (null)s/sec -- ------------------------------------------------------------ Client connecting to 10.42.103.73, TCP port 5103 TCP window size: 256 KByte (WARNING: requested 1.00 MByte) ------------------------------------------------------------ [ 3] local 10.42.103.91 port 48395 connected with 10.42.103.73 port 5103 [ ID] Interval Transfer Bandwidth [ 3] 0.0-85967.8 sec 109 GBytes 10.9 Mbits/sec }}} utah-pg-plastic-103-a: {{{ ------------------------------------------------------------ Client connecting to 10.42.103.105, TCP port 5103 TCP window size: 256 KByte (WARNING: requested 1.00 MByte) ------------------------------------------------------------ [ 3] local 10.42.103.26 port 49384 connected with 10.42.103.105 port 5103 [ ID] Interval Transfer Bandwidth [ 3] 0.0-439515.0 sec 725 GBytes 14.2 Mbits/sec -- ------------------------------------------------------------ Client connecting to 10.42.103.105, TCP port 5103 TCP window size: 256 KByte (WARNING: requested 1.00 MByte) ------------------------------------------------------------ [ 3] local 10.42.103.26 port 49583 connected with 10.42.103.105 port 5103 [ ID] Interval Transfer Bandwidth [ 3] 0.0-85955.8 sec 171 GBytes 17.1 Mbits/sec }}} == Comments == There was an outage during this run when the system where I run my OpenFlow controllers needed to be rebooted for OS updates. The iperf clients all either died or hung as a result, and had to be restarted, which is why there are two sets of results for each of them. The Fedora 12 iperf client (at Clemson and Stanford) sometimes reports nonsensical bandwidth results if the client dies or hangs. Very low bandwidth from GT -> Utah; much lower than any of the others. = plastic-104 = [ggw:PlasticSlices/Experiments#SteadyPerfTCP SteadyPerf TCP], using port=5104, time=518400, and this table of client/server pairs: || '''client''' || '''server''' || '''server address''' || || ganel.gpolab.bbn.com || utah-pg-plastic-104-a || server=10.42.104.26 || || planetlab4.clemson.edu || of-planet2.stanford.edu || server=10.42.104.91 || || plnode2.cip.gatech.edu || pl4.myplc.grnoc.iu.edu || server=10.42.104.72 || || pl5.myplc.grnoc.iu.edu || planetlab5.clemson.edu || server=10.42.104.105 || || of-planet1.stanford.edu || plnode1.cip.gatech.edu || server=10.42.104.100 || || utah-pg-plastic-104-b || gardil.gpolab.bbn.com || server=10.42.104.52 || == Commands run on each server == {{{ server= nice -n 19 iperf -B $server -p 5104 -s -i 1 -w 1m }}} == Commands run on each client == {{{ server= nice -n 19 iperf -c $server -p 5104 -t 518400 -w 1m }}} == Results == Generated with {{{ subnet=104 for login in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt) do user=$(echo $login | sed -r -e 's/@.+//') host=$(echo $login | sed -r -e 's/.+@//') echo -e "$host:\n\n{{{" ; grep -a -A 5 -B 1 "Client connecting" $user\@$host.log ; echo -e "}}}\n" done }}} and then edited slightly to remove artifacts (like control characters, my prompt, etc). ganel.gpolab.bbn.com: {{{ ------------------------------------------------------------ Client connecting to 10.42.104.26, TCP port 5104 TCP window size: 256 KByte (WARNING: requested 1.00 MByte) ------------------------------------------------------------ [ 3] local 10.42.104.51 port 45121 connected with 10.42.104.26 port 5104 write2 failed: No route to host [ 3] 0.0-371011.4 sec 374 GBytes 8.67 Mbits/sec -- ------------------------------------------------------------ Client connecting to 10.42.104.26, TCP port 5104 TCP window size: 256 KByte (WARNING: requested 1.00 MByte) ------------------------------------------------------------ [ 3] local 10.42.104.51 port 39544 connected with 10.42.104.26 port 5104 [ 3] 0.0-86042.6 sec 90.1 GBytes 8.99 Mbits/sec }}} planetlab4.clemson.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.104.91, TCP port 5104 TCP window size: 256 KByte (WARNING: requested 1.00 MByte) ------------------------------------------------------------ [ 3] local 10.42.104.104 port 34155 connected with 10.42.104.91 port 5104 [ ID] Interval Transfer Bandwidth [ 3] 0.0-439464.8 sec 18407172598695016448 bits 0.00 (null)s/sec -- ------------------------------------------------------------ Client connecting to 10.42.104.91, TCP port 5104 TCP window size: 256 KByte (WARNING: requested 1.00 MByte) ------------------------------------------------------------ [ 3] local 10.42.104.104 port 39222 connected with 10.42.104.91 port 5104 [ ID] Interval Transfer Bandwidth [ 3] 0.0-86031.0 sec 49.9 GBytes 4.98 Mbits/sec }}} plnode2.cip.gatech.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.104.72, TCP port 5104 TCP window size: 256 KByte (WARNING: requested 1.00 MByte) ------------------------------------------------------------ [ 3] local 10.42.104.101 port 34460 connected with 10.42.104.72 port 5104 write2 failed: No route to host [ 3] 0.0-371023.6 sec 28.9 GBytes 669 Kbits/sec -- ------------------------------------------------------------ Client connecting to 10.42.104.72, TCP port 5104 TCP window size: 256 KByte (WARNING: requested 1.00 MByte) ------------------------------------------------------------ [ 3] local 10.42.104.101 port 54642 connected with 10.42.104.72 port 5104 write2 failed: No route to host [ 3] 0.0-74394.3 sec 5.76 GBytes 665 Kbits/sec }}} pl5.myplc.grnoc.iu.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.104.105, TCP port 5104 TCP window size: 256 KByte (WARNING: requested 1.00 MByte) ------------------------------------------------------------ [ 3] local 10.42.104.73 port 39853 connected with 10.42.104.105 port 5104 write2 failed: No route to host [ 3] 0.0-253441.4 sec 309 GBytes 10.5 Mbits/sec -- ------------------------------------------------------------ Client connecting to 10.42.104.105, TCP port 5104 TCP window size: 256 KByte (WARNING: requested 1.00 MByte) ------------------------------------------------------------ [ 3] local 10.42.104.73 port 52293 connected with 10.42.104.105 port 5104 [ 3] 0.0-86034.9 sec 105 GBytes 10.5 Mbits/sec }}} of-planet1.stanford.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.104.100, TCP port 5104 TCP window size: 256 KByte (WARNING: requested 1.00 MByte) ------------------------------------------------------------ [ 3] local 10.42.104.90 port 57730 connected with 10.42.104.100 port 5104 [ ID] Interval Transfer Bandwidth [ 3] 0.0-439503.7 sec 36166123700098040 bits 658 Gbits/sec -- ------------------------------------------------------------ Client connecting to 10.42.104.100, TCP port 5104 TCP window size: 256 KByte (WARNING: requested 1.00 MByte) ------------------------------------------------------------ [ 3] local 10.42.104.90 port 33380 connected with 10.42.104.100 port 5104 [ ID] Interval Transfer Bandwidth [ 3] 0.0-86021.8 sec 3159591055125393920 bits 0.00 (null)s/sec }}} utah-pg-plastic-104-b: {{{ ------------------------------------------------------------ Client connecting to 10.42.104.52, TCP port 5104 TCP window size: 256 KByte (WARNING: requested 1.00 MByte) ------------------------------------------------------------ [ 3] local 10.42.104.27 port 44734 connected with 10.42.104.52 port 5104 [ ID] Interval Transfer Bandwidth [ 3] 0.0-439529.2 sec 576 GBytes 11.3 Mbits/sec -- ------------------------------------------------------------ Client connecting to 10.42.104.52, TCP port 5104 TCP window size: 256 KByte (WARNING: requested 1.00 MByte) ------------------------------------------------------------ [ 3] local 10.42.104.27 port 44960 connected with 10.42.104.52 port 5104 [ ID] Interval Transfer Bandwidth [ 3] 0.0-86017.1 sec 137 GBytes 13.7 Mbits/sec }}} == Comments == There was an outage during this run when the system where I run my OpenFlow controllers needed to be rebooted for OS updates. The iperf clients all either died or hung as a result, and had to be restarted, which is why there are two sets of results for each of them. The Fedora 12 iperf client (at Clemson and Stanford) sometimes reports nonsensical bandwidth results if the client dies or hangs. Very low bandwidth from GT -> Indiana; much lower than any of the others. = plastic-105 = [ggw:PlasticSlices/Experiments#SteadyPerfTCP SteadyPerf TCP], using port=5105, time=518400, and this table of client/server pairs: || '''client''' || '''server''' || '''server address''' || || ganel.gpolab.bbn.com || pl4.myplc.grnoc.iu.edu || server=10.42.105.72 || || planetlab4.clemson.edu || plnode2.cip.gatech.edu || server=10.42.105.101 || || plnode1.cip.gatech.edu || gardil.gpolab.bbn.com || server=10.42.105.52 || || pl5.myplc.grnoc.iu.edu || utah-pg-plastic-105-a || server=10.42.105.26 || || of-planet2.stanford.edu || planetlab5.clemson.edu || server=10.42.105.105 || || utah-pg-plastic-105-b || of-planet1.stanford.edu || server=10.42.105.90 || == Commands run on each server == {{{ server= nice -n 19 iperf -B $server -p 5105 -s -i 1 -w 1m }}} == Commands run on each client == {{{ server= nice -n 19 iperf -c $server -p 5105 -t 518400 -w 1m }}} == Results == Generated with {{{ subnet=105 for login in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt) do user=$(echo $login | sed -r -e 's/@.+//') host=$(echo $login | sed -r -e 's/.+@//') echo -e "$host:\n\n{{{" ; grep -a -A 5 -B 1 "Client connecting" $user\@$host.log ; echo -e "}}}\n" done }}} and then edited slightly to remove artifacts (like control characters, my prompt, etc). ganel.gpolab.bbn.com: {{{ ------------------------------------------------------------ Client connecting to 10.42.105.72, TCP port 5105 TCP window size: 256 KByte (WARNING: requested 1.00 MByte) ------------------------------------------------------------ [ 3] local 10.42.105.51 port 38170 connected with 10.42.105.72 port 5105 write2 failed: No route to host [ 3] 0.0-370958.8 sec 350 GBytes 8.10 Mbits/sec -- ------------------------------------------------------------ Client connecting to 10.42.105.72, TCP port 5105 TCP window size: 256 KByte (WARNING: requested 1.00 MByte) ------------------------------------------------------------ [ 3] local 10.42.105.51 port 33908 connected with 10.42.105.72 port 5105 [ 3] 0.0-86017.0 sec 81.1 GBytes 8.10 Mbits/sec }}} planetlab4.clemson.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.105.101, TCP port 5105 TCP window size: 256 KByte (WARNING: requested 1.00 MByte) ------------------------------------------------------------ [ 3] local 10.42.105.104 port 43143 connected with 10.42.105.101 port 5105 [ ID] Interval Transfer Bandwidth [ 3] 0.0-439505.1 sec 1935915996601714176 bits 0.00 (null)s/sec -- ------------------------------------------------------------ Client connecting to 10.42.105.101, TCP port 5105 TCP window size: 256 KByte (WARNING: requested 1.00 MByte) ------------------------------------------------------------ [ 3] local 10.42.105.104 port 40462 connected with 10.42.105.101 port 5105 [ ID] Interval Transfer Bandwidth [ 3] 0.0-86013.7 sec 3481089854294193152 bits 0.00 (null)s/sec }}} plnode1.cip.gatech.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.105.52, TCP port 5105 TCP window size: 256 KByte (WARNING: requested 1.00 MByte) ------------------------------------------------------------ [ 3] local 10.42.105.100 port 51114 connected with 10.42.105.52 port 5105 write2 failed: No route to host [ 3] 0.0-370953.2 sec 88.2 GBytes 2.04 Mbits/sec -- ------------------------------------------------------------ Client connecting to 10.42.105.52, TCP port 5105 TCP window size: 256 KByte (WARNING: requested 1.00 MByte) ------------------------------------------------------------ [ 3] local 10.42.105.100 port 32994 connected with 10.42.105.52 port 5105 write2 failed: No route to host [ 3] 0.0-74317.8 sec 17.5 GBytes 2.02 Mbits/sec }}} pl5.myplc.grnoc.iu.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.105.26, TCP port 5105 TCP window size: 256 KByte (WARNING: requested 1.00 MByte) ------------------------------------------------------------ [ 3] local 10.42.105.73 port 41151 connected with 10.42.105.26 port 5105 write2 failed: No route to host [ 3] 0.0-370920.4 sec 338 GBytes 7.83 Mbits/sec -- ------------------------------------------------------------ Client connecting to 10.42.105.26, TCP port 5105 TCP window size: 256 KByte (WARNING: requested 1.00 MByte) ------------------------------------------------------------ [ 3] local 10.42.105.73 port 43970 connected with 10.42.105.26 port 5105 [ 3] 0.0-86010.2 sec 82.8 GBytes 8.27 Mbits/sec }}} of-planet2.stanford.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.105.105, TCP port 5105 TCP window size: 256 KByte (WARNING: requested 1.00 MByte) ------------------------------------------------------------ [ 3] local 10.42.105.91 port 51978 connected with 10.42.105.105 port 5105 [ ID] Interval Transfer Bandwidth [ 3] 0.0-439538.8 sec 234151794153822656 bits 0.00 (null)s/sec -- ------------------------------------------------------------ Client connecting to 10.42.105.105, TCP port 5105 TCP window size: 256 KByte (WARNING: requested 1.00 MByte) ------------------------------------------------------------ [ 3] local 10.42.105.91 port 52266 connected with 10.42.105.105 port 5105 [ ID] Interval Transfer Bandwidth [ 3] 0.0-86002.4 sec 162 GBytes 16.2 Mbits/sec }}} utah-pg-plastic-105-b: {{{ ------------------------------------------------------------ Client connecting to 10.42.105.90, TCP port 5105 TCP window size: 256 KByte (WARNING: requested 1.00 MByte) ------------------------------------------------------------ [ 3] local 10.42.105.27 port 54878 connected with 10.42.105.90 port 5105 [ ID] Interval Transfer Bandwidth [ 3] 0.0-439545.6 sec 339 GBytes 6.63 Mbits/sec -- ------------------------------------------------------------ Client connecting to 10.42.105.90, TCP port 5105 TCP window size: 256 KByte (WARNING: requested 1.00 MByte) ------------------------------------------------------------ [ 3] local 10.42.105.27 port 55075 connected with 10.42.105.90 port 5105 [ ID] Interval Transfer Bandwidth [ 3] 0.0-86000.1 sec 80.6 GBytes 8.05 Mbits/sec }}} == Comments == There was an outage during this run when the system where I run my OpenFlow controllers needed to be rebooted for OS updates. The iperf clients all either died or hung as a result, and had to be restarted, which is why there are two sets of results for each of them. The Fedora 12 iperf client (at Clemson and Stanford) sometimes reports nonsensical bandwidth results if the client dies or hangs. Very low bandwidth from GT -> BBN, although not as much lower as in some of the other slices. = plastic-106 = [ggw:PlasticSlices/Experiments#SteadyPerfTCP SteadyPerf TCP], using port=5106, time=518400, and this table of client/server pairs: || '''client''' || '''server''' || '''server address''' || || ganel.gpolab.bbn.com || of-planet2.stanford.edu || server=10.42.106.91 || || planetlab5.clemson.edu || pl5.myplc.grnoc.iu.edu || server=10.42.106.73 || || plnode2.cip.gatech.edu || planetlab4.clemson.edu || server=10.42.106.104 || || pl4.myplc.grnoc.iu.edu || gardil.gpolab.bbn.com || server=10.42.106.52 || || of-planet1.stanford.edu || utah-pg-plastic-106-a || server=10.42.106.26 || || utah-pg-plastic-106-b || plnode1.cip.gatech.edu || server=10.42.106.100 || == Commands run on each server == {{{ server= nice -n 19 iperf -B $server -p 5106 -s -i 1 -w 1m }}} == Commands run on each client == {{{ server= nice -n 19 iperf -c $server -p 5106 -t 518400 -w 1m }}} == Results == Generated with {{{ subnet=106 for login in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt) do user=$(echo $login | sed -r -e 's/@.+//') host=$(echo $login | sed -r -e 's/.+@//') echo -e "$host:\n\n{{{" ; grep -a -A 5 -B 1 "Client connecting" $user\@$host.log ; echo -e "}}}\n" done }}} and then edited slightly to remove artifacts (like control characters, my prompt, etc). ganel.gpolab.bbn.com: {{{ ------------------------------------------------------------ Client connecting to 10.42.106.91, TCP port 5106 TCP window size: 256 KByte (WARNING: requested 1.00 MByte) ------------------------------------------------------------ [ 3] local 10.42.106.51 port 48531 connected with 10.42.106.91 port 5106 write2 failed: No route to host [ 3] 0.0-370915.6 sec 654 GBytes 15.1 Mbits/sec -- ------------------------------------------------------------ Client connecting to 10.42.106.91, TCP port 5106 TCP window size: 256 KByte (WARNING: requested 1.00 MByte) ------------------------------------------------------------ [ 3] local 10.42.106.51 port 60131 connected with 10.42.106.91 port 5106 [ 3] 0.0-86020.0 sec 147 GBytes 14.7 Mbits/sec }}} planetlab5.clemson.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.106.73, TCP port 5106 TCP window size: 256 KByte (WARNING: requested 1.00 MByte) ------------------------------------------------------------ [ 3] local 10.42.106.105 port 35646 connected with 10.42.106.73 port 5106 [ ID] Interval Transfer Bandwidth [ 3] 0.0-439534.2 sec 1967638614995821568 bits 0.00 (null)s/sec -- ------------------------------------------------------------ Client connecting to 10.42.106.73, TCP port 5106 TCP window size: 256 KByte (WARNING: requested 1.00 MByte) ------------------------------------------------------------ [ 3] local 10.42.106.105 port 33150 connected with 10.42.106.73 port 5106 [ ID] Interval Transfer Bandwidth [ 3] 0.0-86019.5 sec 39.3 GBytes 3.93 Mbits/sec }}} plnode2.cip.gatech.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.106.104, TCP port 5106 TCP window size: 256 KByte (WARNING: requested 1.00 MByte) ------------------------------------------------------------ [ 3] local 10.42.106.101 port 47772 connected with 10.42.106.104 port 5106 write2 failed: No route to host [ 3] 0.0-370884.6 sec 721 GBytes 16.7 Mbits/sec -- ------------------------------------------------------------ Client connecting to 10.42.106.104, TCP port 5106 TCP window size: 256 KByte (WARNING: requested 1.00 MByte) ------------------------------------------------------------ [ 3] local 10.42.106.101 port 38622 connected with 10.42.106.104 port 5106 write2 failed: No route to host [ 3] 0.0-74206.2 sec 163 GBytes 18.9 Mbits/sec }}} pl4.myplc.grnoc.iu.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.106.52, TCP port 5106 TCP window size: 256 KByte (WARNING: requested 1.00 MByte) ------------------------------------------------------------ [ 3] local 10.42.106.72 port 52018 connected with 10.42.106.52 port 5106 write2 failed: No route to host [ 3] 0.0-370904.9 sec 352 GBytes 8.14 Mbits/sec -- ------------------------------------------------------------ Client connecting to 10.42.106.52, TCP port 5106 TCP window size: 256 KByte (WARNING: requested 1.00 MByte) ------------------------------------------------------------ [ 3] local 10.42.106.72 port 59793 connected with 10.42.106.52 port 5106 [ 3] 0.0-86023.9 sec 82.4 GBytes 8.23 Mbits/sec }}} of-planet1.stanford.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.106.26, TCP port 5106 TCP window size: 256 KByte (WARNING: requested 1.00 MByte) ------------------------------------------------------------ [ 3] local 10.42.106.90 port 33217 connected with 10.42.106.26 port 5106 [ ID] Interval Transfer Bandwidth [ 3] 0.0-439558.7 sec 26251700480309168 bits 478 Gbits/sec -- ------------------------------------------------------------ Client connecting to 10.42.106.26, TCP port 5106 TCP window size: 256 KByte (WARNING: requested 1.00 MByte) ------------------------------------------------------------ [ 3] local 10.42.106.90 port 48326 connected with 10.42.106.26 port 5106 [ ID] Interval Transfer Bandwidth [ 3] 0.0-86019.4 sec 46.0 GBytes 4.60 Mbits/sec }}} utah-pg-plastic-106-b: {{{ ------------------------------------------------------------ Client connecting to 10.42.106.100, TCP port 5106 TCP window size: 256 KByte (WARNING: requested 1.00 MByte) ------------------------------------------------------------ [ 3] local 10.42.106.27 port 50300 connected with 10.42.106.100 port 5106 [ ID] Interval Transfer Bandwidth [ 3] 0.0-439579.1 sec 496 GBytes 9.69 Mbits/sec -- ------------------------------------------------------------ Client connecting to 10.42.106.100, TCP port 5106 TCP window size: 256 KByte (WARNING: requested 1.00 MByte) ------------------------------------------------------------ [ 3] local 10.42.106.27 port 50488 connected with 10.42.106.100 port 5106 [ ID] Interval Transfer Bandwidth [ 3] 0.0-86010.9 sec 99.8 GBytes 9.97 Mbits/sec }}} == Comments == There was an outage during this run when the system where I run my OpenFlow controllers needed to be rebooted for OS updates. The iperf clients all either died or hung as a result, and had to be restarted, which is why there are two sets of results for each of them. The Fedora 12 iperf client (at Clemson and Stanford) sometimes reports nonsensical bandwidth results if the client dies or hangs. GT -> Clemson was not low at all, which is interesting, in that it perhaps suggests that the problem isn't strictly at GT. = plastic-107 = [ggw:PlasticSlices/Experiments#SteadyPerfUDP SteadyPerf UDP], using port=5107, time=518400, rate=2, and this table of client/server pairs: || '''client''' || '''server''' || '''server address''' || || gardil.gpolab.bbn.com || of-planet1.stanford.edu || server=10.42.107.90 || || planetlab4.clemson.edu || pl4.myplc.grnoc.iu.edu || server=10.42.107.72 || || plnode1.cip.gatech.edu || planetlab5.clemson.edu || server=10.42.107.105 || || pl5.myplc.grnoc.iu.edu || ganel.gpolab.bbn.com || server=10.42.107.51 || || of-planet2.stanford.edu || utah-pg-plastic-107-b || server=10.42.107.27 || || utah-pg-plastic-107-a || plnode2.cip.gatech.edu || server=10.42.107.101 || == Commands run on each server == {{{ server= nice -n 19 iperf -u -B $server -p 5107 -s -i 1 }}} == Commands run on each client == {{{ server= nice -n 19 iperf -u -c $server -p 5107 -t 518400 -b 2M }}} == Results == Generated with {{{ subnet=107 for login in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt) do user=$(echo $login | sed -r -e 's/@.+//') host=$(echo $login | sed -r -e 's/.+@//') echo -e "$host:\n\n{{{" ; grep -a -A 10 -B 1 "Client connecting" $user\@$host.log ; echo -e "}}}\n" done }}} and then edited slightly to remove artifacts (like control characters, my prompt, etc). gardil.gpolab.bbn.com: {{{ ------------------------------------------------------------ Client connecting to 10.42.107.90, UDP port 5107 Sending 1470 byte datagrams UDP buffer size: 110 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.107.52 port 59378 connected with 10.42.107.90 port 5107 [ 3] 0.0-518400.0 sec 121 GBytes 2.00 Mbits/sec [ 3] Sent 88163125 datagrams [ 3] Server Report: [ 3] 0.0-518397.3 sec 120 GBytes 1.98 Mbits/sec 0.194 ms 740534/88163124 (0.84%) [ 3] 0.0-518397.3 sec 11037 datagrams received out-of-order }}} planetlab4.clemson.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.107.72, UDP port 5107 Sending 1470 byte datagrams UDP buffer size: 110 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.107.104 port 34409 connected with 10.42.107.72 port 5107 [ ID] Interval Transfer Bandwidth [ 3] 0.0-518400.0 sec 121 GBytes 2.00 Mbits/sec [ 3] Sent 88163267 datagrams [ 3] Server Report: [ 3] 0.0-518398.4 sec 119 GBytes 1.98 Mbits/sec 0.037 ms 904942/88163267 (1%) [ 3] 0.0-518398.4 sec 3256 datagrams received out-of-order }}} plnode1.cip.gatech.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.107.105, UDP port 5107 Sending 1470 byte datagrams UDP buffer size: 122 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.107.100 port 36924 connected with 10.42.107.105 port 5107 [ 3] 0.0-518400.0 sec 121 GBytes 2.00 Mbits/sec [ 3] Sent 88160844 datagrams [ 3] Server Report: [ 3] 0.0-518399.1 sec 119 GBytes 1.98 Mbits/sec 0.192 ms 1068799/88160843 (1.2%) [ 3] 0.0-518399.1 sec 1747 datagrams received out-of-order }}} pl5.myplc.grnoc.iu.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.107.51, UDP port 5107 Sending 1470 byte datagrams UDP buffer size: 110 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.107.73 port 60928 connected with 10.42.107.51 port 5107 [ 3] 0.0-518400.0 sec 121 GBytes 2.00 Mbits/sec [ 3] Sent 88163212 datagrams [ 3] Server Report: [ 3] 0.0-518397.5 sec 120 GBytes 1.99 Mbits/sec 0.032 ms 521733/88163211 (0.59%) [ 3] 0.0-518397.5 sec 6307 datagrams received out-of-order }}} of-planet2.stanford.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.107.27, UDP port 5107 Sending 1470 byte datagrams UDP buffer size: 110 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.107.91 port 36486 connected with 10.42.107.27 port 5107 [ ID] Interval Transfer Bandwidth [ 3] 0.0-518400.0 sec 121 GBytes 2.00 Mbits/sec [ 3] Sent 88163267 datagrams [ 3] Server Report: [ 3] 0.0-518396.7 sec 120 GBytes 1.98 Mbits/sec 1.463 ms 700326/88163266 (0.79%) [ 3] 0.0-518396.7 sec 7533 datagrams received out-of-order }}} utah-pg-plastic-107-a: {{{ ------------------------------------------------------------ Client connecting to 10.42.107.101, UDP port 5107 Sending 1470 byte datagrams UDP buffer size: 136 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.107.26 port 36011 connected with 10.42.107.101 port 5107 [ ID] Interval Transfer Bandwidth [ 3] 0.0-518400.0 sec 121 GBytes 2.00 Mbits/sec [ 3] Sent 88163267 datagrams [ 3] Server Report: [ 3] 0.0-518397.8 sec 119 GBytes 1.98 Mbits/sec 1.733 ms 1070500/88163266 (1.2%) [ 3] 0.0-518397.8 sec 3680 datagrams received out-of-order }}} == Comments == Packet loss numbers, in order: {{{ Indiana -> BBN [ 3] 0.0-518397.5 sec 120 GBytes 1.99 Mbits/sec 0.032 ms 521733/88163211 (0.59%) Stanford -> Utah [ 3] 0.0-518396.7 sec 120 GBytes 1.98 Mbits/sec 1.463 ms 700326/88163266 (0.79%) BBN -> Stanford [ 3] 0.0-518397.3 sec 120 GBytes 1.98 Mbits/sec 0.194 ms 740534/88163124 (0.84%) Clemson -> Indiana [ 3] 0.0-518398.4 sec 119 GBytes 1.98 Mbits/sec 0.037 ms 904942/88163267 (1%) GT -> Clemson [ 3] 0.0-518399.1 sec 119 GBytes 1.98 Mbits/sec 0.192 ms 1068799/88160843 (1.2%) Utah -> GT [ 3] 0.0-518397.8 sec 119 GBytes 1.98 Mbits/sec 1.733 ms 1070500/88163266 (1.2%) }}} All low, and pretty even. = plastic-108 = [ggw:PlasticSlices/Experiments#SteadyPerfUDP SteadyPerf UDP], using port=5108, time=518400, rate=3, and this table of client/server pairs: || '''client''' || '''server''' || '''server address''' || || gardil.gpolab.bbn.com || pl5.myplc.grnoc.iu.edu || server=10.42.108.73 || || planetlab5.clemson.edu || plnode1.cip.gatech.edu || server=10.42.108.100 || || plnode2.cip.gatech.edu || ganel.gpolab.bbn.com || server=10.42.108.51 || || pl4.myplc.grnoc.iu.edu || utah-pg-plastic-108-b || server=10.42.108.27 || || of-planet1.stanford.edu || planetlab4.clemson.edu || server=10.42.108.104 || || utah-pg-plastic-108-a || of-planet2.stanford.edu || server=10.42.108.91 || == Commands run on each server == {{{ server= nice -n 19 iperf -u -B $server -p 5108 -s -i 1 }}} == Commands run on each client == {{{ server= nice -n 19 iperf -u -c $server -p 5108 -t 518400 -b 3M }}} == Results == Generated with {{{ subnet=108 for login in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt) do user=$(echo $login | sed -r -e 's/@.+//') host=$(echo $login | sed -r -e 's/.+@//') echo -e "$host:\n\n{{{" ; grep -a -A 10 -B 1 "Client connecting" $user\@$host.log ; echo -e "}}}\n" done }}} and then edited slightly to remove artifacts (like control characters, my prompt, etc). gardil.gpolab.bbn.com: {{{ ------------------------------------------------------------ Client connecting to 10.42.108.73, UDP port 5108 Sending 1470 byte datagrams UDP buffer size: 110 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.108.52 port 56210 connected with 10.42.108.73 port 5108 [ 3] 0.0-518400.0 sec 181 GBytes 3.00 Mbits/sec [ 3] Sent 132242416 datagrams [ 3] Server Report: [ 3] 0.0-518396.2 sec 180 GBytes 2.98 Mbits/sec 0.018 ms 912958/132242415 (0.69%) [ 3] 0.0-518396.2 sec 16408 datagrams received out-of-order }}} planetlab5.clemson.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.108.100, UDP port 5108 Sending 1470 byte datagrams UDP buffer size: 110 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.108.105 port 57493 connected with 10.42.108.100 port 5108 [ ID] Interval Transfer Bandwidth [ 3] 0.0-518400.0 sec 181 GBytes 3.00 Mbits/sec [ 3] Sent 132244899 datagrams [ 3] Server Report: [ 3] 0.0-518399.1 sec 179 GBytes 2.96 Mbits/sec 0.986 ms 1684667/132244899 (1.3%) [ 3] 0.0-518399.1 sec 3247 datagrams received out-of-order }}} plnode2.cip.gatech.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.108.51, UDP port 5108 Sending 1470 byte datagrams UDP buffer size: 122 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.108.101 port 32916 connected with 10.42.108.51 port 5108 [ 3] 0.0-518400.0 sec 181 GBytes 3.00 Mbits/sec [ 3] Sent 132240843 datagrams [ 3] Server Report: [ 3] 0.0-518396.7 sec 178 GBytes 2.94 Mbits/sec 0.167 ms 2567854/132240842 (1.9%) [ 3] 0.0-518396.7 sec 4615 datagrams received out-of-order }}} pl4.myplc.grnoc.iu.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.108.27, UDP port 5108 Sending 1470 byte datagrams UDP buffer size: 110 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.108.72 port 39731 connected with 10.42.108.27 port 5108 [ 3] 0.0-518400.0 sec 181 GBytes 3.00 Mbits/sec [ 3] Sent 132243713 datagrams [ 3] Server Report: [ 3] 0.0-518388.2 sec 179 GBytes 2.97 Mbits/sec 0.123 ms 1242191/132243713 (0.94%) [ 3] 0.0-518388.2 sec 10252 datagrams received out-of-order }}} of-planet1.stanford.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.108.104, UDP port 5108 Sending 1470 byte datagrams UDP buffer size: 110 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.108.90 port 59215 connected with 10.42.108.104 port 5108 [ ID] Interval Transfer Bandwidth [ 3] 0.0-518400.0 sec 181 GBytes 3.00 Mbits/sec [ 3] Sent 132238474 datagrams [ 3] Server Report: [ 3] 0.0-518396.1 sec 180 GBytes 2.98 Mbits/sec 0.069 ms 926567/132238474 (0.7%) [ 3] 0.0-518396.1 sec 8586 datagrams received out-of-order }}} utah-pg-plastic-108-a: {{{ ------------------------------------------------------------ Client connecting to 10.42.108.91, UDP port 5108 Sending 1470 byte datagrams UDP buffer size: 136 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.108.26 port 56945 connected with 10.42.108.91 port 5108 [ ID] Interval Transfer Bandwidth [ 3] 0.0-518400.0 sec 181 GBytes 3.00 Mbits/sec [ 3] Sent 132244899 datagrams [ 3] Server Report: [ 3] 0.0-518393.6 sec 180 GBytes 2.98 Mbits/sec 1.354 ms 961426/132244898 (0.73%) [ 3] 0.0-518393.6 sec 79034 datagrams received out-of-order }}} == Comments == Packet loss numbers, in order: {{{ BBN -> Indiana [ 3] 0.0-518396.2 sec 180 GBytes 2.98 Mbits/sec 0.018 ms 912958/132242415 (0.69%) Stanford -> Clemson [ 3] 0.0-518396.1 sec 180 GBytes 2.98 Mbits/sec 0.069 ms 926567/132238474 (0.7%) Utah -> Stanford [ 3] 0.0-518393.6 sec 180 GBytes 2.98 Mbits/sec 1.354 ms 961426/132244898 (0.73%) Indiana -> Utah [ 3] 0.0-518388.2 sec 179 GBytes 2.97 Mbits/sec 0.123 ms 1242191/132243713 (0.94%) Clemson -> GT [ 3] 0.0-518399.1 sec 179 GBytes 2.96 Mbits/sec 0.986 ms 1684667/132244899 (1.3%) GT -> BBN [ 3] 0.0-518396.7 sec 178 GBytes 2.94 Mbits/sec 0.167 ms 2567854/132240842 (1.9%) }}} GT again tops the list, although again not by much. = plastic-109 = [ggw:PlasticSlices/Experiments#SteadyPerfUDP SteadyPerf UDP], using port=5109, time=518400, rate=4, and this table of client/server pairs: || '''client''' || '''server''' || '''server address''' || || gardil.gpolab.bbn.com || utah-pg-plastic-109-b || server=10.42.109.27 || || planetlab5.clemson.edu || of-planet1.stanford.edu || server=10.42.109.90 || || plnode1.cip.gatech.edu || pl5.myplc.grnoc.iu.edu || server=10.42.109.73 || || pl4.myplc.grnoc.iu.edu || planetlab4.clemson.edu || server=10.42.109.104 || || of-planet2.stanford.edu || plnode2.cip.gatech.edu || server=10.42.109.101 || || utah-pg-plastic-109-a || ganel.gpolab.bbn.com || server=10.42.109.51 || == Commands run on each server == {{{ server= nice -n 19 iperf -u -B $server -p 5109 -s -i 1 }}} == Commands run on each client == {{{ server= nice -n 19 iperf -u -c $server -p 5109 -t 518400 -b 4M }}} == Results == Generated with {{{ subnet=109 for login in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt) do user=$(echo $login | sed -r -e 's/@.+//') host=$(echo $login | sed -r -e 's/.+@//') echo -e "$host:\n\n{{{" ; grep -a -A 10 -B 1 "Client connecting" $user\@$host.log ; echo -e "}}}\n" done }}} and then edited slightly to remove artifacts (like control characters, my prompt, etc). gardil.gpolab.bbn.com: {{{ ------------------------------------------------------------ Client connecting to 10.42.109.27, UDP port 5109 Sending 1470 byte datagrams UDP buffer size: 110 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.109.52 port 46996 connected with 10.42.109.27 port 5109 [ 3] 0.0-518400.0 sec 241 GBytes 4.00 Mbits/sec [ 3] Sent 176323659 datagrams [ 3] Server Report: [ 3] 0.0-518398.8 sec 240 GBytes 3.98 Mbits/sec 0.596 ms 1000063/176323658 (0.57%) [ 3] 0.0-518398.8 sec 689 datagrams received out-of-order }}} planetlab5.clemson.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.109.90, UDP port 5109 Sending 1470 byte datagrams UDP buffer size: 110 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.109.105 port 45602 connected with 10.42.109.90 port 5109 [ ID] Interval Transfer Bandwidth [ 3] 0.0-518400.0 sec 241 GBytes 4.00 Mbits/sec [ 3] Sent 176326532 datagrams [ 3] Server Report: [ 3] 0.0-518397.9 sec 239 GBytes 3.97 Mbits/sec 0.313 ms 1497231/176326531 (0.85%) [ 3] 0.0-518397.9 sec 14077 datagrams received out-of-order }}} plnode1.cip.gatech.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.109.73, UDP port 5109 Sending 1470 byte datagrams UDP buffer size: 122 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.109.100 port 52256 connected with 10.42.109.73 port 5109 [ 3] 0.0-518400.0 sec 241 GBytes 4.00 Mbits/sec [ 3] Sent 176286647 datagrams [ 3] Server Report: [ 3] 0.0-518398.2 sec 235 GBytes 3.89 Mbits/sec 0.164 ms 4645357/176286646 (2.6%) [ 3] 0.0-518398.2 sec 5451 datagrams received out-of-order }}} pl4.myplc.grnoc.iu.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.109.104, UDP port 5109 Sending 1470 byte datagrams UDP buffer size: 110 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.109.72 port 42950 connected with 10.42.109.104 port 5109 [ 3] 0.0-518400.0 sec 241 GBytes 4.00 Mbits/sec [ 3] Sent 176324957 datagrams [ 3] Server Report: [ 3] 0.0-518395.5 sec 240 GBytes 3.98 Mbits/sec 0.037 ms 1011245/176324956 (0.57%) [ 3] 0.0-518395.5 sec 5674 datagrams received out-of-order }}} of-planet2.stanford.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.109.101, UDP port 5109 Sending 1470 byte datagrams UDP buffer size: 110 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.109.91 port 50722 connected with 10.42.109.101 port 5109 [ ID] Interval Transfer Bandwidth [ 3] 0.0-518400.0 sec 241 GBytes 4.00 Mbits/sec [ 3] Sent 176322764 datagrams [ 3] Server Report: [ 3] 0.0-518398.1 sec 239 GBytes 3.95 Mbits/sec 1.922 ms 2097259/176322763 (1.2%) [ 3] 0.0-518398.1 sec 4921 datagrams received out-of-order }}} utah-pg-plastic-109-a: {{{ ------------------------------------------------------------ Client connecting to 10.42.109.51, UDP port 5109 Sending 1470 byte datagrams UDP buffer size: 136 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.109.26 port 40570 connected with 10.42.109.51 port 5109 [ ID] Interval Transfer Bandwidth [ 3] 0.0-518400.0 sec 241 GBytes 4.00 Mbits/sec [ 3] Sent 176326532 datagrams [ 3] Server Report: [ 3] 0.0-518398.9 sec 240 GBytes 3.98 Mbits/sec 1.022 ms 786796/176326532 (0.45%) [ 3] 0.0-518398.9 sec 792 datagrams received out-of-order }}} == Comments == Packet loss numbers, in order: {{{ Utah -> BBN [ 3] 0.0-518398.9 sec 240 GBytes 3.98 Mbits/sec 1.022 ms 786796/176326532 (0.45%) BBN -> Utah [ 3] 0.0-518398.8 sec 240 GBytes 3.98 Mbits/sec 0.596 ms 1000063/176323658 (0.57%) Indiana -> Clemson [ 3] 0.0-518395.5 sec 240 GBytes 3.98 Mbits/sec 0.037 ms 1011245/176324956 (0.57%) Clemson -> Stanford [ 3] 0.0-518397.9 sec 239 GBytes 3.97 Mbits/sec 0.313 ms 1497231/176326531 (0.85%) Stanford -> GT [ 3] 0.0-518398.1 sec 239 GBytes 3.95 Mbits/sec 1.922 ms 2097259/176322763 (1.2%) GT -> Indiana [ 3] 0.0-518398.2 sec 235 GBytes 3.89 Mbits/sec 0.164 ms 4645357/176286646 (2.6%) }}} GT again tops the list, and significantly worse sending than receiving. = plastic-110 = [ggw:PlasticSlices/Experiments#SteadyPerfUDP SteadyPerf UDP], using port=5110, time=518400, rate=5, and this table of client/server pairs: || '''client''' || '''server''' || '''server address''' || || gardil.gpolab.bbn.com || plnode1.cip.gatech.edu || server=10.42.110.100 || || planetlab5.clemson.edu || ganel.gpolab.bbn.com || server=10.42.110.51 || || plnode2.cip.gatech.edu || utah-pg-plastic-110-a || server=10.42.110.26 || || pl5.myplc.grnoc.iu.edu || of-planet1.stanford.edu || server=10.42.110.90 || || of-planet2.stanford.edu || pl4.myplc.grnoc.iu.edu || server=10.42.110.72 || || utah-pg-plastic-110-b || planetlab4.clemson.edu || server=10.42.110.104 || == Commands run on each server == {{{ server= nice -n 19 iperf -u -B $server -p 5110 -s -i 1 }}} == Commands run on each client == {{{ server= nice -n 19 iperf -u -c $server -p 5110 -t 518400 -b 5M }}} == Results == Generated with {{{ subnet=110 for login in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt) do user=$(echo $login | sed -r -e 's/@.+//') host=$(echo $login | sed -r -e 's/.+@//') echo -e "$host:\n\n{{{" ; grep -a -A 10 -B 1 "Client connecting" $user\@$host.log ; echo -e "}}}\n" done }}} and then edited slightly to remove artifacts (like control characters, my prompt, etc). gardil.gpolab.bbn.com: {{{ ------------------------------------------------------------ Client connecting to 10.42.110.100, UDP port 5110 Sending 1470 byte datagrams UDP buffer size: 110 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.110.52 port 42040 connected with 10.42.110.100 port 5110 [ 3] 0.0-518400.0 sec 302 GBytes 5.00 Mbits/sec [ 3] Sent 220403534 datagrams [ 3] Server Report: [ 3] 0.0-518398.5 sec 298 GBytes 4.94 Mbits/sec 0.025 ms 2722881/220403533 (1.2%) [ 3] 0.0-518398.5 sec 6234 datagrams received out-of-order }}} planetlab5.clemson.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.110.51, UDP port 5110 Sending 1470 byte datagrams UDP buffer size: 110 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.110.105 port 39654 connected with 10.42.110.51 port 5110 [ ID] Interval Transfer Bandwidth [ 3] 0.0-518400.0 sec 302 GBytes 5.00 Mbits/sec [ 3] Sent 220408164 datagrams [ 3] Server Report: [ 3] 0.0-518395.9 sec 300 GBytes 4.96 Mbits/sec 0.028 ms 1555147/220408163 (0.71%) [ 3] 0.0-518395.9 sec 7591 datagrams received out-of-order }}} plnode2.cip.gatech.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.110.26, UDP port 5110 Sending 1470 byte datagrams UDP buffer size: 122 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.110.101 port 43833 connected with 10.42.110.26 port 5110 [ 3] 0.0-518400.0 sec 302 GBytes 5.00 Mbits/sec [ 3] Sent 220360587 datagrams [ 3] Server Report: [ 3] 0.0-518393.5 sec 287 GBytes 4.76 Mbits/sec 0.333 ms 10463889/220360586 (4.7%) [ 3] 0.0-518393.5 sec 6298 datagrams received out-of-order }}} pl5.myplc.grnoc.iu.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.110.90, UDP port 5110 Sending 1470 byte datagrams UDP buffer size: 110 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.110.73 port 60890 connected with 10.42.110.90 port 5110 [ 3] 0.0-518400.0 sec 302 GBytes 5.00 Mbits/sec [ 3] Sent 220405846 datagrams [ 3] Server Report: [ 3] 0.0-518397.2 sec 299 GBytes 4.96 Mbits/sec 0.070 ms 1666392/220405846 (0.76%) [ 3] 0.0-518397.2 sec 22024 datagrams received out-of-order }}} of-planet2.stanford.edu: {{{ ------------------------------------------------------------ Client connecting to 10.42.110.72, UDP port 5110 Sending 1470 byte datagrams UDP buffer size: 110 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.110.91 port 41765 connected with 10.42.110.72 port 5110 [ ID] Interval Transfer Bandwidth [ 3] 0.0-518400.0 sec 302 GBytes 5.00 Mbits/sec [ 3] Sent 220401805 datagrams [ 3] Server Report: [ 3] 0.0-518395.1 sec 300 GBytes 4.97 Mbits/sec 0.626 ms 1264636/220401804 (0.57%) [ 3] 0.0-518395.1 sec 5274 datagrams received out-of-order }}} utah-pg-plastic-110-b: {{{ ------------------------------------------------------------ Client connecting to 10.42.110.104, UDP port 5110 Sending 1470 byte datagrams UDP buffer size: 136 KByte (default) ------------------------------------------------------------ [ 3] local 10.42.110.27 port 46653 connected with 10.42.110.104 port 5110 [ ID] Interval Transfer Bandwidth [ 3] 0.0-518400.0 sec 302 GBytes 5.00 Mbits/sec [ 3] Sent 220408165 datagrams [ 3] Server Report: [ 3] 0.0-518394.5 sec 300 GBytes 4.97 Mbits/sec 0.829 ms 1374058/220408165 (0.62%) [ 3] 0.0-518394.5 sec 6107 datagrams received out-of-order }}} == Comments == Packet loss numbers, in order: {{{ Stanford -> Indiana [ 3] 0.0-518395.1 sec 300 GBytes 4.97 Mbits/sec 0.626 ms 1264636/220401804 (0.57%) Utah -> Clemson [ 3] 0.0-518394.5 sec 300 GBytes 4.97 Mbits/sec 0.829 ms 1374058/220408165 (0.62%) Clemson -> BBN [ 3] 0.0-518395.9 sec 300 GBytes 4.96 Mbits/sec 0.028 ms 1555147/220408163 (0.71%) Indiana -> Stanford [ 3] 0.0-518397.2 sec 299 GBytes 4.96 Mbits/sec 0.070 ms 1666392/220405846 (0.76%) BBN -> GT [ 3] 0.0-518398.5 sec 298 GBytes 4.94 Mbits/sec 0.025 ms 2722881/220403533 (1.2%) GT -> Utah [ 3] 0.0-518393.5 sec 287 GBytes 4.76 Mbits/sec 0.333 ms 10463889/220360586 (4.7%) }}} GT again tops the list, and significantly worse sending than receiving.