wiki:PlasticSlices/Continuation/Weekly03

Version 6 (modified by Josh Smift, 12 years ago) (diff)

--

Continuation Week 03

This is the third of a set of week-long continuation runs. It's similar to Week 02, but drops Washington MyPLC (which had been unreliable recently) and adds Utah ProtoGENI.

The hostpair tables list hostnames when they're short, or SSH aliases (from my ~/.ssh/config file) when they're not. The ssh config aliases are in the log directory below.

There was an outage during this run when the system where I run my OpenFlow controllers needed to be rebooted for OS updates. The iperf clients in the SteadyPerf TCP slices (plastic-103 - plastic-106) all either died or hung as a result, and had to be restarted, which is why there are two sets of results for each of them.

The raw logs are at http://www.gpolab.bbn.com/plastic-slices/continuation/weekly-03/.

plastic-101

SteadyPing, using interval=.005, and this table of client/server pairs:

client server server address
ganel.gpolab.bbn.com planetlab5.clemson.edu server=10.42.101.105
planetlab4.clemson.edu utah-pg-plastic-101-b server=10.42.101.27
plnode1.cip.gatech.edu of-planet2.stanford.edu server=10.42.101.91
pl4.myplc.grnoc.iu.edu plnode2.cip.gatech.edu server=10.42.101.101
of-planet1.stanford.edu gardil.gpolab.bbn.com server=10.42.101.52
utah-pg-plastic-101-a pl5.myplc.grnoc.iu.edu server=10.42.101.73

Commands run on each client

server=<ipaddr>
sudo ping -q -i .005 -s $((1500-8-20)) $server

Results

Generated from the logs with

subnet=101
for login in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt)
do
  user=$(echo $login | sed -r -e 's/@.+//')
  host=$(echo $login | sed -r -e 's/.+@//')
  echo -e "$host:\n\n{{{" ; grep -A 2 statistics $user\@$host.log ; echo -e "}}}\n"
done

ganel.gpolab.bbn.com:

--- 10.42.101.105 ping statistics ---
52912352 packets transmitted, 52625407 received, +2182 errors, 0% packet loss, time 525285486ms
rtt min/avg/max/mdev = 137.966/138.131/10556.125/18.894 ms, pipe 1226

planetlab4.clemson.edu:

--- 10.42.101.27 ping statistics ---
59304093 packets transmitted, 58925698 received, +2196 errors, 0% packet loss, time 525345062ms
rtt min/avg/max/mdev = 82.694/84.777/9713.411/20.931 ms, pipe 965

plnode1.cip.gatech.edu:

--- 10.42.101.91 ping statistics ---
54627481 packets transmitted, 54002781 received, +5322 errors, 1% packet loss, time 525329638ms
rtt min/avg/max/mdev = 67.189/70.033/11352.405/19.352 ms, pipe 1174

pl4.myplc.grnoc.iu.edu:

--- 10.42.101.101 ping statistics ---
55309178 packets transmitted, 52825622 received, +5265 errors, 4% packet loss, time 525309417ms
rtt min/avg/max/mdev = 37.416/38.717/11372.391/29.549 ms, pipe 1184

of-planet1.stanford.edu:

--- 10.42.101.52 ping statistics ---
55991355 packets transmitted, 55590872 received, +2505 errors, 0% packet loss, time 525298229ms
rtt min/avg/max/mdev = 201.710/202.998/15193.378/41.534 ms, pipe 1569

utah-pg-plastic-101-a:

--- 10.42.101.73 ping statistics ---
54985862 packets transmitted, 54603195 received, +2172 errors, 0% packet loss, time 525292180ms
rtt min/avg/max/mdev = 116.647/118.720/18826.632/35.162 ms, pipe 1859

Comments

Indiana -> GT had a lot of packet loss, and GT -> Stanford had some as well.

plastic-102

SteadyPing, using interval=.005, and this table of client/server pairs:

client server server address
ganel.gpolab.bbn.com plnode2.cip.gatech.edu server=10.42.102.101
planetlab5.clemson.edu gardil.gpolab.bbn.com server=10.42.102.52
plnode1.cip.gatech.edu utah-pg-plastic-102-a server=10.42.102.26
pl5.myplc.grnoc.iu.edu of-planet2.stanford.edu server=10.42.102.91
of-planet1.stanford.edu pl4.myplc.grnoc.iu.edu server=10.42.102.72
utah-pg-plastic-102-b planetlab4.clemson.edu server=10.42.102.104

Commands run on each client

server=<ipaddr>
sudo ping -q -i .005 -s $((1500-8-20)) $server

Results

Generated from the logs with

subnet=102
for login in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt)
do
  user=$(echo $login | sed -r -e 's/@.+//')
  host=$(echo $login | sed -r -e 's/.+@//')
  echo -e "$host:\n\n{{{" ; grep -A 2 statistics $user\@$host.log ; echo -e "}}}\n"
done

ganel.gpolab.bbn.com:

--- 10.42.102.101 ping statistics ---
56322663 packets transmitted, 53814596 received, +6163 errors, 4% packet loss, time 525288395ms
rtt min/avg/max/mdev = 24.620/25.861/9819.198/20.373 ms, pipe 884

planetlab5.clemson.edu:

--- 10.42.102.52 ping statistics ---
58117224 packets transmitted, 57811428 received, +2229 errors, 0% packet loss, time 525507418ms
rtt min/avg/max/mdev = 27.016/27.184/10009.308/17.413 ms, pipe 1077

plnode1.cip.gatech.edu:

--- 10.42.102.26 ping statistics ---
54496109 packets transmitted, 53694530 received, +6204 errors, 1% packet loss, time 525493972ms
rtt min/avg/max/mdev = 117.559/120.989/11362.959/23.518 ms, pipe 1127

pl5.myplc.grnoc.iu.edu:

--- 10.42.102.91 ping statistics ---
58080188 packets transmitted, 57808597 received, +2361 errors, 0% packet loss, time 525476457ms
rtt min/avg/max/mdev = 78.318/79.711/6480.512/16.264 ms, pipe 592

of-planet1.stanford.edu:

--- 10.42.102.72 ping statistics ---
58668048 packets transmitted, 58318385 received, +2400 errors, 0% packet loss, time 525467981ms
rtt min/avg/max/mdev = 78.335/79.536/20525.339/35.694 ms, pipe 2374

utah-pg-plastic-102-b:

--- 10.42.102.104 ping statistics ---
54624483 packets transmitted, 53876310 received, +2208 errors, 1% packet loss, time 525448716ms
rtt min/avg/max/mdev = 119.938/121.951/12206.465/22.701 ms, pipe 1240

Comments

BBN -> GT had a lot of packet loss, and GT -> Utah had some as well.

plastic-103

SteadyPerf TCP, using port=5103, time=518400, and this table of client/server pairs:

client server server address
gardil.gpolab.bbn.com plnode1.cip.gatech.edu server=10.42.103.100
planetlab4.clemson.edu ganel.gpolab.bbn.com server=10.42.103.51
plnode2.cip.gatech.edu utah-pg-plastic-103-b server=10.42.103.27
pl4.myplc.grnoc.iu.edu of-planet1.stanford.edu server=10.42.103.90
of-planet2.stanford.edu pl5.myplc.grnoc.iu.edu server=10.42.103.73
utah-pg-plastic-103-a planetlab5.clemson.edu server=10.42.103.105

Commands run on each server

server=<ipaddr>
nice -n 19 iperf -B $server -p 5103 -s -i 1 -w 1m

Commands run on each client

server=<ipaddr>
nice -n 19 iperf -c $server -p 5103 -t 518400 -w 1m

Results

Generated with

subnet=103
for login in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt)
do
  user=$(echo $login | sed -r -e 's/@.+//')
  host=$(echo $login | sed -r -e 's/.+@//')
  echo -e "$host:\n\n{{{" ; grep -a -A 5 -B 1 "Client connecting" $user\@$host.log ; echo -e "}}}\n"
done

and then edited slightly to remove artifacts (like control characters, my prompt, etc).

gardil.gpolab.bbn.com:

------------------------------------------------------------
Client connecting to 10.42.103.100, TCP port 5103
TCP window size:   256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.103.52 port 60886 connected with 10.42.103.100 port 5103
write2 failed: No route to host
[  3]  0.0-371094.0 sec    434 GBytes  10.0 Mbits/sec
--
------------------------------------------------------------
Client connecting to 10.42.103.100, TCP port 5103
TCP window size:   256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.103.52 port 60031 connected with 10.42.103.100 port 5103
write2 failed: No route to host
[  3]  0.0-6754.9 sec  6.76 GBytes  8.60 Mbits/sec

planetlab4.clemson.edu:

------------------------------------------------------------
Client connecting to 10.42.103.51, TCP port 5103
TCP window size:  256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.103.104 port 49457 connected with 10.42.103.51 port 5103
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-439460.5 sec  1872893339255434496 bits  0.00 (null)s/sec
--
------------------------------------------------------------
Client connecting to 10.42.103.51, TCP port 5103
TCP window size:  256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.103.104 port 50430 connected with 10.42.103.51 port 5103
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-85977.8 sec  35.9 GBytes  3.59 Mbits/sec

plnode2.cip.gatech.edu:

------------------------------------------------------------
Client connecting to 10.42.103.27, TCP port 5103
TCP window size:   256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.103.101 port 60598 connected with 10.42.103.27 port 5103
write2 failed: No route to host
[  3]  0.0-371067.6 sec  39.3 GBytes    911 Kbits/sec
--
------------------------------------------------------------
Client connecting to 10.42.103.27, TCP port 5103
TCP window size:   256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.103.101 port 45427 connected with 10.42.103.27 port 5103
write2 failed: No route to host
[  3]  0.0-6289.2 sec    748 MBytes    997 Kbits/sec

pl4.myplc.grnoc.iu.edu:

------------------------------------------------------------
Client connecting to 10.42.103.90, TCP port 5103
TCP window size:   256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.103.72 port 34451 connected with 10.42.103.90 port 5103
write2 failed: No route to host
[  3]  0.0-371081.2 sec    309 GBytes  7.14 Mbits/sec
--
------------------------------------------------------------
Client connecting to 10.42.103.90, TCP port 5103
TCP window size:   256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.103.72 port 48334 connected with 10.42.103.90 port 5103
[  3]  0.0-85974.8 sec  82.3 GBytes  8.22 Mbits/sec

of-planet2.stanford.edu:

------------------------------------------------------------
Client connecting to 10.42.103.73, TCP port 5103
TCP window size:  256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.103.91 port 54556 connected with 10.42.103.73 port 5103
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-439495.4 sec  180079025129797024 bits  0.00 (null)s/sec
--
------------------------------------------------------------
Client connecting to 10.42.103.73, TCP port 5103
TCP window size:  256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.103.91 port 48395 connected with 10.42.103.73 port 5103
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-85967.8 sec   109 GBytes  10.9 Mbits/sec

utah-pg-plastic-103-a:

------------------------------------------------------------
Client connecting to 10.42.103.105, TCP port 5103
TCP window size:  256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.103.26 port 49384 connected with 10.42.103.105 port 5103
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-439515.0 sec   725 GBytes  14.2 Mbits/sec
--
------------------------------------------------------------
Client connecting to 10.42.103.105, TCP port 5103
TCP window size:  256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.103.26 port 49583 connected with 10.42.103.105 port 5103
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-85955.8 sec   171 GBytes  17.1 Mbits/sec

Comments

There was an outage during this run when the system where I run my OpenFlow controllers needed to be rebooted for OS updates. The iperf clients all either died or hung as a result, and had to be restarted, which is why there are two sets of results for each of them.

The Fedora 12 iperf client (at Clemson and Stanford) sometimes reports nonsensical bandwidth results if the client dies or hangs.

Very low bandwidth from GT -> Utah; much lower than any of the others.

plastic-104

SteadyPerf TCP, using port=5104, time=518400, and this table of client/server pairs:

client server server address
ganel.gpolab.bbn.com utah-pg-plastic-104-a server=10.42.104.26
planetlab4.clemson.edu of-planet2.stanford.edu server=10.42.104.91
plnode2.cip.gatech.edu pl4.myplc.grnoc.iu.edu server=10.42.104.72
pl5.myplc.grnoc.iu.edu planetlab5.clemson.edu server=10.42.104.105
of-planet1.stanford.edu plnode1.cip.gatech.edu server=10.42.104.100
utah-pg-plastic-104-b gardil.gpolab.bbn.com server=10.42.104.52

Commands run on each server

server=<ipaddr>
nice -n 19 iperf -B $server -p 5104 -s -i 1 -w 1m

Commands run on each client

server=<ipaddr>
nice -n 19 iperf -c $server -p 5104 -t 518400 -w 1m

Results

Generated with

subnet=104
for login in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt)
do
  user=$(echo $login | sed -r -e 's/@.+//')
  host=$(echo $login | sed -r -e 's/.+@//')
  echo -e "$host:\n\n{{{" ; grep -a -A 5 -B 1 "Client connecting" $user\@$host.log ; echo -e "}}}\n"
done

and then edited slightly to remove artifacts (like control characters, my prompt, etc).

ganel.gpolab.bbn.com:

------------------------------------------------------------
Client connecting to 10.42.104.26, TCP port 5104
TCP window size:   256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.104.51 port 45121 connected with 10.42.104.26 port 5104
write2 failed: No route to host
[  3]  0.0-371011.4 sec    374 GBytes  8.67 Mbits/sec
--
------------------------------------------------------------
Client connecting to 10.42.104.26, TCP port 5104
TCP window size:   256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.104.51 port 39544 connected with 10.42.104.26 port 5104
[  3]  0.0-86042.6 sec  90.1 GBytes  8.99 Mbits/sec

planetlab4.clemson.edu:

------------------------------------------------------------
Client connecting to 10.42.104.91, TCP port 5104
TCP window size:  256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.104.104 port 34155 connected with 10.42.104.91 port 5104
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-439464.8 sec  18407172598695016448 bits  0.00 (null)s/sec
--
------------------------------------------------------------
Client connecting to 10.42.104.91, TCP port 5104
TCP window size:  256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.104.104 port 39222 connected with 10.42.104.91 port 5104
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-86031.0 sec  49.9 GBytes  4.98 Mbits/sec

plnode2.cip.gatech.edu:

------------------------------------------------------------
Client connecting to 10.42.104.72, TCP port 5104
TCP window size:   256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.104.101 port 34460 connected with 10.42.104.72 port 5104
write2 failed: No route to host
[  3]  0.0-371023.6 sec  28.9 GBytes    669 Kbits/sec
--
------------------------------------------------------------
Client connecting to 10.42.104.72, TCP port 5104
TCP window size:   256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.104.101 port 54642 connected with 10.42.104.72 port 5104
write2 failed: No route to host
[  3]  0.0-74394.3 sec  5.76 GBytes    665 Kbits/sec

pl5.myplc.grnoc.iu.edu:

------------------------------------------------------------
Client connecting to 10.42.104.105, TCP port 5104
TCP window size:   256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.104.73 port 39853 connected with 10.42.104.105 port 5104
write2 failed: No route to host
[  3]  0.0-253441.4 sec    309 GBytes  10.5 Mbits/sec
--
------------------------------------------------------------
Client connecting to 10.42.104.105, TCP port 5104
TCP window size:   256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.104.73 port 52293 connected with 10.42.104.105 port 5104
[  3]  0.0-86034.9 sec    105 GBytes  10.5 Mbits/sec

of-planet1.stanford.edu:

------------------------------------------------------------
Client connecting to 10.42.104.100, TCP port 5104
TCP window size:  256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.104.90 port 57730 connected with 10.42.104.100 port 5104
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-439503.7 sec  36166123700098040 bits   658 Gbits/sec
--
------------------------------------------------------------
Client connecting to 10.42.104.100, TCP port 5104
TCP window size:  256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.104.90 port 33380 connected with 10.42.104.100 port 5104
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-86021.8 sec  3159591055125393920 bits  0.00 (null)s/sec

utah-pg-plastic-104-b:

------------------------------------------------------------
Client connecting to 10.42.104.52, TCP port 5104
TCP window size:  256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.104.27 port 44734 connected with 10.42.104.52 port 5104
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-439529.2 sec   576 GBytes  11.3 Mbits/sec
--
------------------------------------------------------------
Client connecting to 10.42.104.52, TCP port 5104
TCP window size:  256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.104.27 port 44960 connected with 10.42.104.52 port 5104
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-86017.1 sec   137 GBytes  13.7 Mbits/sec

Comments

There was an outage during this run when the system where I run my OpenFlow controllers needed to be rebooted for OS updates. The iperf clients all either died or hung as a result, and had to be restarted, which is why there are two sets of results for each of them.

The Fedora 12 iperf client (at Clemson and Stanford) sometimes reports nonsensical bandwidth results if the client dies or hangs.

Very low bandwidth from GT -> Indiana; much lower than any of the others.

plastic-105

SteadyPerf TCP, using port=5105, time=518400, and this table of client/server pairs:

client server server address
ganel.gpolab.bbn.com pl4.myplc.grnoc.iu.edu server=10.42.105.72
planetlab4.clemson.edu plnode2.cip.gatech.edu server=10.42.105.101
plnode1.cip.gatech.edu gardil.gpolab.bbn.com server=10.42.105.52
pl5.myplc.grnoc.iu.edu utah-pg-plastic-105-a server=10.42.105.26
of-planet2.stanford.edu planetlab5.clemson.edu server=10.42.105.105
utah-pg-plastic-105-b of-planet1.stanford.edu server=10.42.105.90

Commands run on each server

server=<ipaddr>
nice -n 19 iperf -B $server -p 5105 -s -i 1 -w 1m

Commands run on each client

server=<ipaddr>
nice -n 19 iperf -c $server -p 5105 -t 518400 -w 1m

Results

Generated with

subnet=105
for login in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt)
do
  user=$(echo $login | sed -r -e 's/@.+//')
  host=$(echo $login | sed -r -e 's/.+@//')
  echo -e "$host:\n\n{{{" ; grep -a -A 5 -B 1 "Client connecting" $user\@$host.log ; echo -e "}}}\n"
done

and then edited slightly to remove artifacts (like control characters, my prompt, etc).

ganel.gpolab.bbn.com:

------------------------------------------------------------
Client connecting to 10.42.105.72, TCP port 5105
TCP window size:   256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.105.51 port 38170 connected with 10.42.105.72 port 5105
write2 failed: No route to host
[  3]  0.0-370958.8 sec    350 GBytes  8.10 Mbits/sec
--
------------------------------------------------------------
Client connecting to 10.42.105.72, TCP port 5105
TCP window size:   256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.105.51 port 33908 connected with 10.42.105.72 port 5105
[  3]  0.0-86017.0 sec  81.1 GBytes  8.10 Mbits/sec

planetlab4.clemson.edu:

------------------------------------------------------------
Client connecting to 10.42.105.101, TCP port 5105
TCP window size:  256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.105.104 port 43143 connected with 10.42.105.101 port 5105
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-439505.1 sec  1935915996601714176 bits  0.00 (null)s/sec
--
------------------------------------------------------------
Client connecting to 10.42.105.101, TCP port 5105
TCP window size:  256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.105.104 port 40462 connected with 10.42.105.101 port 5105
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-86013.7 sec  3481089854294193152 bits  0.00 (null)s/sec

plnode1.cip.gatech.edu:

------------------------------------------------------------
Client connecting to 10.42.105.52, TCP port 5105
TCP window size:   256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.105.100 port 51114 connected with 10.42.105.52 port 5105
write2 failed: No route to host
[  3]  0.0-370953.2 sec  88.2 GBytes  2.04 Mbits/sec
--
------------------------------------------------------------
Client connecting to 10.42.105.52, TCP port 5105
TCP window size:   256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.105.100 port 32994 connected with 10.42.105.52 port 5105
write2 failed: No route to host
[  3]  0.0-74317.8 sec  17.5 GBytes  2.02 Mbits/sec

pl5.myplc.grnoc.iu.edu:

------------------------------------------------------------
Client connecting to 10.42.105.26, TCP port 5105
TCP window size:   256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.105.73 port 41151 connected with 10.42.105.26 port 5105
write2 failed: No route to host
[  3]  0.0-370920.4 sec    338 GBytes  7.83 Mbits/sec
--
------------------------------------------------------------
Client connecting to 10.42.105.26, TCP port 5105
TCP window size:   256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.105.73 port 43970 connected with 10.42.105.26 port 5105
[  3]  0.0-86010.2 sec  82.8 GBytes  8.27 Mbits/sec

of-planet2.stanford.edu:

------------------------------------------------------------
Client connecting to 10.42.105.105, TCP port 5105
TCP window size:  256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.105.91 port 51978 connected with 10.42.105.105 port 5105
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-439538.8 sec  234151794153822656 bits  0.00 (null)s/sec
--
------------------------------------------------------------
Client connecting to 10.42.105.105, TCP port 5105
TCP window size:  256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.105.91 port 52266 connected with 10.42.105.105 port 5105
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-86002.4 sec   162 GBytes  16.2 Mbits/sec

utah-pg-plastic-105-b:

------------------------------------------------------------
Client connecting to 10.42.105.90, TCP port 5105
TCP window size:  256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.105.27 port 54878 connected with 10.42.105.90 port 5105
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-439545.6 sec   339 GBytes  6.63 Mbits/sec
--
------------------------------------------------------------
Client connecting to 10.42.105.90, TCP port 5105
TCP window size:  256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.105.27 port 55075 connected with 10.42.105.90 port 5105
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-86000.1 sec  80.6 GBytes  8.05 Mbits/sec

Comments

There was an outage during this run when the system where I run my OpenFlow controllers needed to be rebooted for OS updates. The iperf clients all either died or hung as a result, and had to be restarted, which is why there are two sets of results for each of them.

The Fedora 12 iperf client (at Clemson and Stanford) sometimes reports nonsensical bandwidth results if the client dies or hangs.

Very low bandwidth from GT -> BBN, although not as much lower as in some of the other slices.

plastic-106

SteadyPerf TCP, using port=5106, time=518400, and this table of client/server pairs:

client server server address
ganel.gpolab.bbn.com of-planet2.stanford.edu server=10.42.106.91
planetlab5.clemson.edu pl5.myplc.grnoc.iu.edu server=10.42.106.73
plnode2.cip.gatech.edu planetlab4.clemson.edu server=10.42.106.104
pl4.myplc.grnoc.iu.edu gardil.gpolab.bbn.com server=10.42.106.52
of-planet1.stanford.edu utah-pg-plastic-106-a server=10.42.106.26
utah-pg-plastic-106-b plnode1.cip.gatech.edu server=10.42.106.100

Commands run on each server

server=<ipaddr>
nice -n 19 iperf -B $server -p 5106 -s -i 1 -w 1m

Commands run on each client

server=<ipaddr>
nice -n 19 iperf -c $server -p 5106 -t 518400 -w 1m

Results

Generated with

subnet=106
for login in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt)
do
  user=$(echo $login | sed -r -e 's/@.+//')
  host=$(echo $login | sed -r -e 's/.+@//')
  echo -e "$host:\n\n{{{" ; grep -a -A 5 -B 1 "Client connecting" $user\@$host.log ; echo -e "}}}\n"
done

and then edited slightly to remove artifacts (like control characters, my prompt, etc).

ganel.gpolab.bbn.com:

------------------------------------------------------------
Client connecting to 10.42.106.91, TCP port 5106
TCP window size:   256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.106.51 port 48531 connected with 10.42.106.91 port 5106
write2 failed: No route to host
[  3]  0.0-370915.6 sec    654 GBytes  15.1 Mbits/sec
--
------------------------------------------------------------
Client connecting to 10.42.106.91, TCP port 5106
TCP window size:   256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.106.51 port 60131 connected with 10.42.106.91 port 5106
[  3]  0.0-86020.0 sec    147 GBytes  14.7 Mbits/sec

planetlab5.clemson.edu:

------------------------------------------------------------
Client connecting to 10.42.106.73, TCP port 5106
TCP window size:  256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.106.105 port 35646 connected with 10.42.106.73 port 5106
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-439534.2 sec  1967638614995821568 bits  0.00 (null)s/sec
--
------------------------------------------------------------
Client connecting to 10.42.106.73, TCP port 5106
TCP window size:  256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.106.105 port 33150 connected with 10.42.106.73 port 5106
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-86019.5 sec  39.3 GBytes  3.93 Mbits/sec

plnode2.cip.gatech.edu:

------------------------------------------------------------
Client connecting to 10.42.106.104, TCP port 5106
TCP window size:   256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.106.101 port 47772 connected with 10.42.106.104 port 5106
write2 failed: No route to host
[  3]  0.0-370884.6 sec    721 GBytes  16.7 Mbits/sec
--
------------------------------------------------------------
Client connecting to 10.42.106.104, TCP port 5106
TCP window size:   256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.106.101 port 38622 connected with 10.42.106.104 port 5106
write2 failed: No route to host
[  3]  0.0-74206.2 sec    163 GBytes  18.9 Mbits/sec

pl4.myplc.grnoc.iu.edu:

------------------------------------------------------------
Client connecting to 10.42.106.52, TCP port 5106
TCP window size:   256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.106.72 port 52018 connected with 10.42.106.52 port 5106
write2 failed: No route to host
[  3]  0.0-370904.9 sec    352 GBytes  8.14 Mbits/sec
--
------------------------------------------------------------
Client connecting to 10.42.106.52, TCP port 5106
TCP window size:   256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.106.72 port 59793 connected with 10.42.106.52 port 5106
[  3]  0.0-86023.9 sec  82.4 GBytes  8.23 Mbits/sec

of-planet1.stanford.edu:

------------------------------------------------------------
Client connecting to 10.42.106.26, TCP port 5106
TCP window size:  256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.106.90 port 33217 connected with 10.42.106.26 port 5106
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-439558.7 sec  26251700480309168 bits   478 Gbits/sec
--
------------------------------------------------------------
Client connecting to 10.42.106.26, TCP port 5106
TCP window size:  256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.106.90 port 48326 connected with 10.42.106.26 port 5106
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-86019.4 sec  46.0 GBytes  4.60 Mbits/sec

utah-pg-plastic-106-b:

------------------------------------------------------------
Client connecting to 10.42.106.100, TCP port 5106
TCP window size:  256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.106.27 port 50300 connected with 10.42.106.100 port 5106
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-439579.1 sec   496 GBytes  9.69 Mbits/sec
--
------------------------------------------------------------
Client connecting to 10.42.106.100, TCP port 5106
TCP window size:  256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.106.27 port 50488 connected with 10.42.106.100 port 5106
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-86010.9 sec  99.8 GBytes  9.97 Mbits/sec

Comments

There was an outage during this run when the system where I run my OpenFlow controllers needed to be rebooted for OS updates. The iperf clients all either died or hung as a result, and had to be restarted, which is why there are two sets of results for each of them.

The Fedora 12 iperf client (at Clemson and Stanford) sometimes reports nonsensical bandwidth results if the client dies or hangs.

GT -> Clemson was not low at all, which is interesting, in that it perhaps suggests that the problem isn't strictly at GT.

plastic-107

SteadyPerf UDP, using port=5107, time=518400, rate=2, and this table of client/server pairs:

client server server address
gardil.gpolab.bbn.com of-planet1.stanford.edu server=10.42.107.90
planetlab4.clemson.edu pl4.myplc.grnoc.iu.edu server=10.42.107.72
plnode1.cip.gatech.edu planetlab5.clemson.edu server=10.42.107.105
pl5.myplc.grnoc.iu.edu ganel.gpolab.bbn.com server=10.42.107.51
of-planet2.stanford.edu utah-pg-plastic-107-b server=10.42.107.27
utah-pg-plastic-107-a plnode2.cip.gatech.edu server=10.42.107.101

Commands run on each server

server=<ipaddr>
nice -n 19 iperf -u -B $server -p 5107 -s -i 1

Commands run on each client

server=<ipaddr>
nice -n 19 iperf -u -c $server -p 5107 -t 518400 -b 2M

Results

Generated with

subnet=107
for login in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt)
do
  user=$(echo $login | sed -r -e 's/@.+//')
  host=$(echo $login | sed -r -e 's/.+@//')
  echo -e "$host:\n\n{{{" ; grep -a -A 10 -B 1 "Client connecting" $user\@$host.log ; echo -e "}}}\n"
done

and then edited slightly to remove artifacts (like control characters, my prompt, etc).

gardil.gpolab.bbn.com:

------------------------------------------------------------
Client connecting to 10.42.107.90, UDP port 5107
Sending 1470 byte datagrams
UDP buffer size:   110 KByte (default)
------------------------------------------------------------
[  3] local 10.42.107.52 port 59378 connected with 10.42.107.90 port 5107
[  3]  0.0-518400.0 sec    121 GBytes  2.00 Mbits/sec
[  3] Sent 88163125 datagrams
[  3] Server Report:
[  3]  0.0-518397.3 sec    120 GBytes  1.98 Mbits/sec  0.194 ms 740534/88163124 (0.84%)
[  3]  0.0-518397.3 sec  11037 datagrams received out-of-order

planetlab4.clemson.edu:

------------------------------------------------------------
Client connecting to 10.42.107.72, UDP port 5107
Sending 1470 byte datagrams
UDP buffer size:  110 KByte (default)
------------------------------------------------------------
[  3] local 10.42.107.104 port 34409 connected with 10.42.107.72 port 5107
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-518400.0 sec   121 GBytes  2.00 Mbits/sec
[  3] Sent 88163267 datagrams
[  3] Server Report:
[  3]  0.0-518398.4 sec   119 GBytes  1.98 Mbits/sec   0.037 ms 904942/88163267 (1%)
[  3]  0.0-518398.4 sec  3256 datagrams received out-of-order

plnode1.cip.gatech.edu:

------------------------------------------------------------
Client connecting to 10.42.107.105, UDP port 5107
Sending 1470 byte datagrams
UDP buffer size:   122 KByte (default)
------------------------------------------------------------
[  3] local 10.42.107.100 port 36924 connected with 10.42.107.105 port 5107
[  3]  0.0-518400.0 sec    121 GBytes  2.00 Mbits/sec
[  3] Sent 88160844 datagrams
[  3] Server Report:
[  3]  0.0-518399.1 sec    119 GBytes  1.98 Mbits/sec  0.192 ms 1068799/88160843 (1.2%)
[  3]  0.0-518399.1 sec  1747 datagrams received out-of-order

pl5.myplc.grnoc.iu.edu:

------------------------------------------------------------
Client connecting to 10.42.107.51, UDP port 5107
Sending 1470 byte datagrams
UDP buffer size:   110 KByte (default)
------------------------------------------------------------
[  3] local 10.42.107.73 port 60928 connected with 10.42.107.51 port 5107
[  3]  0.0-518400.0 sec    121 GBytes  2.00 Mbits/sec
[  3] Sent 88163212 datagrams
[  3] Server Report:
[  3]  0.0-518397.5 sec    120 GBytes  1.99 Mbits/sec  0.032 ms 521733/88163211 (0.59%)
[  3]  0.0-518397.5 sec  6307 datagrams received out-of-order

of-planet2.stanford.edu:

------------------------------------------------------------
Client connecting to 10.42.107.27, UDP port 5107
Sending 1470 byte datagrams
UDP buffer size:  110 KByte (default)
------------------------------------------------------------
[  3] local 10.42.107.91 port 36486 connected with 10.42.107.27 port 5107
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-518400.0 sec   121 GBytes  2.00 Mbits/sec
[  3] Sent 88163267 datagrams
[  3] Server Report:
[  3]  0.0-518396.7 sec   120 GBytes  1.98 Mbits/sec   1.463 ms 700326/88163266 (0.79%)
[  3]  0.0-518396.7 sec  7533 datagrams received out-of-order

utah-pg-plastic-107-a:

------------------------------------------------------------
Client connecting to 10.42.107.101, UDP port 5107
Sending 1470 byte datagrams
UDP buffer size:  136 KByte (default)
------------------------------------------------------------
[  3] local 10.42.107.26 port 36011 connected with 10.42.107.101 port 5107
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-518400.0 sec   121 GBytes  2.00 Mbits/sec
[  3] Sent 88163267 datagrams
[  3] Server Report:
[  3]  0.0-518397.8 sec   119 GBytes  1.98 Mbits/sec   1.733 ms 1070500/88163266 (1.2%)
[  3]  0.0-518397.8 sec  3680 datagrams received out-of-order

Comments

Packet loss numbers, in order:

Indiana    -> BBN        [  3]  0.0-518397.5 sec   120 GBytes  1.99 Mbits/sec   0.032 ms  521733/88163211 (0.59%)
Stanford   -> Utah       [  3]  0.0-518396.7 sec   120 GBytes  1.98 Mbits/sec   1.463 ms  700326/88163266 (0.79%)
BBN        -> Stanford   [  3]  0.0-518397.3 sec   120 GBytes  1.98 Mbits/sec   0.194 ms  740534/88163124 (0.84%)
Clemson    -> Indiana    [  3]  0.0-518398.4 sec   119 GBytes  1.98 Mbits/sec   0.037 ms  904942/88163267 (1%)
GT         -> Clemson    [  3]  0.0-518399.1 sec   119 GBytes  1.98 Mbits/sec   0.192 ms 1068799/88160843 (1.2%)
Utah       -> GT         [  3]  0.0-518397.8 sec   119 GBytes  1.98 Mbits/sec   1.733 ms 1070500/88163266 (1.2%)

All low, and pretty even.

plastic-108

SteadyPerf UDP, using port=5108, time=518400, rate=3, and this table of client/server pairs:

client server server address
gardil.gpolab.bbn.com pl5.myplc.grnoc.iu.edu server=10.42.108.73
planetlab5.clemson.edu plnode1.cip.gatech.edu server=10.42.108.100
plnode2.cip.gatech.edu ganel.gpolab.bbn.com server=10.42.108.51
pl4.myplc.grnoc.iu.edu utah-pg-plastic-108-b server=10.42.108.27
of-planet1.stanford.edu planetlab4.clemson.edu server=10.42.108.104
utah-pg-plastic-108-a of-planet2.stanford.edu server=10.42.108.91

Commands run on each server

server=<ipaddr>
nice -n 19 iperf -u -B $server -p 5108 -s -i 1

Commands run on each client

server=<ipaddr>
nice -n 19 iperf -u -c $server -p 5108 -t 518400 -b 3M

Results

Generated with

subnet=108
for login in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt)
do
  user=$(echo $login | sed -r -e 's/@.+//')
  host=$(echo $login | sed -r -e 's/.+@//')
  echo -e "$host:\n\n{{{" ; grep -a -A 10 -B 1 "Client connecting" $user\@$host.log ; echo -e "}}}\n"
done

and then edited slightly to remove artifacts (like control characters, my prompt, etc).

gardil.gpolab.bbn.com:

------------------------------------------------------------
Client connecting to 10.42.108.73, UDP port 5108
Sending 1470 byte datagrams
UDP buffer size:   110 KByte (default)
------------------------------------------------------------
[  3] local 10.42.108.52 port 56210 connected with 10.42.108.73 port 5108
[  3]  0.0-518400.0 sec    181 GBytes  3.00 Mbits/sec
[  3] Sent 132242416 datagrams
[  3] Server Report:
[  3]  0.0-518396.2 sec    180 GBytes  2.98 Mbits/sec  0.018 ms 912958/132242415 (0.69%)
[  3]  0.0-518396.2 sec  16408 datagrams received out-of-order

planetlab5.clemson.edu:

------------------------------------------------------------
Client connecting to 10.42.108.100, UDP port 5108
Sending 1470 byte datagrams
UDP buffer size:  110 KByte (default)
------------------------------------------------------------
[  3] local 10.42.108.105 port 57493 connected with 10.42.108.100 port 5108
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-518400.0 sec   181 GBytes  3.00 Mbits/sec
[  3] Sent 132244899 datagrams
[  3] Server Report:
[  3]  0.0-518399.1 sec   179 GBytes  2.96 Mbits/sec   0.986 ms 1684667/132244899 (1.3%)
[  3]  0.0-518399.1 sec  3247 datagrams received out-of-order

plnode2.cip.gatech.edu:

------------------------------------------------------------
Client connecting to 10.42.108.51, UDP port 5108
Sending 1470 byte datagrams
UDP buffer size:   122 KByte (default)
------------------------------------------------------------
[  3] local 10.42.108.101 port 32916 connected with 10.42.108.51 port 5108
[  3]  0.0-518400.0 sec    181 GBytes  3.00 Mbits/sec
[  3] Sent 132240843 datagrams
[  3] Server Report:
[  3]  0.0-518396.7 sec    178 GBytes  2.94 Mbits/sec  0.167 ms 2567854/132240842 (1.9%)
[  3]  0.0-518396.7 sec  4615 datagrams received out-of-order

pl4.myplc.grnoc.iu.edu:

------------------------------------------------------------
Client connecting to 10.42.108.27, UDP port 5108
Sending 1470 byte datagrams
UDP buffer size:   110 KByte (default)
------------------------------------------------------------
[  3] local 10.42.108.72 port 39731 connected with 10.42.108.27 port 5108
[  3]  0.0-518400.0 sec    181 GBytes  3.00 Mbits/sec
[  3] Sent 132243713 datagrams
[  3] Server Report:
[  3]  0.0-518388.2 sec    179 GBytes  2.97 Mbits/sec  0.123 ms 1242191/132243713 (0.94%)
[  3]  0.0-518388.2 sec  10252 datagrams received out-of-order

of-planet1.stanford.edu:

------------------------------------------------------------
Client connecting to 10.42.108.104, UDP port 5108
Sending 1470 byte datagrams
UDP buffer size:  110 KByte (default)
------------------------------------------------------------
[  3] local 10.42.108.90 port 59215 connected with 10.42.108.104 port 5108
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-518400.0 sec   181 GBytes  3.00 Mbits/sec
[  3] Sent 132238474 datagrams
[  3] Server Report:
[  3]  0.0-518396.1 sec   180 GBytes  2.98 Mbits/sec   0.069 ms 926567/132238474 (0.7%)
[  3]  0.0-518396.1 sec  8586 datagrams received out-of-order

utah-pg-plastic-108-a:

------------------------------------------------------------
Client connecting to 10.42.108.91, UDP port 5108
Sending 1470 byte datagrams
UDP buffer size:  136 KByte (default)
------------------------------------------------------------
[  3] local 10.42.108.26 port 56945 connected with 10.42.108.91 port 5108
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-518400.0 sec   181 GBytes  3.00 Mbits/sec
[  3] Sent 132244899 datagrams
[  3] Server Report:
[  3]  0.0-518393.6 sec   180 GBytes  2.98 Mbits/sec   1.354 ms 961426/132244898 (0.73%)
[  3]  0.0-518393.6 sec  79034 datagrams received out-of-order

Comments

Packet loss numbers, in order:

BBN        -> Indiana    [  3]  0.0-518396.2 sec   180 GBytes  2.98 Mbits/sec   0.018 ms  912958/132242415 (0.69%)
Stanford   -> Clemson    [  3]  0.0-518396.1 sec   180 GBytes  2.98 Mbits/sec   0.069 ms  926567/132238474 (0.7%)
Utah       -> Stanford   [  3]  0.0-518393.6 sec   180 GBytes  2.98 Mbits/sec   1.354 ms  961426/132244898 (0.73%)
Indiana    -> Utah       [  3]  0.0-518388.2 sec   179 GBytes  2.97 Mbits/sec   0.123 ms 1242191/132243713 (0.94%)
Clemson    -> GT         [  3]  0.0-518399.1 sec   179 GBytes  2.96 Mbits/sec   0.986 ms 1684667/132244899 (1.3%)
GT         -> BBN        [  3]  0.0-518396.7 sec   178 GBytes  2.94 Mbits/sec   0.167 ms 2567854/132240842 (1.9%)

GT again tops the list, although again not by much.

plastic-109

SteadyPerf UDP, using port=5109, time=518400, rate=4, and this table of client/server pairs:

client server server address
gardil.gpolab.bbn.com utah-pg-plastic-109-b server=10.42.109.27
planetlab5.clemson.edu of-planet1.stanford.edu server=10.42.109.90
plnode1.cip.gatech.edu pl5.myplc.grnoc.iu.edu server=10.42.109.73
pl4.myplc.grnoc.iu.edu planetlab4.clemson.edu server=10.42.109.104
of-planet2.stanford.edu plnode2.cip.gatech.edu server=10.42.109.101
utah-pg-plastic-109-a ganel.gpolab.bbn.com server=10.42.109.51

Commands run on each server

server=<ipaddr>
nice -n 19 iperf -u -B $server -p 5109 -s -i 1

Commands run on each client

server=<ipaddr>
nice -n 19 iperf -u -c $server -p 5109 -t 518400 -b 4M

Results

Generated with

subnet=109
for login in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt)
do
  user=$(echo $login | sed -r -e 's/@.+//')
  host=$(echo $login | sed -r -e 's/.+@//')
  echo -e "$host:\n\n{{{" ; grep -a -A 10 -B 1 "Client connecting" $user\@$host.log ; echo -e "}}}\n"
done

and then edited slightly to remove artifacts (like control characters, my prompt, etc).

gardil.gpolab.bbn.com:

------------------------------------------------------------
Client connecting to 10.42.109.27, UDP port 5109
Sending 1470 byte datagrams
UDP buffer size:   110 KByte (default)
------------------------------------------------------------
[  3] local 10.42.109.52 port 46996 connected with 10.42.109.27 port 5109
[  3]  0.0-518400.0 sec    241 GBytes  4.00 Mbits/sec
[  3] Sent 176323659 datagrams
[  3] Server Report:
[  3]  0.0-518398.8 sec    240 GBytes  3.98 Mbits/sec  0.596 ms 1000063/176323658 (0.57%)
[  3]  0.0-518398.8 sec  689 datagrams received out-of-order

planetlab5.clemson.edu:

------------------------------------------------------------
Client connecting to 10.42.109.90, UDP port 5109
Sending 1470 byte datagrams
UDP buffer size:  110 KByte (default)
------------------------------------------------------------
[  3] local 10.42.109.105 port 45602 connected with 10.42.109.90 port 5109
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-518400.0 sec   241 GBytes  4.00 Mbits/sec
[  3] Sent 176326532 datagrams
[  3] Server Report:
[  3]  0.0-518397.9 sec   239 GBytes  3.97 Mbits/sec   0.313 ms 1497231/176326531 (0.85%)
[  3]  0.0-518397.9 sec  14077 datagrams received out-of-order

plnode1.cip.gatech.edu:

------------------------------------------------------------
Client connecting to 10.42.109.73, UDP port 5109
Sending 1470 byte datagrams
UDP buffer size:   122 KByte (default)
------------------------------------------------------------
[  3] local 10.42.109.100 port 52256 connected with 10.42.109.73 port 5109
[  3]  0.0-518400.0 sec    241 GBytes  4.00 Mbits/sec
[  3] Sent 176286647 datagrams
[  3] Server Report:
[  3]  0.0-518398.2 sec    235 GBytes  3.89 Mbits/sec  0.164 ms 4645357/176286646 (2.6%)
[  3]  0.0-518398.2 sec  5451 datagrams received out-of-order

pl4.myplc.grnoc.iu.edu:

------------------------------------------------------------
Client connecting to 10.42.109.104, UDP port 5109
Sending 1470 byte datagrams
UDP buffer size:   110 KByte (default)
------------------------------------------------------------
[  3] local 10.42.109.72 port 42950 connected with 10.42.109.104 port 5109
[  3]  0.0-518400.0 sec    241 GBytes  4.00 Mbits/sec
[  3] Sent 176324957 datagrams
[  3] Server Report:
[  3]  0.0-518395.5 sec    240 GBytes  3.98 Mbits/sec  0.037 ms 1011245/176324956 (0.57%)
[  3]  0.0-518395.5 sec  5674 datagrams received out-of-order

of-planet2.stanford.edu:

------------------------------------------------------------
Client connecting to 10.42.109.101, UDP port 5109
Sending 1470 byte datagrams
UDP buffer size:  110 KByte (default)
------------------------------------------------------------
[  3] local 10.42.109.91 port 50722 connected with 10.42.109.101 port 5109
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-518400.0 sec   241 GBytes  4.00 Mbits/sec
[  3] Sent 176322764 datagrams
[  3] Server Report:
[  3]  0.0-518398.1 sec   239 GBytes  3.95 Mbits/sec   1.922 ms 2097259/176322763 (1.2%)
[  3]  0.0-518398.1 sec  4921 datagrams received out-of-order

utah-pg-plastic-109-a:

------------------------------------------------------------
Client connecting to 10.42.109.51, UDP port 5109
Sending 1470 byte datagrams
UDP buffer size:  136 KByte (default)
------------------------------------------------------------
[  3] local 10.42.109.26 port 40570 connected with 10.42.109.51 port 5109
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-518400.0 sec   241 GBytes  4.00 Mbits/sec
[  3] Sent 176326532 datagrams
[  3] Server Report:
[  3]  0.0-518398.9 sec   240 GBytes  3.98 Mbits/sec   1.022 ms 786796/176326532 (0.45%)
[  3]  0.0-518398.9 sec  792 datagrams received out-of-order

Comments

Packet loss numbers, in order:

Utah       -> BBN        [  3]  0.0-518398.9 sec   240 GBytes  3.98 Mbits/sec   1.022 ms  786796/176326532 (0.45%)
BBN        -> Utah       [  3]  0.0-518398.8 sec   240 GBytes  3.98 Mbits/sec   0.596 ms 1000063/176323658 (0.57%)
Indiana    -> Clemson    [  3]  0.0-518395.5 sec   240 GBytes  3.98 Mbits/sec   0.037 ms 1011245/176324956 (0.57%)
Clemson    -> Stanford   [  3]  0.0-518397.9 sec   239 GBytes  3.97 Mbits/sec   0.313 ms 1497231/176326531 (0.85%)
Stanford   -> GT         [  3]  0.0-518398.1 sec   239 GBytes  3.95 Mbits/sec   1.922 ms 2097259/176322763 (1.2%)
GT         -> Indiana    [  3]  0.0-518398.2 sec   235 GBytes  3.89 Mbits/sec   0.164 ms 4645357/176286646 (2.6%)

GT again tops the list, and significantly worse sending than receiving.

plastic-110

SteadyPerf UDP, using port=5110, time=518400, rate=5, and this table of client/server pairs:

client server server address
gardil.gpolab.bbn.com plnode1.cip.gatech.edu server=10.42.110.100
planetlab5.clemson.edu ganel.gpolab.bbn.com server=10.42.110.51
plnode2.cip.gatech.edu utah-pg-plastic-110-a server=10.42.110.26
pl5.myplc.grnoc.iu.edu of-planet1.stanford.edu server=10.42.110.90
of-planet2.stanford.edu pl4.myplc.grnoc.iu.edu server=10.42.110.72
utah-pg-plastic-110-b planetlab4.clemson.edu server=10.42.110.104

Commands run on each server

server=<ipaddr>
nice -n 19 iperf -u -B $server -p 5110 -s -i 1

Commands run on each client

server=<ipaddr>
nice -n 19 iperf -u -c $server -p 5110 -t 518400 -b 5M

Results

Generated with

subnet=110
for login in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt)
do
  user=$(echo $login | sed -r -e 's/@.+//')
  host=$(echo $login | sed -r -e 's/.+@//')
  echo -e "$host:\n\n{{{" ; grep -a -A 10 -B 1 "Client connecting" $user\@$host.log ; echo -e "}}}\n"
done

and then edited slightly to remove artifacts (like control characters, my prompt, etc).

gardil.gpolab.bbn.com:

------------------------------------------------------------
Client connecting to 10.42.110.100, UDP port 5110
Sending 1470 byte datagrams
UDP buffer size:   110 KByte (default)
------------------------------------------------------------
[  3] local 10.42.110.52 port 42040 connected with 10.42.110.100 port 5110
[  3]  0.0-518400.0 sec    302 GBytes  5.00 Mbits/sec
[  3] Sent 220403534 datagrams
[  3] Server Report:
[  3]  0.0-518398.5 sec    298 GBytes  4.94 Mbits/sec  0.025 ms 2722881/220403533 (1.2%)
[  3]  0.0-518398.5 sec  6234 datagrams received out-of-order

planetlab5.clemson.edu:

------------------------------------------------------------
Client connecting to 10.42.110.51, UDP port 5110
Sending 1470 byte datagrams
UDP buffer size:  110 KByte (default)
------------------------------------------------------------
[  3] local 10.42.110.105 port 39654 connected with 10.42.110.51 port 5110
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-518400.0 sec   302 GBytes  5.00 Mbits/sec
[  3] Sent 220408164 datagrams
[  3] Server Report:
[  3]  0.0-518395.9 sec   300 GBytes  4.96 Mbits/sec   0.028 ms 1555147/220408163 (0.71%)
[  3]  0.0-518395.9 sec  7591 datagrams received out-of-order

plnode2.cip.gatech.edu:

------------------------------------------------------------
Client connecting to 10.42.110.26, UDP port 5110
Sending 1470 byte datagrams
UDP buffer size:   122 KByte (default)
------------------------------------------------------------
[  3] local 10.42.110.101 port 43833 connected with 10.42.110.26 port 5110
[  3]  0.0-518400.0 sec    302 GBytes  5.00 Mbits/sec
[  3] Sent 220360587 datagrams
[  3] Server Report:
[  3]  0.0-518393.5 sec    287 GBytes  4.76 Mbits/sec  0.333 ms 10463889/220360586 (4.7%)
[  3]  0.0-518393.5 sec  6298 datagrams received out-of-order

pl5.myplc.grnoc.iu.edu:

------------------------------------------------------------
Client connecting to 10.42.110.90, UDP port 5110
Sending 1470 byte datagrams
UDP buffer size:   110 KByte (default)
------------------------------------------------------------
[  3] local 10.42.110.73 port 60890 connected with 10.42.110.90 port 5110
[  3]  0.0-518400.0 sec    302 GBytes  5.00 Mbits/sec
[  3] Sent 220405846 datagrams
[  3] Server Report:
[  3]  0.0-518397.2 sec    299 GBytes  4.96 Mbits/sec  0.070 ms 1666392/220405846 (0.76%)
[  3]  0.0-518397.2 sec  22024 datagrams received out-of-order

of-planet2.stanford.edu:

------------------------------------------------------------
Client connecting to 10.42.110.72, UDP port 5110
Sending 1470 byte datagrams
UDP buffer size:  110 KByte (default)
------------------------------------------------------------
[  3] local 10.42.110.91 port 41765 connected with 10.42.110.72 port 5110
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-518400.0 sec   302 GBytes  5.00 Mbits/sec
[  3] Sent 220401805 datagrams
[  3] Server Report:
[  3]  0.0-518395.1 sec   300 GBytes  4.97 Mbits/sec   0.626 ms 1264636/220401804 (0.57%)
[  3]  0.0-518395.1 sec  5274 datagrams received out-of-order

utah-pg-plastic-110-b:

------------------------------------------------------------
Client connecting to 10.42.110.104, UDP port 5110
Sending 1470 byte datagrams
UDP buffer size:  136 KByte (default)
------------------------------------------------------------
[  3] local 10.42.110.27 port 46653 connected with 10.42.110.104 port 5110
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-518400.0 sec   302 GBytes  5.00 Mbits/sec
[  3] Sent 220408165 datagrams
[  3] Server Report:
[  3]  0.0-518394.5 sec   300 GBytes  4.97 Mbits/sec   0.829 ms 1374058/220408165 (0.62%)
[  3]  0.0-518394.5 sec  6107 datagrams received out-of-order

Comments

Packet loss numbers, in order:

Stanford   -> Indiana    [  3]  0.0-518395.1 sec   300 GBytes  4.97 Mbits/sec   0.626 ms  1264636/220401804 (0.57%)
Utah       -> Clemson    [  3]  0.0-518394.5 sec   300 GBytes  4.97 Mbits/sec   0.829 ms  1374058/220408165 (0.62%)
Clemson    -> BBN        [  3]  0.0-518395.9 sec   300 GBytes  4.96 Mbits/sec   0.028 ms  1555147/220408163 (0.71%)
Indiana    -> Stanford   [  3]  0.0-518397.2 sec   299 GBytes  4.96 Mbits/sec   0.070 ms  1666392/220405846 (0.76%)
BBN        -> GT         [  3]  0.0-518398.5 sec   298 GBytes  4.94 Mbits/sec   0.025 ms  2722881/220403533 (1.2%)
GT         -> Utah       [  3]  0.0-518393.5 sec   287 GBytes  4.76 Mbits/sec   0.333 ms 10463889/220360586 (4.7%)

GT again tops the list, and significantly worse sending than receiving.