wiki:PlasticSlices/Continuation/Round8

Continuation Round 8

In this round, the plan was to run all ten slices on all seven sites (down from eight, because MyPLC at Rutgers is no longer available), for a week.

However, MyPLC and Stanford and Washington also went down, and the slivers there were destroyed after four days. We ended the round at that point, and summarized the results for the hostpairs that don't include Stanford or Washington.

The raw logs are at http://www.gpolab.bbn.com/plastic-slices/continuation/round-8/.

plastic-101

SteadyPing, using interval=.005, and this table of client/server pairs:

client server server address
ganel.gpolab.bbn.com planetlab5.clemson.edu server=10.42.101.105
planetlab4.clemson.edu plnode2.cip.gatech.edu server=10.42.101.101
plnode1.cip.gatech.edu pl5.myplc.grnoc.iu.edu server=10.42.101.73
pl4.myplc.grnoc.iu.edu of-planet2.stanford.edu server=10.42.101.91
of-planet1.stanford.edu pl02.cs.washington.edu server=10.42.101.81
pl01.cs.washington.edu wings-openflow-3.wail.wisc.edu server=10.42.101.96
wings-openflow-2.wail.wisc.edu gardil.gpolab.bbn.com server=10.42.101.52

Commands run on each client

server=<ipaddr>
sudo ping -i .005 -s $((1500-8-20)) $server

Results

Generated from the logs with

subnet=101
for host in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt | sed -r -e 's/.+@//') ; do echo -e "$host:\n\n{{{" ; grep -A 2 statistics pgenigpolabbbncom_plastic$subnet\@$host.log ; echo -e "}}}\n" ; done

ganel.gpolab.bbn.com:

planetlab4.clemson.edu:

plnode1.cip.gatech.edu:

--- 10.42.101.73 ping statistics ---
45637004 packets transmitted, 45611948 received, 0% packet loss, time 433704732ms
rtt min/avg/max/mdev = 37.113/37.959/10464.370/22.181 ms, pipe 1115

pl4.myplc.grnoc.iu.edu:

of-planet1.stanford.edu:

pl01.cs.washington.edu:

wings-openflow-2.wail.wisc.edu:

Comments

The logs for most of the hostpairs were truncated, presumably because they were still being written to disk when the sliver was shut down. Handling the ping logs in this way is proving problematic, and will need to be revisited.

plastic-102

SteadyPing, using interval=.005, and this table of client/server pairs:

client server server address
navis.gpolab.bbn.com planetlab4.clemson.edu server=10.42.102.104
planetlab5.clemson.edu plnode1.cip.gatech.edu server=10.42.102.100
plnode2.cip.gatech.edu pl4.myplc.grnoc.iu.edu server=10.42.102.72
pl5.myplc.grnoc.iu.edu of-planet2.stanford.edu server=10.42.102.91
of-planet1.stanford.edu pl01.cs.washington.edu server=10.42.102.80
pl02.cs.washington.edu wings-openflow-2.wail.wisc.edu server=10.42.102.95
wings-openflow-3.wail.wisc.edu bain.gpolab.bbn.com server=10.42.102.54

Commands run on each client

server=<ipaddr>
sudo ping -i .005 -s $((1500-8-20)) $server

Results

Generated from the logs with

subnet=102
for host in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt | sed -r -e 's/.+@//') ; do echo -e "$host:\n\n{{{" ; grep -A 2 statistics pgenigpolabbbncom_plastic$subnet\@$host.log ; echo -e "}}}\n" ; done

navis.gpolab.bbn.com:

planetlab5.clemson.edu:

plnode2.cip.gatech.edu:

--- 10.42.102.72 ping statistics ---
26026129 packets transmitted, 25994426 received, +15 errors, 0% packet loss, time 433756822ms
rtt min/avg/max/mdev = 143.012/174.997/7253.623/32.581 ms, pipe 434

pl5.myplc.grnoc.iu.edu:

of-planet1.stanford.edu:

pl02.cs.washington.edu:

wings-openflow-3.wail.wisc.edu:

Comments

The logs for most of the hostpairs were truncated, presumably because they were still being written to disk when the sliver was shut down. Handling the ping logs in this way is proving problematic, and will need to be revisited.

plastic-103

SteadyPerf TCP, using port=5103, time=518400, and this table of client/server pairs:

client server server address
sardis.gpolab.bbn.com of-planet1.stanford.edu server=10.42.103.90
of-planet2.stanford.edu pl01.cs.washington.edu server=10.42.103.80
pl02.cs.washington.edu ganel.gpolab.bbn.com server=10.42.103.51

One-time prep commands run on each client and server

sudo yum -y install iperf

Commands run on each server

server=<ipaddr>
nice -n 19 iperf -B $server -p 5103 -s -i 1

Commands run on each client

server=<ipaddr>
nice -n 19 iperf -c $server -p 5103 -t 518400

Results

Generated with

subnet=103
for host in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt | sed -r -e 's/.+@//') ; do echo -e "$host:\n\n{{{" ; grep -a -A 5 -B 1 "Client connecting" pgenigpolabbbncom_plastic$subnet\@$host.log ; echo -e "}}}\n" ; done

and then edited slightly to remove artifacts (like control characters, my prompt, etc).

sardis.gpolab.bbn.com:

------------------------------------------------------------
Client connecting to 10.42.103.90, TCP port 5103
TCP window size: 16.0 KByte (default)
------------------------------------------------------------
[  3] local 10.42.103.53 port 33248 connected with 10.42.103.90 port 5103
[  3]  0.0-301551.2 sec  83.7 GBytes  2.38 Mbits/sec

of-planet2.stanford.edu:

------------------------------------------------------------
Client connecting to 10.42.103.80, TCP port 5103
TCP window size: 16.0 KByte (default)
------------------------------------------------------------
[  3] local 10.42.103.91 port 54003 connected with 10.42.103.80 port 5103

pl02.cs.washington.edu:

------------------------------------------------------------
Client connecting to 10.42.103.51, TCP port 5103
TCP window size: 16.0 KByte (default)
------------------------------------------------------------
[  3] local 10.42.103.81 port 39353 connected with 10.42.103.51 port 5103
[  3]  0.0-301576.8 sec  78.3 GBytes  2.23 Mbits/sec

Comments

Since of-planet2.stanford.edu was connected to pl01.cs.washington.edu, the server log at Washington also doesn't have a summary of stats, although one could in theory be generated from the raw log.

plastic-104

SteadyPerf UDP, using port=5104, time=518400, rate=11, and this table of client/server pairs:

client server server address
ganel.gpolab.bbn.com wings-openflow-2.wail.wisc.edu server=10.42.104.95
pl5.myplc.grnoc.iu.edu sardis.gpolab.bbn.com server=10.42.104.53

One-time prep commands run on each client and server

sudo yum -y install iperf

Commands run on each server

server=<ipaddr>
nice -n 19 iperf -u -B $server -p 5104 -s -i 1

Commands run on each client

server=<ipaddr>
nice -n 19 iperf -u -c $server -p 5104 -t 518400 -b 11M

Results

Generated with

subnet=104
for host in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt | sed -r -e 's/.+@//') ; do echo -e "$host:\n\n{{{" ; grep -A 10 -B 1 "Client connecting" pgenigpolabbbncom_plastic$subnet\@$host.log ; echo -e "}}}\n" ; done

and then edited slightly to remove artifacts (like control characters, my prompt, etc).

ganel.gpolab.bbn.com:

------------------------------------------------------------
Client connecting to 10.42.104.95, UDP port 5104
Sending 1470 byte datagrams
UDP buffer size:   110 KByte (default)
------------------------------------------------------------
[  3] local 10.42.104.51 port 49122 connected with 10.42.104.95 port 5104
[  3]  0.0-433744.2 sec    555 GBytes  11.0 Mbits/sec
[  3] Sent 405738814 datagrams
[  3] Server Report:
[  3]  0.0-433738.2 sec    551 GBytes  10.9 Mbits/sec  0.063 ms 3519647/405738814 (0.87%)
[  3]  0.0-433738.2 sec  18324 datagrams received out-of-order

pl5.myplc.grnoc.iu.edu:

------------------------------------------------------------
Client connecting to 10.42.104.53, UDP port 5104
Sending 1470 byte datagrams
UDP buffer size:   110 KByte (default)
------------------------------------------------------------
[  3] local 10.42.104.73 port 59644 connected with 10.42.104.53 port 5104
[  3]  0.0-433756.3 sec    555 GBytes  11.0 Mbits/sec
[  3] Sent 405753021 datagrams
[  3] Server Report:
[  3]  0.0-433752.7 sec    551 GBytes  10.9 Mbits/sec  0.046 ms 3525373/405753021 (0.87%)
[  3]  0.0-433752.7 sec  22602 datagrams received out-of-order

Comments

There was a blip at Clemson during the run, which might account for the nearly 1% packet loss. (Which isn't a *lot*, but is a little higher than expected.)

plastic-105

SteadyPerf UDP, using port=5105, time=518400, rate=6, and this table of client/server pairs:

client server server address
wings-openflow-2.wail.wisc.edu planetlab5.clemson.edu server=10.42.105.105
planetlab4.clemson.edu navis.gpolab.bbn.com server=10.42.105.55
bain.gpolab.bbn.com plnode2.cip.gatech.edu server=10.42.105.101
plnode1.cip.gatech.edu wings-openflow-3.wail.wisc.edu server=10.42.105.96

One-time prep commands run on each client and server

sudo yum -y install iperf

Commands run on each server

server=<ipaddr>
nice -n 19 iperf -u -B $server -p 5105 -s -i 1

Commands run on each client

server=<ipaddr>
nice -n 19 iperf -u -c $server -p 5105 -t 518400 -b 6M

Results

Generated with

subnet=105
for host in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt | sed -r -e 's/.+@//') ; do echo -e "$host:\n\n{{{" ; grep -A 10 -B 1 "Client connecting" pgenigpolabbbncom_plastic$subnet\@$host.log ; echo -e "}}}\n" ; done

and then edited slightly to remove artifacts (like control characters, my prompt, etc).

wings-openflow-2.wail.wisc.edu:

------------------------------------------------------------
Client connecting to 10.42.105.105, UDP port 5105
Sending 1470 byte datagrams
UDP buffer size:  110 KByte (default)
------------------------------------------------------------
[  3] local 10.42.105.95 port 57076 connected with 10.42.105.105 port 5105
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-433697.3 sec   303 GBytes  6.00 Mbits/sec
[  3] Sent 221274146 datagrams
[  3] Server Report:
[  3]  0.0-433695.4 sec   300 GBytes  5.95 Mbits/sec   0.059 ms 2017562/221274145 (0.91%)
[  3]  0.0-433695.4 sec  4284 datagrams received out-of-order

planetlab4.clemson.edu:

------------------------------------------------------------
Client connecting to 10.42.105.55, UDP port 5105
Sending 1470 byte datagrams
UDP buffer size:  110 KByte (default)
------------------------------------------------------------
[  3] local 10.42.105.104 port 60671 connected with 10.42.105.55 port 5105
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-433717.2 sec   303 GBytes  6.00 Mbits/sec
[  3] Sent 221284274 datagrams
[  3] Server Report:
[  3]  0.0-433710.2 sec   300 GBytes  5.95 Mbits/sec   0.012 ms 2013248/221284273 (0.91%)
[  3]  0.0-433710.2 sec  4842 datagrams received out-of-order

bain.gpolab.bbn.com:

------------------------------------------------------------
Client connecting to 10.42.105.101, UDP port 5105
Sending 1470 byte datagrams
UDP buffer size:   110 KByte (default)
------------------------------------------------------------
[  3] local 10.42.105.54 port 44291 connected with 10.42.105.101 port 5105
[  3]  0.0-433725.6 sec    303 GBytes  6.00 Mbits/sec
[  3] Sent 221286908 datagrams
[  3] Server Report:
[  3]  0.0-433719.1 sec    303 GBytes  6.00 Mbits/sec  2.297 ms 179780/221286908 (0.081%)
[  3]  0.0-433719.1 sec  3779 datagrams received out-of-order

plnode1.cip.gatech.edu:

------------------------------------------------------------
Client connecting to 10.42.105.96, UDP port 5105
Sending 1470 byte datagrams
UDP buffer size:   122 KByte (default)
------------------------------------------------------------
[  3] local 10.42.105.100 port 37502 connected with 10.42.105.96 port 5105
[  3]  0.0-433750.9 sec    303 GBytes  6.00 Mbits/sec
[  3] Sent 221274622 datagrams
[  3] Server Report:
[  3]  0.0-433742.9 sec    298 GBytes  5.90 Mbits/sec  0.117 ms 3482557/221274622 (1.6%)
[  3]  0.0-433742.9 sec  4588 datagrams received out-of-order

Comments

There was a blip at Clemson during the run, which might account for the nearly 1% packet loss there. (Which isn't a *lot*, but is a little higher than expected.)

Sending data from GT plnodes is known to have some issues, which probably accounts for the 1.6% packet loss there.

plastic-106

SteadyPerf TCP, using port=5106, time=518400, and this table of client/server pairs:

client server server address
planetlab5.clemson.edu wings-openflow-2.wail.wisc.edu server=10.42.106.95
wings-openflow-3.wail.wisc.edu plnode1.cip.gatech.edu server=10.42.106.100
plnode2.cip.gatech.edu bain.gpolab.bbn.com server=10.42.106.54
navis.gpolab.bbn.com planetlab4.clemson.edu server=10.42.106.104

One-time prep commands run on each client and server

sudo yum -y install iperf

Commands run on each server

server=<ipaddr>
nice -n 19 iperf -B $server -p 5106 -s -i 1

Commands run on each client

server=<ipaddr>
nice -n 19 iperf -c $server -p 5106 -t 518400

Results

Generated with

subnet=106
for host in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt | sed -r -e 's/.+@//') ; do echo -e "$host:\n\n{{{" ; grep -A 5 -B 1 "Client connecting" pgenigpolabbbncom_plastic$subnet\@$host.log ; echo -e "}}}\n" ; done

and then edited slightly to remove artifacts (like control characters, my prompt, etc).

planetlab5.clemson.edu:

------------------------------------------------------------
Client connecting to 10.42.106.95, TCP port 5106
TCP window size: 16.0 KByte (default)
------------------------------------------------------------
[  3] local 10.42.106.105 port 42612 connected with 10.42.106.95 port 5106
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-262786.5 sec  2572392441075410944 bits  0.00 (null)s/sec
--
------------------------------------------------------------
Client connecting to 10.42.106.95, TCP port 5106
TCP window size: 16.0 KByte (default)
------------------------------------------------------------
[  3] local 10.42.106.105 port 58034 connected with 10.42.106.95 port 5106
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-170932.7 sec  58.0 GBytes  2.91 Mbits/sec

wings-openflow-3.wail.wisc.edu:

------------------------------------------------------------
Client connecting to 10.42.106.100, TCP port 5106
TCP window size: 16.0 KByte (default)
------------------------------------------------------------
[  3] local 10.42.106.96 port 55284 connected with 10.42.106.100 port 5106
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-433738.5 sec   132 GBytes  2.61 Mbits/sec

plnode2.cip.gatech.edu:

------------------------------------------------------------
Client connecting to 10.42.106.54, TCP port 5106
TCP window size: 16.0 KByte (default)
------------------------------------------------------------
[  3] local 10.42.106.101 port 41257 connected with 10.42.106.54 port 5106
[  3]  0.0-433755.2 sec  8.74 GBytes    173 Kbits/sec

navis.gpolab.bbn.com:

------------------------------------------------------------
Client connecting to 10.42.106.104, TCP port 5106
TCP window size: 16.0 KByte (default)
------------------------------------------------------------
[  3] local 10.42.106.55 port 42707 connected with 10.42.106.104 port 5106
write2 failed: No route to host
[  3]  0.0-130042.3 sec  45.9 GBytes  3.03 Mbits/sec
--
------------------------------------------------------------
Client connecting to 10.42.106.104, TCP port 5106
TCP window size: 16.0 KByte (default)
------------------------------------------------------------
[  3] local 10.42.106.55 port 58769 connected with 10.42.106.104 port 5106
[  3]  0.0-170833.5 sec  60.1 GBytes  3.02 Mbits/sec

Comments

The raw log for GT had 2438 identical copies of the summary, I think because I accidentally reconnected to the screen session within the screen session at one point. I trimmed them down to the one shown above.

The bandwidth from GT to BBN is unusually low, even given the known issue with GT's plnodes.

plastic-107

SteadyPerf TCP, using port=5107, time=518400, and this table of client/server pairs:

client server server address
planetlab5.clemson.edu pl4.myplc.grnoc.iu.edu server=10.42.107.72
pl5.myplc.grnoc.iu.edu plnode2.cip.gatech.edu server=10.42.107.101
plnode1.cip.gatech.edu pl02.cs.washington.edu server=10.42.107.81
pl01.cs.washington.edu planetlab4.clemson.edu server=10.42.107.104

One-time prep commands run on each client and server

sudo yum -y install iperf

Commands run on each server

server=<ipaddr>
nice -n 19 iperf -B $server -p 5107 -s -i 1

Commands run on each client

server=<ipaddr>
nice -n 19 iperf -c $server -p 5107 -t 518400

Results

Generated with

subnet=107
for host in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt | sed -r -e 's/.+@//') ; do echo -e "$host:\n\n{{{" ; grep -A 5 -B 1 "Client connecting" pgenigpolabbbncom_plastic$subnet\@$host.log ; echo -e "}}}\n" ; done

and then edited slightly to remove artifacts (like control characters, my prompt, etc).

planetlab5.clemson.edu:

------------------------------------------------------------
Client connecting to 10.42.107.72, TCP port 5107
TCP window size: 16.0 KByte (default)
------------------------------------------------------------
[  3] local 10.42.107.105 port 38845 connected with 10.42.107.72 port 5107
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-262512.9 sec  2513573969281897984 bits  0.00 (null)s/sec
--
------------------------------------------------------------
Client connecting to 10.42.107.72, TCP port 5107
TCP window size: 16.0 KByte (default)
------------------------------------------------------------
[  3] local 10.42.107.105 port 40331 connected with 10.42.107.72 port 5107
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-171297.9 sec   156 GBytes  7.84 Mbits/sec

pl5.myplc.grnoc.iu.edu:

------------------------------------------------------------
Client connecting to 10.42.107.101, TCP port 5107
TCP window size: 16.0 KByte (default)
------------------------------------------------------------
[  3] local 10.42.107.73 port 44290 connected with 10.42.107.101 port 5107
[  3]  0.0-433822.3 sec    129 GBytes  2.55 Mbits/sec

plnode1.cip.gatech.edu:

------------------------------------------------------------
Client connecting to 10.42.107.81, TCP port 5107
TCP window size: 16.0 KByte (default)
------------------------------------------------------------
[  3] local 10.42.107.100 port 32891 connected with 10.42.107.81 port 5107
write2 failed: Broken pipe
[  3]  0.0-348624.7 sec    184 GBytes  4.53 Mbits/sec

pl01.cs.washington.edu:

------------------------------------------------------------
Client connecting to 10.42.107.104, TCP port 5107
TCP window size: 16.0 KByte (default)
------------------------------------------------------------
[  3] local 10.42.107.80 port 46690 connected with 10.42.107.104 port 5107
write2 failed: No route to host
[  3]  0.0-130027.1 sec  74.6 GBytes  4.93 Mbits/sec
--
------------------------------------------------------------
Client connecting to 10.42.107.104, TCP port 5107
TCP window size: 16.0 KByte (default)
------------------------------------------------------------
[  3] local 10.42.107.80 port 36229 connected with 10.42.107.104 port 5107

Comments

The server log for planetlab4.clemson.edu, which pl01.cs.washington.edu was connected to, had this summary at the bottom:

[  5]  0.0-348621.8 sec  49.4 GBytes  1.22 Mbits/sec
[SUM]  0.0-348621.8 sec  49.4 GBytes  1.22 Mbits/sec

plastic-108

SteadyPerf UDP, using port=5108, time=518400, rate=8, and this table of client/server pairs:

client server server address
wings-openflow-3.wail.wisc.edu of-planet2.stanford.edu server=10.42.108.91
of-planet1.stanford.edu pl5.myplc.grnoc.iu.edu server=10.42.108.73
pl4.myplc.grnoc.iu.edu wings-openflow-2.wail.wisc.edu server=10.42.108.95

One-time prep commands run on each client and server

sudo yum -y install iperf

Commands run on each server

server=<ipaddr>
nice -n 19 iperf -u -B $server -p 5108 -s -i 1

Commands run on each client

server=<ipaddr>
nice -n 19 iperf -u -c $server -p 5108 -t 518400 -b 8M

Results

Generated with

subnet=108
for host in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt | sed -r -e 's/.+@//') ; do echo -e "$host:\n\n{{{" ; grep -A 10 -B 1 "Client connecting" pgenigpolabbbncom_plastic$subnet\@$host.log ; echo -e "}}}\n" ; done

and then edited slightly to remove artifacts (like control characters, my prompt, etc).

wings-openflow-3.wail.wisc.edu:

------------------------------------------------------------
Client connecting to 10.42.108.91, UDP port 5108
Sending 1470 byte datagrams
UDP buffer size:  110 KByte (default)
------------------------------------------------------------
[  3] local 10.42.108.96 port 33977 connected with 10.42.108.91 port 5108
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-433814.4 sec  135519079565040 bits  2.50 Gbits/sec
[  3] Sent 295111862 datagrams
read failed: Connection refused
[  3] WARNING: did not receive ack of last datagram after 2 tries.

of-planet1.stanford.edu:

------------------------------------------------------------
Client connecting to 10.42.108.73, UDP port 5108
Sending 1470 byte datagrams
UDP buffer size:  110 KByte (default)
------------------------------------------------------------
[  3] local 10.42.108.90 port 41236 connected with 10.42.108.73 port 5108

pl4.myplc.grnoc.iu.edu:

------------------------------------------------------------
Client connecting to 10.42.108.95, UDP port 5108
Sending 1470 byte datagrams
UDP buffer size:   110 KByte (default)
------------------------------------------------------------
[  3] local 10.42.108.72 port 47671 connected with 10.42.108.95 port 5108
[  3]  0.0-433817.5 sec    404 GBytes  8.00 Mbits/sec
[  3] Sent 295110461 datagrams
[  3] Server Report:
[  3]  0.0-433816.5 sec    404 GBytes  8.00 Mbits/sec  0.035 ms 93725/295110461 (0.032%)
[  3]  0.0-433816.5 sec  1610 datagrams received out-of-order

Comments

The "2.50 Gbits/sec" number from Wisconsin to Stanford is obviously not right. The log for of-planet2.stanford.edu ends with

[  3] 344333.0-344334.0 sec   976 KBytes  8.00 Mbits/sec   0.019 ms    0/  680 (0%)
[  3] 344334.0-344335.0 sec   975 KBytes  7.99 Mbits/sec   0.023 ms    1/  680 (0.15%)
[  3] 344335.0-344336.0 sec   976 KBytes  8.00 Mbits/sec   0.027 ms    0/  680 (0%)
[  3] 344336.0-344337.0 sec   976 KBytes  8.00 Mbits/sec   0.036 ms    1/  681 (0.15%)

and that 8 Mbits/sec number is as expected.

The server log for pl5.myplc.grnoc.iu.edu, which of-planet1.stanford.edu was connected to, had this summary at the bottom:

[  3]  0.0-402590.4 sec    374 GBytes  7.97 Mbits/sec  0.021 ms 880273/273854026 (0.32%)
[  3]  0.0-402590.4 sec  13364 datagrams received out-of-order

plastic-109

SteadyPerf UDP, using port=5109, time=518400, rate=4, and this table of client/server pairs:

client server server address
gardil.gpolab.bbn.com pl5.myplc.grnoc.iu.edu server=10.42.109.73
pl4.myplc.grnoc.iu.edu pl02.cs.washington.edu server=10.42.109.81
pl01.cs.washington.edu planetlab5.clemson.edu server=10.42.109.105
planetlab4.clemson.edu of-planet1.stanford.edu server=10.42.109.90
of-planet2.stanford.edu wings-openflow-3.wail.wisc.edu server=10.42.109.96
wings-openflow-2.wail.wisc.edu ganel.gpolab.bbn.com server=10.42.109.51

One-time prep commands run on each client and server

sudo yum -y install iperf

Commands run on each server

server=<ipaddr>
nice -n 19 iperf -u -B $server -p 5109 -s -i 1

Commands run on each client

server=<ipaddr>
nice -n 19 iperf -u -c $server -p 5109 -t 518400 -b 4M

Results

Generated with

subnet=109
for host in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt | sed -r -e 's/.+@//') ; do echo -e "$host:\n\n{{{" ; grep -A 10 -B 1 "Client connecting" pgenigpolabbbncom_plastic$subnet\@$host.log ; echo -e "}}}\n" ; done

and then edited slightly to remove artifacts (like control characters, my prompt, etc).

gardil.gpolab.bbn.com:

------------------------------------------------------------
Client connecting to 10.42.109.73, UDP port 5109
Sending 1470 byte datagrams
UDP buffer size:   110 KByte (default)
------------------------------------------------------------
[  3] local 10.42.109.52 port 53746 connected with 10.42.109.73 port 5109
[  3]  0.0-433793.1 sec    202 GBytes  4.00 Mbits/sec
[  3] Sent 147548681 datagrams
[  3] Server Report:
[  3]  0.0-433790.7 sec    201 GBytes  3.97 Mbits/sec  0.004 ms 983731/147548681 (0.67%)
[  3]  0.0-433790.7 sec  9337 datagrams received out-of-order

pl4.myplc.grnoc.iu.edu:

------------------------------------------------------------
Client connecting to 10.42.109.81, UDP port 5109
Sending 1470 byte datagrams
UDP buffer size:   110 KByte (default)
------------------------------------------------------------
[  3] local 10.42.109.72 port 39551 connected with 10.42.109.81 port 5109
write2 failed: Connection refused
[  3]  0.0-348511.9 sec    162 GBytes  4.00 Mbits/sec
[  3] Sent 118541205 datagrams
read failed: Connection refused
[  3] WARNING: did not receive ack of last datagram after 1 tries.

pl01.cs.washington.edu:

------------------------------------------------------------
Client connecting to 10.42.109.105, UDP port 5109
Sending 1470 byte datagrams
UDP buffer size:   110 KByte (default)
------------------------------------------------------------
[  3] local 10.42.109.80 port 43885 connected with 10.42.109.105 port 5109

planetlab4.clemson.edu:

------------------------------------------------------------
Client connecting to 10.42.109.90, UDP port 5109
Sending 1470 byte datagrams
UDP buffer size:  110 KByte (default)
------------------------------------------------------------
[  3] local 10.42.109.104 port 57468 connected with 10.42.109.90 port 5109
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-433803.5 sec  135096008515530 bits  2.49 Gbits/sec
[  3] Sent 147552209 datagrams
read failed: Connection refused
[  3] WARNING: did not receive ack of last datagram after 2 tries.

of-planet2.stanford.edu:

------------------------------------------------------------
Client connecting to 10.42.109.96, UDP port 5109
Sending 1470 byte datagrams
UDP buffer size:  110 KByte (default)
------------------------------------------------------------
[  3] local 10.42.109.91 port 44570 connected with 10.42.109.96 port 5109

wings-openflow-2.wail.wisc.edu:

------------------------------------------------------------
Client connecting to 10.42.109.51, UDP port 5109
Sending 1470 byte datagrams
UDP buffer size:  110 KByte (default)
------------------------------------------------------------
[  3] local 10.42.109.95 port 58015 connected with 10.42.109.51 port 5109
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-433807.8 sec   202 GBytes  4.00 Mbits/sec
[  3] Sent 147553686 datagrams
[  3] Server Report:
[  3]  0.0-433802.6 sec   201 GBytes  3.97 Mbits/sec   0.040 ms 978284/147553685 (0.66%)
[  3]  0.0-433802.6 sec  10543 datagrams received out-of-order

Comments

The "2.49 Gbits/sec" number from Clemson to Stanford is obviously not right. The log for of-planet1.stanford.edu ends with

[  3] 344235.0-344236.0 sec   488 KBytes  4.00 Mbits/sec   0.029 ms    0/  340 (0%)
[  3] 344236.0-344237.0 sec   488 KBytes  4.00 Mbits/sec   0.046 ms    0/  340 (0%)
[  3] 344237.0-344238.0 sec   488 KBytes  4.00 Mbits/sec   0.047 ms    0/  340 (0%)
[  3] 344238.0-344239.0 sec   490 KBytes  4.01 Mbits/sec   0.026 ms    0/  341 (0%)

and that 4 Mbits/sec number is as expected.

The server log for planetlab5.clemson.edu, which pl01.cs.washington.edu was connected to, had this summary at the bottom:

[  3]  0.0-348503.1 sec   160 GBytes  3.95 Mbits/sec   0.122 ms 1515509/118510107 (1.3%)
[  3]  0.0-348503.1 sec  14898 datagrams received out-of-order

The server log for wings-openflow-3.wail.wisc.edu, which of-planet2.stanford.edu was connected to, had this summary at the bottom:

[  3]  0.0-402506.6 sec   187 GBytes  3.99 Mbits/sec   0.111 ms 221552/136906806 (0.16%)
[  3]  0.0-402506.6 sec  6383 datagrams received out-of-order

plastic-110

SteadyPerf TCP, using port=5110, time=518400, and this table of client/server pairs:

client server server address
bain.gpolab.bbn.com pl01.cs.washington.edu server=10.42.110.80
pl02.cs.washington.edu of-planet1.stanford.edu server=10.42.110.90
of-planet2.stanford.edu pl4.myplc.grnoc.iu.edu server=10.42.110.72
pl5.myplc.grnoc.iu.edu plnode1.cip.gatech.edu server=10.42.110.100
plnode2.cip.gatech.edu navis.gpolab.bbn.com server=10.42.110.55

One-time prep commands run on each client and server

sudo yum -y install iperf

Commands run on each server

server=<ipaddr>
nice -n 19 iperf -B $server -p 5110 -s -i 1

Commands run on each client

server=<ipaddr>
nice -n 19 iperf -c $server -p 5110 -t 518400

Results

Generated with

subnet=110
for host in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt | sed -r -e 's/.+@//') ; do echo -e "$host:\n\n{{{" ; grep -A 5 -B 1 "Client connecting" pgenigpolabbbncom_plastic$subnet\@$host.log ; echo -e "}}}\n" ; done

and then edited slightly to remove artifacts (like control characters, my prompt, etc).

bain.gpolab.bbn.com:

------------------------------------------------------------
Client connecting to 10.42.110.80, TCP port 5110
TCP window size: 16.0 KByte (default)
------------------------------------------------------------
[  3] local 10.42.110.54 port 46265 connected with 10.42.110.80 port 5110
write2 failed: Connection reset by peer
[  3]  0.0-348394.1 sec    248 GBytes  6.12 Mbits/sec

pl02.cs.washington.edu:

------------------------------------------------------------
Client connecting to 10.42.110.90, TCP port 5110
TCP window size: 16.0 KByte (default)
------------------------------------------------------------
[  3] local 10.42.110.81 port 36323 connected with 10.42.110.90 port 5110

of-planet2.stanford.edu:

------------------------------------------------------------
Client connecting to 10.42.110.72, TCP port 5110
TCP window size: 16.0 KByte (default)
------------------------------------------------------------
[  3] local 10.42.110.91 port 41437 connected with 10.42.110.72 port 5110

pl5.myplc.grnoc.iu.edu:

------------------------------------------------------------
Client connecting to 10.42.110.100, TCP port 5110
TCP window size: 16.0 KByte (default)
------------------------------------------------------------
[  3] local 10.42.110.73 port 51910 connected with 10.42.110.100 port 5110
[  3]  0.0-433718.6 sec    147 GBytes  2.91 Mbits/sec

plnode2.cip.gatech.edu:

------------------------------------------------------------
Client connecting to 10.42.110.55, TCP port 5110
TCP window size: 16.0 KByte (default)
------------------------------------------------------------
[  3] local 10.42.110.101 port 38696 connected with 10.42.110.55 port 5110
[  3]  0.0-433742.2 sec  28.5 GBytes    565 Kbits/sec

Comments

Since pl02.cs.washington.edu was connected to of-planet2.stanford.edu, the server log at Stanford also doesn't have a summary of stats, although one could in theory be generated from the raw log.

The server log for pl4.myplc.grnoc.iu.edu, which of-planet2.stanford.edu was connected to, had this summary at the bottom:

[  4]  0.0-402383.5 sec    307 GBytes  6.56 Mbits/sec
Last modified 12 years ago Last modified on 05/16/12 12:19:44