wiki:PlasticSlices/Continuation/Weekly01

Version 2 (modified by Josh Smift, 12 years ago) (diff)

--

Continuation Week 01

This is the first of a set of week-long continuation runs. Some changes from previous continuation rounds:

  • We're down to six sites, because MyPLC at Wisconsin is no longer available.
  • We're now using all six sites in all ten slices, balanced to have traffic flowing somewhat evenly between each pair of sites.
  • The SteadyPerf UDP slices are now running at different rates: 2, 3, 4, and 5 Mb/sec per hostpair, so approximately 12, 18, 24, and 30 Mb/sec total in those four slices.

The raw logs are at http://www.gpolab.bbn.com/plastic-slices/continuation/weekly-01/.

plastic-101

SteadyPing, using interval=.005, and this table of client/server pairs:

client server server address
ganel.gpolab.bbn.com planetlab5.clemson.edu server=10.42.101.105
planetlab4.clemson.edu pl02.cs.washington.edu server=10.42.101.81
plnode1.cip.gatech.edu of-planet2.stanford.edu server=10.42.101.91
pl4.myplc.grnoc.iu.edu plnode2.cip.gatech.edu server=10.42.101.101
of-planet1.stanford.edu gardil.gpolab.bbn.com server=10.42.101.52
pl01.cs.washington.edu pl5.myplc.grnoc.iu.edu server=10.42.101.73

Commands run on each client

server=<ipaddr>
sudo ping -q -i .005 -s $((1500-8-20)) $server

Results

Generated from the logs with

subnet=101
for host in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt | sed -r -e 's/.+@//') ; do echo -e "$host:\n\n{{{" ; grep -A 2 statistics pgenigpolabbbncom_plastic$subnet\@$host.log ; echo -e "}}}\n" ; done

ganel.gpolab.bbn.com:

--- 10.42.101.105 ping statistics ---
69020482 packets transmitted, 68754388 received, +831 errors, 0% packet loss, time 693587078ms
rtt min/avg/max/mdev = 138.365/152.648/12150.739/35.083 ms, pipe 1204

planetlab4.clemson.edu:

--- 10.42.101.81 ping statistics ---
72481357 packets transmitted, 69157641 received, +275 errors, 4% packet loss, time 693642857ms
rtt min/avg/max/mdev = 89.337/91.991/257109.003/67.957 ms, pipe 25551

plnode1.cip.gatech.edu:

--- 10.42.101.91 ping statistics ---
71785528 packets transmitted, 68373862 received, +1026 errors, 4% packet loss, time 693628879ms
rtt min/avg/max/mdev = 68.216/72.702/16648.690/71.830 ms, pipe 1762

pl4.myplc.grnoc.iu.edu:

--- 10.42.101.101 ping statistics ---
62417909 packets transmitted, 55529131 received, +1029 errors, 11% packet loss, time 693614079ms
rtt min/avg/max/mdev = 36.713/89.007/14013.525/42.816 ms, pipe 1298

of-planet1.stanford.edu:

--- 10.42.101.52 ping statistics ---
74157054 packets transmitted, 70885511 received, +3132 errors, 4% packet loss, time 693594276ms
rtt min/avg/max/mdev = 201.700/226.012/56554.295/259.941 ms, pipe 5914

pl01.cs.washington.edu:

--- 10.42.101.73 ping statistics ---
72513792 packets transmitted, 69828975 received, +678 errors, 3% packet loss, time 693587578ms
rtt min/avg/max/mdev = 58.159/61.228/17922.674/35.901 ms, pipe 1633

Comments

Due to the change in how we log SteadyPing results, we can't easily tell whether the packet loss was all at once (e.g. during an outage of some sort), or steady throughout the experiment.

plastic-102

SteadyPing, using interval=.005, and this table of client/server pairs:

client server server address
ganel.gpolab.bbn.com plnode2.cip.gatech.edu server=10.42.102.101
planetlab5.clemson.edu gardil.gpolab.bbn.com server=10.42.102.52
plnode1.cip.gatech.edu pl01.cs.washington.edu server=10.42.102.80
pl5.myplc.grnoc.iu.edu of-planet2.stanford.edu server=10.42.102.91
of-planet1.stanford.edu pl4.myplc.grnoc.iu.edu server=10.42.102.72
pl02.cs.washington.edu planetlab4.clemson.edu server=10.42.102.104

Commands run on each client

server=<ipaddr>
sudo ping -q -i .005 -s $((1500-8-20)) $server

Results

Generated from the logs with

subnet=102
for host in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt | sed -r -e 's/.+@//') ; do echo -e "$host:\n\n{{{" ; grep -A 2 statistics pgenigpolabbbncom_plastic$subnet\@$host.log ; echo -e "}}}\n" ; done

ganel.gpolab.bbn.com:

--- 10.42.102.101 ping statistics ---
62421342 packets transmitted, 55184251 received, +1116 errors, 11% packet loss, time 693631928ms
rtt min/avg/max/mdev = 25.848/78.019/16253.353/36.467 ms, pipe 1455

planetlab5.clemson.edu:

--- 10.42.102.52 ping statistics ---
75728134 packets transmitted, 75535508 received, +523 errors, 0% packet loss, time 693673497ms
rtt min/avg/max/mdev = 27.407/27.680/21434.374/31.972 ms, pipe 2140

plnode1.cip.gatech.edu:

--- 10.42.102.80 ping statistics ---
70999513 packets transmitted, 67980633 received, +771 errors, 4% packet loss, time 693661762ms
rtt min/avg/max/mdev = 85.931/90.329/19876.841/47.477 ms, pipe 1967

pl5.myplc.grnoc.iu.edu:

--- 10.42.102.91 ping statistics ---
75453528 packets transmitted, 70871589 received, +841 errors, 6% packet loss, time 693651165ms
rtt min/avg/max/mdev = 76.963/84.879/16795.205/117.627 ms, pipe 1942

of-planet1.stanford.edu:

--- 10.42.102.72 ping statistics ---
74195984 packets transmitted, 71132927 received, +1956 errors, 4% packet loss, time 693641161ms
rtt min/avg/max/mdev = 77.475/89.172/48177.293/287.332 ms, pipe 4471

pl02.cs.washington.edu:

--- 10.42.102.104 ping statistics ---
70053850 packets transmitted, 67274492 received, +294 errors, 3% packet loss, time 693634608ms
rtt min/avg/max/mdev = 87.278/89.282/10743.665/32.728 ms, pipe 977

Comments

Due to the change in how we log SteadyPing results, we can't easily tell whether the packet loss was all at once (e.g. during an outage of some sort), or steady throughout the experiment.

plastic-103

SteadyPerf TCP, using port=5103, time=518400, and this table of client/server pairs:

client server server address
gardil.gpolab.bbn.com plnode1.cip.gatech.edu server=10.42.103.100
planetlab4.clemson.edu ganel.gpolab.bbn.com server=10.42.103.51
plnode2.cip.gatech.edu pl02.cs.washington.edu server=10.42.103.81
pl4.myplc.grnoc.iu.edu of-planet1.stanford.edu server=10.42.103.90
of-planet2.stanford.edu pl5.myplc.grnoc.iu.edu server=10.42.103.73
pl01.cs.washington.edu planetlab5.clemson.edu server=10.42.103.105

Commands run on each server

server=<ipaddr>
nice -n 19 iperf -B $server -p 5103 -s -i 1 -w 1m

Commands run on each client

server=<ipaddr>
nice -n 19 iperf -c $server -p 5103 -t 518400 -w 1m

Results

Generated with

subnet=103
for host in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt | sed -r -e 's/.+@//') ; do echo -e "$host:\n\n{{{" ; grep -a -A 5 -B 1 "Client connecting" pgenigpolabbbncom_plastic$subnet\@$host.log ; echo -e "}}}\n" ; done

and then edited slightly to remove artifacts (like control characters, my prompt, etc).

gardil.gpolab.bbn.com:

------------------------------------------------------------
Client connecting to 10.42.103.100, TCP port 5103
TCP window size:   256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.103.52 port 57577 connected with 10.42.103.100 port 5103
[  3]  0.0-518400.1 sec    539 GBytes  8.93 Mbits/sec

planetlab4.clemson.edu:

------------------------------------------------------------
Client connecting to 10.42.103.51, TCP port 5103
TCP window size:  256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.103.104 port 52740 connected with 10.42.103.51 port 5103
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-518400.3 sec   380 GBytes  6.30 Mbits/sec

plnode2.cip.gatech.edu:

------------------------------------------------------------
Client connecting to 10.42.103.81, TCP port 5103
TCP window size:   256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.103.101 port 39286 connected with 10.42.103.81 port 5103
[  3]  0.0-518401.0 sec  36.4 GBytes    603 Kbits/sec

pl4.myplc.grnoc.iu.edu:

------------------------------------------------------------
Client connecting to 10.42.103.90, TCP port 5103
TCP window size:   256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.103.72 port 60448 connected with 10.42.103.90 port 5103
[  3]  0.0-518400.0 sec    336 GBytes  5.56 Mbits/sec

of-planet2.stanford.edu:

------------------------------------------------------------
Client connecting to 10.42.103.73, TCP port 5103
TCP window size:  256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.103.91 port 60721 connected with 10.42.103.73 port 5103
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-518400.2 sec   635 GBytes  10.5 Mbits/sec

pl01.cs.washington.edu:

------------------------------------------------------------
Client connecting to 10.42.103.105, TCP port 5103
TCP window size:   256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.103.80 port 39409 connected with 10.42.103.105 port 5103
[  3]  0.0-518400.1 sec    111 GBytes  1.83 Mbits/sec

Comments

Bandwidth varied substantially between the hostpairs. We haven't yet analyzed the results of the four SteadyPerf TCP experients to look for trends.

plastic-104

SteadyPerf TCP, using port=5104, time=518400, and this table of client/server pairs:

client server server address
ganel.gpolab.bbn.com pl01.cs.washington.edu server=10.42.104.80
planetlab4.clemson.edu of-planet2.stanford.edu server=10.42.104.91
plnode2.cip.gatech.edu pl4.myplc.grnoc.iu.edu server=10.42.104.72
pl5.myplc.grnoc.iu.edu planetlab5.clemson.edu server=10.42.104.105
of-planet1.stanford.edu plnode1.cip.gatech.edu server=10.42.104.100
pl02.cs.washington.edu gardil.gpolab.bbn.com server=10.42.104.52

Commands run on each server

server=<ipaddr>
nice -n 19 iperf -B $server -p 5104 -s -i 1 -w 1m

Commands run on each client

server=<ipaddr>
nice -n 19 iperf -c $server -p 5104 -t 518400 -w 1m

Results

Generated with

subnet=104
for host in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt | sed -r -e 's/.+@//') ; do echo -e "$host:\n\n{{{" ; grep -a -A 5 -B 1 "Client connecting" pgenigpolabbbncom_plastic$subnet\@$host.log ; echo -e "}}}\n" ; done

and then edited slightly to remove artifacts (like control characters, my prompt, etc).

ganel.gpolab.bbn.com:

------------------------------------------------------------
Client connecting to 10.42.104.80, TCP port 5104
TCP window size:   256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.104.51 port 57092 connected with 10.42.104.80 port 5104
[  3]  0.0-518400.0 sec    542 GBytes  8.98 Mbits/sec

planetlab4.clemson.edu:

------------------------------------------------------------
Client connecting to 10.42.104.91, TCP port 5104
TCP window size:  256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.104.104 port 35515 connected with 10.42.104.91 port 5104
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-339806.3 sec  10124656164684535808 bits  0.00 (null)s/sec
--
------------------------------------------------------------
Client connecting to 10.42.104.91, TCP port 5104
TCP window size:  256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.104.104 port 44644 connected with 10.42.104.91 port 5104
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-354052.5 sec   548 GBytes  13.3 Mbits/sec

plnode2.cip.gatech.edu:

------------------------------------------------------------
Client connecting to 10.42.104.72, TCP port 5104
TCP window size:   256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.104.101 port 33862 connected with 10.42.104.72 port 5104
[  3]  0.0-518402.3 sec  26.4 GBytes    437 Kbits/sec

pl5.myplc.grnoc.iu.edu:

------------------------------------------------------------
Client connecting to 10.42.104.105, TCP port 5104
TCP window size:   256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.104.73 port 58392 connected with 10.42.104.105 port 5104
write2 failed: No route to host
[  3]  0.0-57584.0 sec  69.2 GBytes  10.3 Mbits/sec
--
------------------------------------------------------------
Client connecting to 10.42.104.105, TCP port 5104
TCP window size:   256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.104.73 port 46554 connected with 10.42.104.105 port 5104
[  3]  0.0-353965.7 sec    433 GBytes  10.5 Mbits/sec

of-planet1.stanford.edu:

------------------------------------------------------------
Client connecting to 10.42.104.100, TCP port 5104
TCP window size:  256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.104.90 port 56536 connected with 10.42.104.100 port 5104
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-518444.8 sec   967 GBytes  16.0 Mbits/sec

pl02.cs.washington.edu:

------------------------------------------------------------
Client connecting to 10.42.104.52, TCP port 5104
TCP window size:   256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.104.81 port 51283 connected with 10.42.104.52 port 5104
[  3]  0.0-518400.0 sec    275 GBytes  4.56 Mbits/sec

Comments

The clients on planetlab4.clemson.edu and pl5.myplc.grnoc.iu.edu (connecting to Clemson) died partway through, and had to be restarted.

Bandwidth varied substantially between the hostpairs. We haven't yet analyzed the results of the four SteadyPerf TCP experients to look for trends.

plastic-105

SteadyPerf TCP, using port=5105, time=518400, and this table of client/server pairs:

client server server address
ganel.gpolab.bbn.com pl4.myplc.grnoc.iu.edu server=10.42.105.72
planetlab4.clemson.edu plnode2.cip.gatech.edu server=10.42.105.101
plnode1.cip.gatech.edu gardil.gpolab.bbn.com server=10.42.105.52
pl5.myplc.grnoc.iu.edu pl01.cs.washington.edu server=10.42.105.80
of-planet2.stanford.edu planetlab5.clemson.edu server=10.42.105.105
pl02.cs.washington.edu of-planet1.stanford.edu server=10.42.105.90

Commands run on each server

server=<ipaddr>
nice -n 19 iperf -B $server -p 5105 -s -i 1 -w 1m

Commands run on each client

server=<ipaddr>
nice -n 19 iperf -c $server -p 5105 -t 518400 -w 1m

Results

Generated with

subnet=105
for host in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt | sed -r -e 's/.+@//') ; do echo -e "$host:\n\n{{{" ; grep -a -A 5 -B 1 "Client connecting" pgenigpolabbbncom_plastic$subnet\@$host.log ; echo -e "}}}\n" ; done

and then edited slightly to remove artifacts (like control characters, my prompt, etc).

ganel.gpolab.bbn.com:

------------------------------------------------------------
Client connecting to 10.42.105.72, TCP port 5105
TCP window size:   256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.105.51 port 59709 connected with 10.42.105.72 port 5105
[  3]  0.0-518400.1 sec    438 GBytes  7.26 Mbits/sec

planetlab4.clemson.edu:

------------------------------------------------------------
Client connecting to 10.42.105.101, TCP port 5105
TCP window size:  256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.105.104 port 32802 connected with 10.42.105.101 port 5105
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-518400.9 sec  64.0 GBytes  1.06 Mbits/sec

plnode1.cip.gatech.edu:

------------------------------------------------------------
Client connecting to 10.42.105.52, TCP port 5105
TCP window size:   256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.105.100 port 46417 connected with 10.42.105.52 port 5105
[  3]  0.0-518400.2 sec    130 GBytes  2.15 Mbits/sec

pl5.myplc.grnoc.iu.edu:

------------------------------------------------------------
Client connecting to 10.42.105.80, TCP port 5105
TCP window size:   256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.105.73 port 35663 connected with 10.42.105.80 port 5105
[  3]  0.0-518400.0 sec    976 GBytes  16.2 Mbits/sec

of-planet2.stanford.edu:

------------------------------------------------------------
Client connecting to 10.42.105.105, TCP port 5105
TCP window size:  256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.105.91 port 57130 connected with 10.42.105.105 port 5105
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-518400.1 sec   940 GBytes  15.6 Mbits/sec

pl02.cs.washington.edu:

------------------------------------------------------------
Client connecting to 10.42.105.90, TCP port 5105
TCP window size:   256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 0.0.0.0 port 49985 connected with 10.42.105.90 port 5105
[  3]  0.0- 0.0 sec  0.00 Bytes  0.00 bits/sec
--
------------------------------------------------------------
Client connecting to 10.42.105.90, TCP port 5105
TCP window size:   256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 0.0.0.0 port 57017 connected with 10.42.105.90 port 5105
[  3]  0.0- 0.0 sec  0.00 Bytes  0.00 bits/sec
--
------------------------------------------------------------
Client connecting to 10.42.105.90, TCP port 5105
TCP window size:   256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.105.81 port 57019 connected with 10.42.105.90 port 5105
write2 failed: No route to host
[  3]  0.0-109778.5 sec  23.1 GBytes  1.81 Mbits/sec
--
------------------------------------------------------------
Client connecting to 10.42.105.90, TCP port 5105
TCP window size:   256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 0.0.0.0 port 44157 connected with 10.42.105.90 port 5105
[  3]  0.0- 0.0 sec  0.00 Bytes  0.00 bits/sec
--
------------------------------------------------------------
Client connecting to 10.42.105.90, TCP port 5105
TCP window size:   256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.105.81 port 44158 connected with 10.42.105.90 port 5105
[  3]  0.0-353910.3 sec    172 GBytes  4.17 Mbits/sec

Comments

The client on pl02.cs.washington.edu (connecting to Clemson) died partway through, and had to be restarted.

Bandwidth varied substantially between the hostpairs. We haven't yet analyzed the results of the four SteadyPerf TCP experients to look for trends.

plastic-106

SteadyPerf TCP, using port=5106, time=518400, and this table of client/server pairs:

client server server address
ganel.gpolab.bbn.com of-planet2.stanford.edu server=10.42.106.91
planetlab5.clemson.edu pl5.myplc.grnoc.iu.edu server=10.42.106.73
plnode2.cip.gatech.edu planetlab4.clemson.edu server=10.42.106.104
pl4.myplc.grnoc.iu.edu gardil.gpolab.bbn.com server=10.42.106.52
of-planet1.stanford.edu pl01.cs.washington.edu server=10.42.106.80
pl02.cs.washington.edu plnode1.cip.gatech.edu server=10.42.106.100

Commands run on each server

server=<ipaddr>
nice -n 19 iperf -B $server -p 5106 -s -i 1 -w 1m

Commands run on each client

server=<ipaddr>
nice -n 19 iperf -c $server -p 5106 -t 518400 -w 1m

Results

Generated with

subnet=106
for host in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt | sed -r -e 's/.+@//') ; do echo -e "$host:\n\n{{{" ; grep -a -A 5 -B 1 "Client connecting" pgenigpolabbbncom_plastic$subnet\@$host.log ; echo -e "}}}\n" ; done

and then edited slightly to remove artifacts (like control characters, my prompt, etc).

ganel.gpolab.bbn.com:

------------------------------------------------------------
Client connecting to 10.42.106.91, TCP port 5105
TCP window size:   256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.106.51 port 34768 connected with 10.42.106.91 port 5105
[  3]  0.0-518400.0 sec    719 GBytes  11.9 Mbits/sec

planetlab5.clemson.edu:

------------------------------------------------------------
Client connecting to 10.42.106.73, TCP port 5105
TCP window size:  256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.106.105 port 34157 connected with 10.42.106.73 port 5105
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-518400.5 sec   268 GBytes  4.45 Mbits/sec

plnode2.cip.gatech.edu:

------------------------------------------------------------
Client connecting to 10.42.106.104, TCP port 5105
TCP window size:   256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.106.101 port 59057 connected with 10.42.106.104 port 5105
[  3]  0.0-518401.2 sec  34.0 GBytes    564 Kbits/sec

pl4.myplc.grnoc.iu.edu:

------------------------------------------------------------
Client connecting to 10.42.106.52, TCP port 5105
TCP window size:   256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.106.72 port 43381 connected with 10.42.106.52 port 5105
[  3]  0.0-518400.0 sec    492 GBytes  8.16 Mbits/sec

of-planet1.stanford.edu:

------------------------------------------------------------
Client connecting to 10.42.106.80, TCP port 5105
TCP window size:  256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.106.90 port 51895 connected with 10.42.106.80 port 5105
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-518400.0 sec  1951031754752 bits  30.1 Mbits/sec

pl02.cs.washington.edu:

------------------------------------------------------------
Client connecting to 10.42.106.100, TCP port 5105
TCP window size:   256 KByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[  3] local 10.42.106.81 port 53501 connected with 10.42.106.100 port 5105
[  3]  0.0-518400.0 sec    278 GBytes  4.61 Mbits/sec

Comments

Bandwidth varied substantially between the hostpairs. We haven't yet analyzed the results of the four SteadyPerf TCP experients to look for trends.

plastic-107

SteadyPerf UDP, using port=5107, time=518400, rate=2, and this table of client/server pairs:

client server server address
gardil.gpolab.bbn.com of-planet1.stanford.edu server=10.42.107.90
planetlab4.clemson.edu pl4.myplc.grnoc.iu.edu server=10.42.107.72
plnode1.cip.gatech.edu planetlab5.clemson.edu server=10.42.107.105
pl5.myplc.grnoc.iu.edu ganel.gpolab.bbn.com server=10.42.107.51
of-planet2.stanford.edu pl02.cs.washington.edu server=10.42.107.81
pl01.cs.washington.edu plnode2.cip.gatech.edu server=10.42.107.101

Commands run on each server

server=<ipaddr>
nice -n 19 iperf -u -B $server -p 5107 -s -i 1

Commands run on each client

server=<ipaddr>
nice -n 19 iperf -u -c $server -p 5107 -t 518400 -b 2M

Results

Generated with

subnet=107
for host in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt | sed -r -e 's/.+@//') ; do echo -e "$host:\n\n{{{" ; grep -a -A 10 -B 1 "Client connecting" pgenigpolabbbncom_plastic$subnet\@$host.log ; echo -e "}}}\n" ; done

and then edited slightly to remove artifacts (like control characters, my prompt, etc).

gardil.gpolab.bbn.com:

------------------------------------------------------------
Client connecting to 10.42.107.90, UDP port 5107
Sending 1470 byte datagrams
UDP buffer size:   110 KByte (default)
------------------------------------------------------------
[  3] local 10.42.107.52 port 44059 connected with 10.42.107.90 port 5107
nice -n 19 iperf -u -c $server -p 5107 -t 518400 -b 2M

[  3]  0.0-518400.0 sec    121 GBytes  2.00 Mbits/sec
[  3] Sent 88163209 datagrams
[  3] WARNING: did not receive ack of last datagram after 10 tries.
--
------------------------------------------------------------
Client connecting to 10.42.107.90, UDP port 5107
Sending 1470 byte datagrams
UDP buffer size:   110 KByte (default)
------------------------------------------------------------
[  3] local 10.42.107.52 port 34227 connected with 10.42.107.90 port 5107
[  3]  0.0-175078.0 sec  40.8 GBytes  2.00 Mbits/sec
[  3] Sent 29775176 datagrams
[  3] Server Report:
[  3]  0.0-175077.0 sec  39.4 GBytes  1.93 Mbits/sec  0.005 ms 1001950/29775176 (3.4%)
[  3]  0.0-175077.0 sec  41548 datagrams received out-of-order

planetlab4.clemson.edu:

------------------------------------------------------------
Client connecting to 10.42.107.72, UDP port 5107
Sending 1470 byte datagrams
UDP buffer size:  110 KByte (default)
------------------------------------------------------------
[  3] local 10.42.107.104 port 48560 connected with 10.42.107.72 port 5107
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-518400.0 sec   121 GBytes  2.00 Mbits/sec
[  3] Sent 88163267 datagrams
[  3] Server Report:
[  3]  0.0-518398.5 sec   120 GBytes  1.99 Mbits/sec   0.016 ms 342347/88163266 (0.39%)
[  3]  0.0-518398.5 sec  7658 datagrams received out-of-order

plnode1.cip.gatech.edu:

------------------------------------------------------------
Client connecting to 10.42.107.105, UDP port 5107
Sending 1470 byte datagrams
UDP buffer size:   122 KByte (default)
------------------------------------------------------------
[  3] local 10.42.107.100 port 54726 connected with 10.42.107.105 port 5107
[  3]  0.0-518400.0 sec    121 GBytes  2.00 Mbits/sec
[  3] Sent 88160368 datagrams
[  3] Server Report:
[  3]  0.0-518399.0 sec    120 GBytes  1.99 Mbits/sec  0.231 ms 281852/88160367 (0.32%)
[  3]  0.0-518399.0 sec  2889 datagrams received out-of-order

pl5.myplc.grnoc.iu.edu:

------------------------------------------------------------
Client connecting to 10.42.107.51, UDP port 5107
Sending 1470 byte datagrams
UDP buffer size:   110 KByte (default)
------------------------------------------------------------
[  3] local 10.42.107.73 port 34991 connected with 10.42.107.51 port 5107
[  3]  0.0-518400.0 sec    121 GBytes  2.00 Mbits/sec
[  3] Sent 88163203 datagrams
[  3] Server Report:
[  3]  0.0-518397.5 sec    120 GBytes  1.99 Mbits/sec  0.049 ms 422890/88163202 (0.48%)
[  3]  0.0-518397.5 sec  14589 datagrams received out-of-order

of-planet2.stanford.edu:

------------------------------------------------------------
Client connecting to 10.42.107.81, UDP port 5107
Sending 1470 byte datagrams
UDP buffer size:  110 KByte (default)
------------------------------------------------------------
[  3] local 10.42.107.91 port 39535 connected with 10.42.107.81 port 5107
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-518400.0 sec   121 GBytes  2.00 Mbits/sec
[  3] Sent 88163266 datagrams
[  3] WARNING: did not receive ack of last datagram after 10 tries.

pl01.cs.washington.edu:

------------------------------------------------------------
Client connecting to 10.42.107.101, UDP port 5107
Sending 1470 byte datagrams
UDP buffer size:   110 KByte (default)
------------------------------------------------------------
[  3] local 10.42.107.80 port 52860 connected with 10.42.107.101 port 5107
[  3]  0.0-518400.0 sec    121 GBytes  2.00 Mbits/sec
[  3] Sent 88148208 datagrams
[  3] Server Report:
[  3]  0.0-518397.0 sec    115 GBytes  1.91 Mbits/sec  12.916 ms 3873660/88148208 (4.4%)
[  3]  0.0-518397.0 sec  162853 datagrams received out-of-order

Comments

of-planet2.stanford.edu didn't get a server report from 10.42.107.81 (on pl02.cs.washington.edu); the server log from pl02 said

[  3]  0.0-518382.9 sec    106 GBytes  1.76 Mbits/sec  0.481 ms 10580729/88163266 (12%)
[  3]  0.0-518382.9 sec  757943 datagrams received out-of-order

We haven't yet analyzed whether the packet loss wass all at once (e.g. during an outage of some sort), or steady throughout the experiment.

plastic-108

SteadyPerf UDP, using port=5108, time=518400, rate=3, and this table of client/server pairs:

client server server address
gardil.gpolab.bbn.com pl5.myplc.grnoc.iu.edu server=10.42.108.73
planetlab5.clemson.edu plnode1.cip.gatech.edu server=10.42.108.100
plnode2.cip.gatech.edu ganel.gpolab.bbn.com server=10.42.108.51
pl4.myplc.grnoc.iu.edu pl02.cs.washington.edu server=10.42.108.81
of-planet1.stanford.edu planetlab4.clemson.edu server=10.42.108.104
pl01.cs.washington.edu of-planet2.stanford.edu server=10.42.108.91

Commands run on each server

server=<ipaddr>
nice -n 19 iperf -u -B $server -p 5108 -s -i 1

Commands run on each client

server=<ipaddr>
nice -n 19 iperf -u -c $server -p 5108 -t 518400 -b 3M

Results

Generated with

subnet=108
for host in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt | sed -r -e 's/.+@//') ; do echo -e "$host:\n\n{{{" ; grep -a -A 10 -B 1 "Client connecting" pgenigpolabbbncom_plastic$subnet\@$host.log ; echo -e "}}}\n" ; done

and then edited slightly to remove artifacts (like control characters, my prompt, etc).

gardil.gpolab.bbn.com:

------------------------------------------------------------
Client connecting to 10.42.108.73, UDP port 5108
Sending 1470 byte datagrams
UDP buffer size:   110 KByte (default)
------------------------------------------------------------
[  3] local 10.42.108.52 port 53532 connected with 10.42.108.73 port 5108
[  3]  0.0-518400.0 sec    181 GBytes  3.00 Mbits/sec
[  3] Sent 132242612 datagrams
[  3] Server Report:
[  3]  0.0-518396.3 sec    180 GBytes  2.98 Mbits/sec  0.017 ms 728144/132242612 (0.55%)
[  3]  0.0-518396.3 sec  23090 datagrams received out-of-order

planetlab5.clemson.edu:

------------------------------------------------------------
Client connecting to 10.42.108.100, UDP port 5108
Sending 1470 byte datagrams
UDP buffer size:  110 KByte (default)
------------------------------------------------------------
[  3] local 10.42.108.105 port 49376 connected with 10.42.108.100 port 5108
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-518400.0 sec   181 GBytes  3.00 Mbits/sec
[  3] Sent 132244899 datagrams
[  3] Server Report:
[  3]  0.0-518398.2 sec   180 GBytes  2.99 Mbits/sec   0.234 ms 645100/132244898 (0.49%)
[  3]  0.0-518398.2 sec  4351 datagrams received out-of-order

plnode2.cip.gatech.edu:

------------------------------------------------------------
Client connecting to 10.42.108.51, UDP port 5108
Sending 1470 byte datagrams
UDP buffer size:   122 KByte (default)
------------------------------------------------------------
[  3] local 10.42.108.101 port 56097 connected with 10.42.108.51 port 5108
[  3]  0.0-518400.0 sec    181 GBytes  3.00 Mbits/sec
[  3] Sent 132222403 datagrams
[  3] Server Report:
[  3]  0.0-518395.2 sec    180 GBytes  2.98 Mbits/sec  0.249 ms 779607/132222402 (0.59%)
[  3]  0.0-518395.2 sec  7785 datagrams received out-of-order

pl4.myplc.grnoc.iu.edu:

------------------------------------------------------------
Client connecting to 10.42.108.81, UDP port 5108
Sending 1470 byte datagrams
UDP buffer size:   110 KByte (default)
------------------------------------------------------------
[  3] local 10.42.108.72 port 55153 connected with 10.42.108.81 port 5108
[  3]  0.0-518400.0 sec    181 GBytes  3.00 Mbits/sec
[  3] Sent 132243713 datagrams
[  3] Server Report:
[  3]  0.0-518394.8 sec    174 GBytes  2.88 Mbits/sec  0.461 ms 5174887/132243713 (3.9%)
[  3]  0.0-518394.8 sec  236253 datagrams received out-of-order

of-planet1.stanford.edu:

------------------------------------------------------------
Client connecting to 10.42.108.104, UDP port 5108
Sending 1470 byte datagrams
UDP buffer size:  110 KByte (default)
------------------------------------------------------------
[  3] local 10.42.108.90 port 50333 connected with 10.42.108.104 port 5108
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-518400.0 sec   181 GBytes  3.00 Mbits/sec
[  3] Sent 132238535 datagrams
[  3] WARNING: did not receive ack of last datagram after 10 tries.

pl01.cs.washington.edu:

------------------------------------------------------------
Client connecting to 10.42.108.91, UDP port 5108
Sending 1470 byte datagrams
UDP buffer size:   110 KByte (default)
------------------------------------------------------------
[  3] local 10.42.108.80 port 59262 connected with 10.42.108.91 port 5108
[  3]  0.0-518400.0 sec    181 GBytes  3.00 Mbits/sec
[  3] Sent 132178204 datagrams
[  3] WARNING: did not receive ack of last datagram after 10 tries.

Comments

of-planet1.stanford.edu didn't get a server report from 10.42.108.104 (on planetlab4.clemson.edu); the server log from planetlab4 said

[  3]  0.0-518392.9 sec   168 GBytes  2.79 Mbits/sec   0.055 ms 9260039/132238535 (7%)
[  3]  0.0-518392.9 sec  370016 datagrams received out-of-order

pl01.cs.washington.edu didn't get a server report from 10.42.108.91 (on of-planet2.stanford.edu); the server log from of-planet2 said

[  3]  0.0-518389.8 sec   170 GBytes  2.81 Mbits/sec   0.640 ms 8362493/132178204 (6.3%)
[  3]  0.0-518389.8 sec  266216 datagrams received out-of-order

We haven't yet analyzed whether the packet loss wass all at once (e.g. during an outage of some sort), or steady throughout the experiment.

plastic-109

SteadyPerf UDP, using port=5109, time=518400, rate=4, and this table of client/server pairs:

client server server address
gardil.gpolab.bbn.com pl02.cs.washington.edu server=10.42.109.81
planetlab5.clemson.edu of-planet1.stanford.edu server=10.42.109.90
plnode1.cip.gatech.edu pl5.myplc.grnoc.iu.edu server=10.42.109.73
pl4.myplc.grnoc.iu.edu planetlab4.clemson.edu server=10.42.109.104
of-planet2.stanford.edu plnode2.cip.gatech.edu server=10.42.109.101
pl01.cs.washington.edu ganel.gpolab.bbn.com server=10.42.109.51

Commands run on each server

server=<ipaddr>
nice -n 19 iperf -u -B $server -p 5109 -s -i 1

Commands run on each client

server=<ipaddr>
nice -n 19 iperf -u -c $server -p 5109 -t 518400 -b 4M

Results

Generated with

subnet=109
for host in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt | sed -r -e 's/.+@//') ; do echo -e "$host:\n\n{{{" ; grep -a -A 10 -B 1 "Client connecting" pgenigpolabbbncom_plastic$subnet\@$host.log ; echo -e "}}}\n" ; done

and then edited slightly to remove artifacts (like control characters, my prompt, etc).

gardil.gpolab.bbn.com:

------------------------------------------------------------
Client connecting to 10.42.109.81, UDP port 5109
Sending 1470 byte datagrams
UDP buffer size:   110 KByte (default)
------------------------------------------------------------
[  3] local 10.42.109.52 port 53366 connected with 10.42.109.81 port 5109
[  3]  0.0-518400.0 sec    241 GBytes  4.00 Mbits/sec
[  3] Sent 176324194 datagrams
[  3] Server Report:
[  3]  0.0-518395.9 sec    228 GBytes  3.78 Mbits/sec  0.475 ms 9547069/176324194 (5.4%)
[  3]  0.0-518395.9 sec  372808 datagrams received out-of-order

planetlab5.clemson.edu:

------------------------------------------------------------
Client connecting to 10.42.109.90, UDP port 5109
Sending 1470 byte datagrams
UDP buffer size:  110 KByte (default)
------------------------------------------------------------
[  3] local 10.42.109.105 port 55745 connected with 10.42.109.90 port 5109
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-518400.0 sec   241 GBytes  4.00 Mbits/sec
[  3] Sent 176326532 datagrams
[  3] WARNING: did not receive ack of last datagram after 10 tries.

plnode1.cip.gatech.edu:

------------------------------------------------------------
Client connecting to 10.42.109.73, UDP port 5109
Sending 1470 byte datagrams
UDP buffer size:   122 KByte (default)
------------------------------------------------------------
[  3] local 10.42.109.100 port 53449 connected with 10.42.109.73 port 5109
[  3]  0.0-518400.0 sec    241 GBytes  4.00 Mbits/sec
[  3] Sent 176283902 datagrams
[  3] Server Report:
[  3]  0.0-518394.3 sec    237 GBytes  3.93 Mbits/sec  0.265 ms 2918333/176283901 (1.7%)
[  3]  0.0-518394.3 sec  10955 datagrams received out-of-order

pl4.myplc.grnoc.iu.edu:

------------------------------------------------------------
Client connecting to 10.42.109.104, UDP port 5109
Sending 1470 byte datagrams
UDP buffer size:   110 KByte (default)
------------------------------------------------------------
[  3] local 10.42.109.72 port 46786 connected with 10.42.109.104 port 5109
[  3]  0.0-518400.0 sec    241 GBytes  4.00 Mbits/sec
[  3] Sent 176325433 datagrams
[  3] Server Report:
[  3]  0.0-518393.8 sec    241 GBytes  3.99 Mbits/sec  0.070 ms 482701/176325433 (0.27%)
[  3]  0.0-518393.8 sec  9389 datagrams received out-of-order

of-planet2.stanford.edu:

------------------------------------------------------------
Client connecting to 10.42.109.101, UDP port 5109
Sending 1470 byte datagrams
UDP buffer size:  110 KByte (default)
------------------------------------------------------------
[  3] local 10.42.109.91 port 46635 connected with 10.42.109.101 port 5109
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-518400.0 sec   241 GBytes  4.00 Mbits/sec
[  3] Sent 176322054 datagrams
[  3] Server Report:
[  3]  0.0-518389.7 sec   228 GBytes  3.78 Mbits/sec   8.052 ms 9696214/176322054 (5.5%)
[  3]  0.0-518389.7 sec  249563 datagrams received out-of-order

pl01.cs.washington.edu:

------------------------------------------------------------
Client connecting to 10.42.109.51, UDP port 5109
Sending 1470 byte datagrams
UDP buffer size:   110 KByte (default)
------------------------------------------------------------
[  3] local 10.42.109.80 port 34978 connected with 10.42.109.51 port 5109
[  3]  0.0-518400.0 sec    241 GBytes  3.99 Mbits/sec
[  3] Sent 176060122 datagrams
[  3] Server Report:
[  3]  0.0-518391.9 sec    228 GBytes  3.79 Mbits/sec  0.014 ms 9165446/176060122 (5.2%)
[  3]  0.0-518391.9 sec  317821 datagrams received out-of-order

Comments

planetlab5.clemson.edu didn't get a server report from 10.42.109.90 (on of-planet2.stanford.edu); the server log from of-planet1 said

[  3]  0.0-518394.4 sec   231 GBytes  3.82 Mbits/sec   0.040 ms 7803344/176326531 (4.4%)
[  3]  0.0-518394.4 sec  224603 datagrams received out-of-order

We haven't yet analyzed whether the packet loss wass all at once (e.g. during an outage of some sort), or steady throughout the experiment.

plastic-110

SteadyPerf UDP, using port=5110, time=518400, rate=5, and this table of client/server pairs:

client server server address
gardil.gpolab.bbn.com plnode1.cip.gatech.edu server=10.42.110.100
planetlab5.clemson.edu ganel.gpolab.bbn.com server=10.42.110.51
plnode2.cip.gatech.edu pl01.cs.washington.edu server=10.42.110.80
pl5.myplc.grnoc.iu.edu of-planet1.stanford.edu server=10.42.110.90
of-planet2.stanford.edu pl4.myplc.grnoc.iu.edu server=10.42.110.72
pl02.cs.washington.edu planetlab4.clemson.edu server=10.42.110.104

Commands run on each server

server=<ipaddr>
nice -n 19 iperf -u -B $server -p 5110 -s -i 1

Commands run on each client

server=<ipaddr>
nice -n 19 iperf -u -c $server -p 5110 -t 518400 -b 5M

Results

Generated with

subnet=110
for host in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt | sed -r -e 's/.+@//') ; do echo -e "$host:\n\n{{{" ; grep -a -A 10 -B 1 "Client connecting" pgenigpolabbbncom_plastic$subnet\@$host.log ; echo -e "}}}\n" ; done

and then edited slightly to remove artifacts (like control characters, my prompt, etc).

gardil.gpolab.bbn.com:

------------------------------------------------------------
Client connecting to 10.42.110.100, UDP port 5110
Sending 1470 byte datagrams
UDP buffer size:   110 KByte (default)
------------------------------------------------------------
[  3] local 10.42.110.52 port 51131 connected with 10.42.110.100 port 5110
[  3]  0.0-518400.0 sec    302 GBytes  5.00 Mbits/sec
[  3] Sent 220406019 datagrams
[  3] Server Report:
[  3]  0.0-518398.6 sec    301 GBytes  4.98 Mbits/sec  0.628 ms 869378/220406019 (0.39%)
[  3]  0.0-518398.6 sec  7401 datagrams received out-of-order

planetlab5.clemson.edu:

------------------------------------------------------------
Client connecting to 10.42.110.51, UDP port 5110
Sending 1470 byte datagrams
UDP buffer size:  110 KByte (default)
------------------------------------------------------------
[  3] local 10.42.110.105 port 43049 connected with 10.42.110.51 port 5110
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-518400.0 sec   302 GBytes  5.00 Mbits/sec
[  3] Sent 220408165 datagrams
[  3] Server Report:
[  3]  0.0-518397.9 sec   301 GBytes  4.98 Mbits/sec   0.012 ms 849461/220408164 (0.39%)
[  3]  0.0-518397.9 sec  11854 datagrams received out-of-order

plnode2.cip.gatech.edu:

------------------------------------------------------------
Client connecting to 10.42.110.80, UDP port 5110
Sending 1470 byte datagrams
UDP buffer size:   122 KByte (default)
------------------------------------------------------------
[  3] local 10.42.110.101 port 35947 connected with 10.42.110.80 port 5110
[  3]  0.0-518400.0 sec    302 GBytes  5.00 Mbits/sec
[  3] Sent 220322807 datagrams
[  3] Server Report:
[  3]  0.0-518397.9 sec    277 GBytes  4.60 Mbits/sec  0.656 ms 17766354/220322806 (8.1%)
[  3]  0.0-518397.9 sec  267152 datagrams received out-of-order

pl5.myplc.grnoc.iu.edu:

------------------------------------------------------------
Client connecting to 10.42.110.90, UDP port 5110
Sending 1470 byte datagrams
UDP buffer size:   110 KByte (default)
------------------------------------------------------------
[  3] local 10.42.110.73 port 38082 connected with 10.42.110.90 port 5110
[  3]  0.0-518400.0 sec    302 GBytes  5.00 Mbits/sec
[  3] Sent 220406063 datagrams
[  3] Server Report:
[  3]  0.0-518389.0 sec    286 GBytes  4.74 Mbits/sec  0.035 ms 11405952/220406063 (5.2%)
[  3]  0.0-518389.0 sec  314715 datagrams received out-of-order

of-planet2.stanford.edu:

------------------------------------------------------------
Client connecting to 10.42.110.72, UDP port 5110
Sending 1470 byte datagrams
UDP buffer size:  110 KByte (default)
------------------------------------------------------------
[  3] local 10.42.110.91 port 39274 connected with 10.42.110.72 port 5110
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-518400.0 sec   302 GBytes  5.00 Mbits/sec
[  3] Sent 220401237 datagrams
[  3] Server Report:
[  3]  0.0-518377.6 sec   278 GBytes  4.60 Mbits/sec   0.017 ms 17439053/220401236 (7.9%)
[  3]  0.0-518377.6 sec  747602 datagrams received out-of-order

pl02.cs.washington.edu:

------------------------------------------------------------
Client connecting to 10.42.110.104, UDP port 5110
Sending 1470 byte datagrams
UDP buffer size:   110 KByte (default)
------------------------------------------------------------
[  3] local 10.42.110.81 port 38285 connected with 10.42.110.104 port 5110
[  3]  0.0-518400.0 sec    301 GBytes  4.99 Mbits/sec
[  3] Sent 220149442 datagrams
[  3] Server Report:
[  3]  0.0-518398.0 sec    289 GBytes  4.78 Mbits/sec  0.340 ms 9251133/220149441 (4.2%)
[  3]  0.0-518398.0 sec  261270 datagrams received out-of-order

Comments

We haven't yet analyzed whether the packet loss wass all at once (e.g. during an outage of some sort), or steady throughout the experiment.