wiki:PlasticSlices/Continuation/Round3

Version 2 (modified by Josh Smift, 13 years ago) (diff)

--

Continuation Round 3

In this round, I ran plastic-104, plastic-105, and plastic-106, for about 24 hours, with a somewhat higher data rate for plastic-106.

The raw logs are at http://www.gpolab.bbn.com/plastic-slices/continuation/round-3/.

plastic-104

SteadyPerf UDP, using port=5104, time=518400, rate=3, and this table of client/server pairs:

client server server address
ganel.gpolab.bbn.com wings-openflow-2.wail.wisc.edu server=10.42.104.95
wings-openflow-3.wail.wisc.edu orbitplc2.orbit-lab.org server=10.42.104.112
orbitplc1.orbit-lab.org pl4.myplc.grnoc.iu.edu server=10.42.104.72
pl5.myplc.grnoc.iu.edu sardis.gpolab.bbn.com server=10.42.104.53

One-time prep commands run on each client and server

sudo yum -y install iperf

Commands run on each server

server=<ipaddr>
nice -n 19 iperf -u -B $server -p 5104 -s -i 1

Commands run on each client

server=<ipaddr>
nice -n 19 iperf -u -c $server -p 5104 -t 518400 -b 3M

Results

Generated with

subnet=104
for host in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt | sed -r -e 's/.+@//') ; do echo -e "$host:\n\n{{{" ; grep -A 10 -B 1 "Client connecting" pgenigpolabbbncom_plastic$subnet\@$host.log ; echo -e "}}}\n" ; done

and then edited slightly to remove artifacts (like control characters, my prompt, etc).

ganel.gpolab.bbn.com:

------------------------------------------------------------
Client connecting to 10.42.104.95, UDP port 5104
Sending 1470 byte datagrams
UDP buffer size:   110 KByte (default)
------------------------------------------------------------
[  3] local 10.42.104.51 port 35659 connected with 10.42.104.95 port 5104
[  3]  0.0-419705.3 sec    147 GBytes  3.00 Mbits/sec
[  3] Sent 107067685 datagrams
[  3] Server Report:
[  3]  0.0-419704.5 sec    147 GBytes  3.00 Mbits/sec  0.038 ms 4813/107067685 (0.0045%)
[  3]  0.0-419704.5 sec  382 datagrams received out-of-order

wings-openflow-3.wail.wisc.edu:

------------------------------------------------------------
Client connecting to 10.42.104.112, UDP port 5104
Sending 1470 byte datagrams
UDP buffer size:  110 KByte (default)
------------------------------------------------------------
[  3] local 10.42.104.96 port 42153 connected with 10.42.104.112 port 5104
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-419706.4 sec   147 GBytes  3.00 Mbits/sec
[  3] Sent 107067959 datagrams
[  3] Server Report:
[  3]  0.0-419704.2 sec   147 GBytes  3.00 Mbits/sec   0.032 ms 12488/107067958 (0.012%)
[  3]  0.0-419704.2 sec  324 datagrams received out-of-order

orbitplc1.orbit-lab.org:

------------------------------------------------------------
Client connecting to 10.42.104.72, UDP port 5104
Sending 1470 byte datagrams
UDP buffer size:   110 KByte (default)
------------------------------------------------------------
[  3] local 10.42.104.111 port 60665 connected with 10.42.104.72 port 5104
[  3]  0.0-419708.5 sec    147 GBytes  3.00 Mbits/sec
[  3] Sent 107068503 datagrams
[  3] Server Report:
[  3]  0.0-419707.2 sec    147 GBytes  3.00 Mbits/sec  0.007 ms 4427/107068503 (0.0041%)
[  3]  0.0-419707.2 sec  14579 datagrams received out-of-order

pl5.myplc.grnoc.iu.edu:

------------------------------------------------------------
Client connecting to 10.42.104.53, UDP port 5104
Sending 1470 byte datagrams
UDP buffer size:   110 KByte (default)
------------------------------------------------------------
[  3] local 10.42.104.73 port 52812 connected with 10.42.104.53 port 5104
[  3]  0.0-419710.3 sec    147 GBytes  3.00 Mbits/sec
[  3] Sent 107068943 datagrams
[  3] Server Report:
[  3]  0.0-419708.3 sec    147 GBytes  3.00 Mbits/sec  0.015 ms 3567/107068943 (0.0033%)
[  3]  0.0-419708.3 sec  1269 datagrams received out-of-order

Analysis

All data seems to have been sent successfully (up to three or four nines, anyway).

plastic-105

SteadyPerf TCP, using port=5105, time=518400, and this table of client/server pairs:

client server server address
wings-openflow-2.wail.wisc.edu planetlab5.clemson.edu server=10.42.105.105
planetlab4.clemson.edu navis.gpolab.bbn.com server=10.42.105.55
bain.gpolab.bbn.com plnode2.cip.gatech.edu server=10.42.105.101
plnode1.cip.gatech.edu wings-openflow-3.wail.wisc.edu server=10.42.105.96

One-time prep commands run on each client and server

sudo yum -y install iperf

Commands run on each server

server=<ipaddr>
nice -n 19 iperf -B $server -p 5105 -s -i 1

Commands run on each client

server=<ipaddr>
nice -n 19 iperf -c $server -p 5105 -t 518400

Results

Generated with

subnet=105
for host in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt | sed -r -e 's/.+@//') ; do echo -e "$host:\n\n{{{" ; grep -A 5 -B 1 "Client connecting" pgenigpolabbbncom_plastic$subnet\@$host.log ; echo -e "}}}\n" ; done

and then edited slightly to remove artifacts (like control characters, my prompt, etc).

wings-openflow-2.wail.wisc.edu:

------------------------------------------------------------
Client connecting to 10.42.105.105, TCP port 5105
TCP window size: 16.0 KByte (default)
------------------------------------------------------------
[  3] local 10.42.105.95 port 35647 connected with 10.42.105.105 port 5105
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-419705.2 sec   588 GBytes  12.0 Mbits/sec

planetlab4.clemson.edu:

------------------------------------------------------------
Client connecting to 10.42.105.55, TCP port 5105
TCP window size: 16.0 KByte (default)
------------------------------------------------------------
[  3] local 10.42.105.104 port 50228 connected with 10.42.105.55 port 5105
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-418795.8 sec   309 GBytes  6.34 Mbits/sec

bain.gpolab.bbn.com:

------------------------------------------------------------
Client connecting to 10.42.105.101, TCP port 5105
TCP window size: 16.0 KByte (default)
------------------------------------------------------------
[  3] local 10.42.105.54 port 38101 connected with 10.42.105.101 port 5105
[  3]  0.0-419708.3 sec    244 GBytes  4.98 Mbits/sec

plnode1.cip.gatech.edu:

------------------------------------------------------------
Client connecting to 10.42.105.96, TCP port 5105
TCP window size: 16.0 KByte (default)
------------------------------------------------------------
[  3] local 10.42.105.100 port 40071 connected with 10.42.105.96 port 5105
[  3]  0.0-419709.8 sec  91.2 GBytes  1.87 Mbits/sec

Analysis

A fair bit of variability in transfer speeds, correlating somewhat with latency. Wisconsin - Clemson only goes through two NLR switches (Chicago to Atlanta); Clemson - BBN follows the same path in the core, but has to go from Chicago all the way to Boston, so that makes sense. The results that include GT are harder to explain: BBN - GT is slower than BBN - Clemson, where you might expect it to be faster; and GT - Wisconsin is slowest of all, a factor of six worse than Wisconsin - Clemson. What's up there?

plastic-106

SteadyPerf UDP, using port=5106, time=518400, rate=30, and this table of client/server pairs:

client server server address
planetlab5.clemson.edu wings-openflow-2.wail.wisc.edu server=10.42.106.95
wings-openflow-3.wail.wisc.edu plnode1.cip.gatech.edu server=10.42.106.100
plnode2.cip.gatech.edu bain.gpolab.bbn.com server=10.42.106.54
navis.gpolab.bbn.com planetlab4.clemson.edu server=10.42.106.104

One-time prep commands run on each client and server

sudo yum -y install iperf

Commands run on each server

server=<ipaddr>
nice -n 19 iperf -u -B $server -p 5106 -s -i 1

Commands run on each client

server=<ipaddr>
nice -n 19 iperf -u -c $server -p 5106 -t 518400 -b 30M

Results

Generated with

subnet=106
for host in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt | sed -r -e 's/.+@//') ; do echo -e "$host:\n\n{{{" ; grep -A 10 -B 1 "Client connecting" pgenigpolabbbncom_plastic$subnet\@$host.log ; echo -e "}}}\n" ; done

and then edited slightly to remove artifacts (like control characters, my prompt, etc).

planetlab5.clemson.edu:

------------------------------------------------------------
Client connecting to 10.42.106.95, UDP port 5106
Sending 1470 byte datagrams
UDP buffer size:  110 KByte (default)
------------------------------------------------------------
[  3] local 10.42.106.105 port 41280 connected with 10.42.106.95 port 5106
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-419322.8 sec  1572460575840 bits  30.0 Mbits/sec
[  3] Sent 1069701072 datagrams
[  3] Server Report:
[  3]  0.0-419322.2 sec  1572384115260 bits  30.0 Mbits/sec   0.017 ms 52013/1069701071 (0.0049%)
[  3]  0.0-419322.2 sec  1007 datagrams received out-of-order

wings-openflow-3.wail.wisc.edu:

------------------------------------------------------------
Client connecting to 10.42.106.100, UDP port 5106
Sending 1470 byte datagrams
UDP buffer size:  110 KByte (default)
------------------------------------------------------------
[  3] local 10.42.106.96 port 56629 connected with 10.42.106.100 port 5106
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-419316.3 sec  1572435738720 bits  30.0 Mbits/sec
[  3] Sent 1069684176 datagrams
[  3] Server Report:
[  3]  0.0-419315.7 sec  1572337244310 bits  30.0 Mbits/sec   0.665 ms 67002/1069684175 (0.0063%)
[  3]  0.0-419315.7 sec  974 datagrams received out-of-order

plnode2.cip.gatech.edu:

------------------------------------------------------------
Client connecting to 10.42.106.54, UDP port 5106
Sending 1470 byte datagrams
UDP buffer size:   122 KByte (default)
------------------------------------------------------------
[  3] local 10.42.106.101 port 53570 connected with 10.42.106.54 port 5106
[  3]  0.0-419059.7 sec  1569792559650 bits  30.0 Mbits/sec
[  3] Sent 1067886095 datagrams
[  3] Server Report:
[  3]  0.0-419059.1 sec  1452686435550 bits  27.7 Mbits/sec  0.147 ms 79664030/1067886095 (7.5%)
[  3]  0.0-419059.1 sec  891 datagrams received out-of-order

navis.gpolab.bbn.com:

------------------------------------------------------------
Client connecting to 10.42.106.104, UDP port 5106
Sending 1470 byte datagrams
UDP buffer size:   110 KByte (default)
------------------------------------------------------------
[  3] local 10.42.106.55 port 47163 connected with 10.42.106.104 port 5106
[  3]  0.0-418994.1 sec  1571221703940 bits  30.0 Mbits/sec
[  3] Sent 1068858302 datagrams
[  3] Server Report:
[  3]  0.0-418993.5 sec  1571147854080 bits  30.0 Mbits/sec  0.011 ms 50238/1068858302 (0.0047%)
[  3]  0.0-418993.5 sec  786 datagrams received out-of-order

Analysis

With one exception, all data seems to have been sent successfully (up to four nines, anyway).

The exception: GT - BBN, which had 7.5% packet loss. Could this (which also included plnode1) be related to the poor results with plnode1 in plastic-105?