wiki:PlasticSlices/Continuation/Round7

Continuation Round 7

In this round, we ran all ten slices, but only with five sites (BBN, Clemson, Rutgers, Stanford, and Wisconsin). The goal was to turn off static ARP, testing before and after to see if there were any significant differences, so the results are in two parts.

We found that turning off static ARP didn't seem to have any effect.

The raw logs are at http://www.gpolab.bbn.com/plastic-slices/continuation/round-7/ (with 'before' and 'after' subdirectories).

plastic-101

SteadyPing, using interval=.006, and this table of client/server pairs:

client server server address
ganel.gpolab.bbn.com planetlab5.clemson.edu server=10.42.101.105
planetlab4.clemson.edu orbitplc2.orbit-lab.org server=10.42.101.112
orbitplc1.orbit-lab.org of-planet2.stanford.edu server=10.42.101.91
of-planet1.stanford.edu wings-openflow-3.wail.wisc.edu server=10.42.101.96
wings-openflow-2.wail.wisc.edu gardil.gpolab.bbn.com server=10.42.101.52

Commands run on each client

server=<ipaddr>
sudo ping -i .006 -s $((1500-8-20)) $server

Results

Generated from the logs with

subnet=101
for host in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt | sed -r -e 's/.+@//') ; do echo -e "$host:\n\n{{{" ; grep -A 2 statistics pgenigpolabbbncom_plastic$subnet\@$host.log ; echo -e "}}}\n" ; done

Before

ganel.gpolab.bbn.com:

--- 10.42.101.105 ping statistics ---
941082 packets transmitted, 940947 received, 0% packet loss, time 9977354ms
rtt min/avg/max/mdev = 149.822/149.933/1139.422/5.297 ms, pipe 108

planetlab4.clemson.edu:

--- 10.42.101.112 ping statistics ---
917778 packets transmitted, 917777 received, 0% packet loss, time 9996943ms
rtt min/avg/max/mdev = 21.630/21.745/787.495/3.931 ms, pipe 79

orbitplc1.orbit-lab.org:

--- 10.42.101.91 ping statistics ---
937322 packets transmitted, 937314 received, 0% packet loss, time 10001187ms
rtt min/avg/max/mdev = 84.958/85.178/1300.406/7.700 ms, pipe 124

of-planet1.stanford.edu:

--- 10.42.101.96 ping statistics ---
959879 packets transmitted, 959695 received, 0% packet loss, time 10003472ms
rtt min/avg/max/mdev = 104.232/104.489/1357.755/8.042 ms, pipe 139

wings-openflow-2.wail.wisc.edu:

--- 10.42.101.52 ping statistics ---
976113 packets transmitted, 976078 received, 0% packet loss, time 10004226ms
rtt min/avg/max/mdev = 184.064/184.265/1614.520/8.073 ms, pipe 159

After

ganel.gpolab.bbn.com:

--- 10.42.101.105 ping statistics ---
706662 packets transmitted, 706401 received, 0% packet loss, time 7521614ms
rtt min/avg/max/mdev = 149.821/149.951/1146.214/6.423 ms, pipe 110

planetlab4.clemson.edu:

--- 10.42.101.112 ping statistics ---
691112 packets transmitted, 691060 received, 0% packet loss, time 7531971ms
rtt min/avg/max/mdev = 21.633/21.819/751.095/4.331 ms, pipe 76

orbitplc1.orbit-lab.org:

--- 10.42.101.91 ping statistics ---
708916 packets transmitted, 708662 received, 0% packet loss, time 7538560ms
rtt min/avg/max/mdev = 84.958/85.187/1227.795/7.769 ms, pipe 115

of-planet1.stanford.edu:

--- 10.42.101.96 ping statistics ---
721561 packets transmitted, 720714 received, 0% packet loss, time 7542461ms
rtt min/avg/max/mdev = 104.238/104.651/3380.193/20.170 ms, pipe 353

wings-openflow-2.wail.wisc.edu:

--- 10.42.101.52 ping statistics ---
736072 packets transmitted, 735894 received, 0% packet loss, time 7546202ms
rtt min/avg/max/mdev = 184.062/184.323/1570.865/10.927 ms, pipe 154

Analysis

No significant changes between before and after.

plastic-102

SteadyPing, using interval=.006, and this table of client/server pairs:

client server server address
navis.gpolab.bbn.com planetlab4.clemson.edu server=10.42.102.104
planetlab5.clemson.edu orbitplc1.orbit-lab.org server=10.42.102.111
orbitplc2.orbit-lab.org of-planet2.stanford.edu server=10.42.102.91
of-planet1.stanford.edu wings-openflow-2.wail.wisc.edu server=10.42.102.95
wings-openflow-3.wail.wisc.edu bain.gpolab.bbn.com server=10.42.102.54

Commands run on each client

server=<ipaddr>
sudo ping -i .006 -s $((1500-8-20)) $server

Results

Generated from the logs with

subnet=102
for host in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt | sed -r -e 's/.+@//') ; do echo -e "$host:\n\n{{{" ; grep -A 2 statistics pgenigpolabbbncom_plastic$subnet\@$host.log ; echo -e "}}}\n" ; done

Before

navis.gpolab.bbn.com:

--- 10.42.102.104 ping statistics ---
912434 packets transmitted, 891167 received, 2% packet loss, time 9919048ms
rtt min/avg/max/mdev = 165.402/165.538/1173.916/6.100 ms, pipe 108

planetlab5.clemson.edu:

--- 10.42.102.111 ping statistics ---
941054 packets transmitted, 941052 received, 0% packet loss, time 9974776ms
rtt min/avg/max/mdev = 21.630/21.708/731.143/3.080 ms, pipe 72

orbitplc2.orbit-lab.org:

--- 10.42.102.91 ping statistics ---
934387 packets transmitted, 934379 received, 0% packet loss, time 9953167ms
rtt min/avg/max/mdev = 84.957/85.169/1245.585/6.840 ms, pipe 118

of-planet1.stanford.edu:

--- 10.42.102.95 ping statistics ---
894014 packets transmitted, 892809 received, 0% packet loss, time 9945707ms
rtt min/avg/max/mdev = 79.015/79.335/1623.424/10.954 ms, pipe 152

wings-openflow-3.wail.wisc.edu:

--- 10.42.102.54 ping statistics ---
999966 packets transmitted, 999963 received, 0% packet loss, time 9938799ms
rtt min/avg/max/mdev = 29.611/29.727/420.635/1.294 ms, pipe 47

After

navis.gpolab.bbn.com:

--- 10.42.102.104 ping statistics ---
694840 packets transmitted, 678137 received, 2% packet loss, time 7542030ms
rtt min/avg/max/mdev = 165.400/165.585/1393.510/9.185 ms, pipe 129

planetlab5.clemson.edu:

--- 10.42.102.111 ping statistics ---
711361 packets transmitted, 711116 received, 0% packet loss, time 7546491ms
rtt min/avg/max/mdev = 21.630/21.796/897.986/5.239 ms, pipe 89

orbitplc2.orbit-lab.org:

--- 10.42.102.91 ping statistics ---
712762 packets transmitted, 712614 received, 0% packet loss, time 7573392ms
rtt min/avg/max/mdev = 84.958/85.231/1524.702/11.002 ms, pipe 149

of-planet1.stanford.edu:

--- 10.42.102.95 ping statistics ---
680834 packets transmitted, 677924 received, 0% packet loss, time 7576467ms
rtt min/avg/max/mdev = 79.024/79.380/2124.789/15.292 ms, pipe 197

wings-openflow-3.wail.wisc.edu:

--- 10.42.102.54 ping statistics ---
762503 packets transmitted, 762431 received, 0% packet loss, time 7579203ms
rtt min/avg/max/mdev = 29.609/29.764/802.375/4.564 ms, pipe 81

Analysis

No significant changes between before and after.

(There were a couple of hiccups in traffic to and from Clemson, but they were consistent before and after as well.)

plastic-103

SteadyPerf TCP, using port=5103, time=518400, and this table of client/server pairs:

client server server address
of-planet1.stanford.edu ganel.gpolab.bbn.com server=10.42.103.51
gardil.gpolab.bbn.com orbitplc1.orbit-lab.org server=10.42.103.111
of-planet2.stanford.edu sardis.gpolab.bbn.com server=10.42.103.53
orbitplc2.orbit-lab.org of-planet3.stanford.edu server=10.42.103.92

One-time prep commands run on each client and server

sudo yum -y install iperf

Commands run on each server

server=<ipaddr>
nice -n 19 iperf -B $server -p 5103 -s -i 1

Commands run on each client

server=<ipaddr>
nice -n 19 iperf -c $server -p 5103 -t 518400

Results

Generated with

subnet=103
for host in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt | sed -r -e 's/.+@//') ; do echo -e "$host:\n\n{{{" ; grep -a -A 5 -B 1 "Client connecting" pgenigpolabbbncom_plastic$subnet\@$host.log ; echo -e "}}}\n" ; done

and then edited slightly to remove artifacts (like control characters, my prompt, etc).

Before

of-planet1.stanford.edu:

------------------------------------------------------------
Client connecting to 10.42.103.51, TCP port 5103
TCP window size: 16.0 KByte (default)
------------------------------------------------------------
[  3] local 10.42.103.90 port 46194 connected with 10.42.103.51 port 5103
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-9878.7 sec  2.75 GBytes  2.39 Mbits/sec

gardil.gpolab.bbn.com:

------------------------------------------------------------
Client connecting to 10.42.103.111, TCP port 5103
TCP window size: 16.0 KByte (default)
------------------------------------------------------------
[  3] local 10.42.103.52 port 46734 connected with 10.42.103.111 port 5103
[  3]  0.0-9882.2 sec  3.01 GBytes  2.62 Mbits/sec

of-planet2.stanford.edu:

------------------------------------------------------------
Client connecting to 10.42.103.53, TCP port 5103
TCP window size: 16.0 KByte (default)
------------------------------------------------------------
[  3] local 10.42.103.91 port 52930 connected with 10.42.103.53 port 5103
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-9883.1 sec  2.75 GBytes  2.39 Mbits/sec

orbitplc2.orbit-lab.org:

------------------------------------------------------------
Client connecting to 10.42.103.92, TCP port 5103
TCP window size: 16.0 KByte (default)
------------------------------------------------------------
[  3] local 10.42.103.112 port 59972 connected with 10.42.103.92 port 5103
write2 failed: Connection timed out
[  3]  0.0-950.8 sec  14.1 KBytes    122 bits/sec

After

of-planet1.stanford.edu:

------------------------------------------------------------
Client connecting to 10.42.103.51, TCP port 5103
TCP window size: 16.0 KByte (default)
------------------------------------------------------------
[  3] local 10.42.103.90 port 51092 connected with 10.42.103.51 port 5103
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-7524.5 sec  2.09 GBytes  2.38 Mbits/sec

gardil.gpolab.bbn.com:

------------------------------------------------------------
Client connecting to 10.42.103.111, TCP port 5103
TCP window size: 16.0 KByte (default)
------------------------------------------------------------
[  3] local 10.42.103.52 port 49304 connected with 10.42.103.111 port 5103
[  3]  0.0-7535.5 sec  2.29 GBytes  2.60 Mbits/sec

of-planet2.stanford.edu:

------------------------------------------------------------
Client connecting to 10.42.103.53, TCP port 5103
TCP window size: 16.0 KByte (default)
------------------------------------------------------------
[  3] local 10.42.103.91 port 56627 connected with 10.42.103.53 port 5103
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-7538.6 sec  2.10 GBytes  2.39 Mbits/sec

orbitplc2.orbit-lab.org:

------------------------------------------------------------
Client connecting to 10.42.103.92, TCP port 5103
TCP window size: 16.0 KByte (default)
------------------------------------------------------------
[  3] local 10.42.103.112 port 35457 connected with 10.42.103.92 port 5103
write2 failed: Connection timed out
[  3]  0.0-953.6 sec  14.1 KBytes    121 bits/sec

Analysis

No significant changes between before and after. (of-planet3.stanford.edu (10.42.103.92) continues to be essentially unusable, and will be dropped from future rounds.)

plastic-104

SteadyPerf UDP, using port=5104, time=518400, rate=3, and this table of client/server pairs:

client server server address
ganel.gpolab.bbn.com wings-openflow-2.wail.wisc.edu server=10.42.104.95
wings-openflow-3.wail.wisc.edu orbitplc2.orbit-lab.org server=10.42.104.112
orbitplc1.orbit-lab.org sardis.gpolab.bbn.com server=10.42.104.53

One-time prep commands run on each client and server

sudo yum -y install iperf

Commands run on each server

server=<ipaddr>
nice -n 19 iperf -u -B $server -p 5104 -s -i 1

Commands run on each client

server=<ipaddr>
nice -n 19 iperf -u -c $server -p 5104 -t 518400 -b 3M

Results

Generated with

subnet=104
for host in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt | sed -r -e 's/.+@//') ; do echo -e "$host:\n\n{{{" ; grep -A 10 -B 1 "Client connecting" pgenigpolabbbncom_plastic$subnet\@$host.log ; echo -e "}}}\n" ; done

and then edited slightly to remove artifacts (like control characters, my prompt, etc).

Before

ganel.gpolab.bbn.com:

------------------------------------------------------------
Client connecting to 10.42.104.95, UDP port 5104
Sending 1470 byte datagrams
UDP buffer size:   110 KByte (default)
------------------------------------------------------------
[  3] local 10.42.104.51 port 60118 connected with 10.42.104.95 port 5104
[  3]  0.0-9717.4 sec  3.39 GBytes  3.00 Mbits/sec
[  3] Sent 2478937 datagrams
[  3] Server Report:
[  3]  0.0-9716.3 sec  3.39 GBytes  3.00 Mbits/sec  0.039 ms   68/2478937 (0.0027%)
[  3]  0.0-9716.3 sec  244 datagrams received out-of-order

wings-openflow-3.wail.wisc.edu:

------------------------------------------------------------
Client connecting to 10.42.104.112, UDP port 5104
Sending 1470 byte datagrams
UDP buffer size:  110 KByte (default)
------------------------------------------------------------
[  3] local 10.42.104.96 port 49321 connected with 10.42.104.112 port 5104
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-9723.1 sec  3.40 GBytes  3.00 Mbits/sec
[  3] Sent 2480376 datagrams
[  3] Server Report:
[  3]  0.0-9722.4 sec  3.40 GBytes  3.00 Mbits/sec   0.050 ms  515/2480376 (0.021%)
[  3]  0.0-9722.4 sec  151 datagrams received out-of-order

orbitplc1.orbit-lab.org:

------------------------------------------------------------
Client connecting to 10.42.104.53, UDP port 5104
Sending 1470 byte datagrams
UDP buffer size:   110 KByte (default)
------------------------------------------------------------
[  3] local 10.42.104.111 port 37080 connected with 10.42.104.53 port 5104
[  3]  0.0-9723.3 sec  3.40 GBytes  3.00 Mbits/sec
[  3] Sent 2480436 datagrams
[  3] Server Report:
[  3]  0.0-9723.2 sec  3.40 GBytes  3.00 Mbits/sec  0.009 ms    1/2480436 (4e-05%)
[  3]  0.0-9723.2 sec  39 datagrams received out-of-order

After

ganel.gpolab.bbn.com:

------------------------------------------------------------
Client connecting to 10.42.104.95, UDP port 5104
Sending 1470 byte datagrams
UDP buffer size:   110 KByte (default)
------------------------------------------------------------
[  3] local 10.42.104.51 port 42578 connected with 10.42.104.95 port 5104
[  3]  0.0-7507.8 sec  2.62 GBytes  3.00 Mbits/sec
[  3] Sent 1915257 datagrams
[  3] Server Report:
[  3]  0.0-7505.1 sec  2.62 GBytes  3.00 Mbits/sec  0.024 ms  680/1915257 (0.036%)
[  3]  0.0-7505.1 sec  204 datagrams received out-of-order

wings-openflow-3.wail.wisc.edu:

------------------------------------------------------------
Client connecting to 10.42.104.112, UDP port 5104
Sending 1470 byte datagrams
UDP buffer size:  110 KByte (default)
------------------------------------------------------------
[  3] local 10.42.104.96 port 57234 connected with 10.42.104.112 port 5104
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-7513.3 sec  2.62 GBytes  3.00 Mbits/sec
[  3] Sent 1916670 datagrams
[  3] Server Report:
[  3]  0.0-7510.6 sec  2.62 GBytes  3.00 Mbits/sec   0.020 ms 1156/1916670 (0.06%)
[  3]  0.0-7510.6 sec  167 datagrams received out-of-order

orbitplc1.orbit-lab.org:

------------------------------------------------------------
Client connecting to 10.42.104.53, UDP port 5104
Sending 1470 byte datagrams
UDP buffer size:   110 KByte (default)
------------------------------------------------------------
[  3] local 10.42.104.111 port 38183 connected with 10.42.104.53 port 5104
[  3]  0.0-7518.6 sec  2.63 GBytes  3.00 Mbits/sec
[  3] Sent 1918015 datagrams
[  3] Server Report:
[  3]  0.0-7518.1 sec  2.63 GBytes  3.00 Mbits/sec  0.007 ms   85/1918015 (0.0044%)
[  3]  0.0-7518.1 sec  44 datagrams received out-of-order

Analysis

No significant changes between before and after.

plastic-105

SteadyPerf TCP, using port=5105, time=518400, and this table of client/server pairs:

client server server address
wings-openflow-2.wail.wisc.edu planetlab5.clemson.edu server=10.42.105.105
planetlab4.clemson.edu navis.gpolab.bbn.com server=10.42.105.55
bain.gpolab.bbn.com wings-openflow-3.wail.wisc.edu server=10.42.105.96

One-time prep commands run on each client and server

sudo yum -y install iperf

Commands run on each server

server=<ipaddr>
nice -n 19 iperf -B $server -p 5105 -s -i 1

Commands run on each client

server=<ipaddr>
nice -n 19 iperf -c $server -p 5105 -t 518400

Results

Generated with

subnet=105
for host in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt | sed -r -e 's/.+@//') ; do echo -e "$host:\n\n{{{" ; grep -A 5 -B 1 "Client connecting" pgenigpolabbbncom_plastic$subnet\@$host.log ; echo -e "}}}\n" ; done

and then edited slightly to remove artifacts (like control characters, my prompt, etc).

Before

wings-openflow-2.wail.wisc.edu:

------------------------------------------------------------
Client connecting to 10.42.105.105, TCP port 5105
TCP window size: 16.0 KByte (default)
------------------------------------------------------------
[  3] local 10.42.105.95 port 39703 connected with 10.42.105.105 port 5105
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-9645.5 sec  6.36 GBytes  5.66 Mbits/sec

planetlab4.clemson.edu:

------------------------------------------------------------
Client connecting to 10.42.105.55, TCP port 5105
TCP window size: 16.0 KByte (default)
------------------------------------------------------------
[  3] local 10.42.105.104 port 46986 connected with 10.42.105.55 port 5105
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-9652.0 sec  1.80 GBytes  1.60 Mbits/sec

bain.gpolab.bbn.com:

------------------------------------------------------------
Client connecting to 10.42.105.96, TCP port 5105
TCP window size: 16.0 KByte (default)
------------------------------------------------------------
[  3] local 10.42.105.54 port 38827 connected with 10.42.105.96 port 5105
[  3]  0.0-9652.7 sec  19.1 GBytes  17.0 Mbits/sec

After

wings-openflow-2.wail.wisc.edu:

------------------------------------------------------------
Client connecting to 10.42.105.105, TCP port 5105
TCP window size: 16.0 KByte (default)
------------------------------------------------------------
[  3] local 10.42.105.95 port 59397 connected with 10.42.105.105 port 5105
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-7434.4 sec  5.24 GBytes  6.06 Mbits/sec

planetlab4.clemson.edu:

------------------------------------------------------------
Client connecting to 10.42.105.55, TCP port 5105
TCP window size: 16.0 KByte (default)
------------------------------------------------------------
[  3] local 10.42.105.104 port 54460 connected with 10.42.105.55 port 5105
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-7457.8 sec  1.39 GBytes  1.61 Mbits/sec

bain.gpolab.bbn.com:

------------------------------------------------------------
Client connecting to 10.42.105.96, TCP port 5105
TCP window size: 16.0 KByte (default)
------------------------------------------------------------
[  3] local 10.42.105.54 port 45867 connected with 10.42.105.96 port 5105
[  3]  0.0-7461.6 sec  14.7 GBytes  17.0 Mbits/sec

Analysis

No significant changes between before and after.

plastic-106

SteadyPerf UDP, using port=5106, time=518400, rate=3, and this table of client/server pairs:

client server server address
planetlab5.clemson.edu wings-openflow-2.wail.wisc.edu server=10.42.106.95
wings-openflow-3.wail.wisc.edu bain.gpolab.bbn.com server=10.42.106.54
navis.gpolab.bbn.com planetlab4.clemson.edu server=10.42.106.104

One-time prep commands run on each client and server

sudo yum -y install iperf

Commands run on each server

server=<ipaddr>
nice -n 19 iperf -u -B $server -p 5106 -s -i 1

Commands run on each client

server=<ipaddr>
nice -n 19 iperf -u -c $server -p 5106 -t 518400 -b 3M

Results

Generated with

subnet=106
for host in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt | sed -r -e 's/.+@//') ; do echo -e "$host:\n\n{{{" ; grep -A 10 -B 1 "Client connecting" pgenigpolabbbncom_plastic$subnet\@$host.log ; echo -e "}}}\n" ; done

and then edited slightly to remove artifacts (like control characters, my prompt, etc).

Before

planetlab5.clemson.edu:

------------------------------------------------------------
Client connecting to 10.42.106.95, UDP port 5106
Sending 1470 byte datagrams
UDP buffer size:  110 KByte (default)
------------------------------------------------------------
[  3] local 10.42.106.105 port 46285 connected with 10.42.106.95 port 5106
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-9594.0 sec  3.35 GBytes  3.00 Mbits/sec
[  3] Sent 2447449 datagrams
[  3] Server Report:
[  3]  0.0-9593.5 sec  3.35 GBytes  3.00 Mbits/sec   0.024 ms  774/2447448 (0.032%)
[  3]  0.0-9593.5 sec  137 datagrams received out-of-order

wings-openflow-3.wail.wisc.edu:

------------------------------------------------------------
Client connecting to 10.42.106.54, UDP port 5106
Sending 1470 byte datagrams
UDP buffer size:  110 KByte (default)
------------------------------------------------------------
[  3] local 10.42.106.96 port 37807 connected with 10.42.106.54 port 5106
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-9594.0 sec  3.35 GBytes  3.00 Mbits/sec
[  3] Sent 2447452 datagrams
[  3] Server Report:
[  3]  0.0-9593.9 sec  3.35 GBytes  3.00 Mbits/sec   0.014 ms  559/2447451 (0.023%)
[  3]  0.0-9593.9 sec  42 datagrams received out-of-order

navis.gpolab.bbn.com:

------------------------------------------------------------
Client connecting to 10.42.106.104, UDP port 5106
Sending 1470 byte datagrams
UDP buffer size:   110 KByte (default)
------------------------------------------------------------
[  3] local 10.42.106.55 port 55383 connected with 10.42.106.104 port 5106
[  3]  0.0-9591.7 sec  3.35 GBytes  3.00 Mbits/sec
[  3] Sent 2446856 datagrams
[  3] Server Report:
[  3]  0.0-9591.2 sec  3.35 GBytes  3.00 Mbits/sec  0.032 ms    2/2446856 (8.2e-05%)
[  3]  0.0-9591.2 sec  114 datagrams received out-of-order

After

planetlab5.clemson.edu:

------------------------------------------------------------
Client connecting to 10.42.106.95, UDP port 5106
Sending 1470 byte datagrams
UDP buffer size:  110 KByte (default)
------------------------------------------------------------
[  3] local 10.42.106.105 port 44896 connected with 10.42.106.95 port 5106
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-7462.5 sec  2.61 GBytes  3.00 Mbits/sec
[  3] Sent 1903693 datagrams
[  3] Server Report:
[  3]  0.0-7460.4 sec  2.60 GBytes  3.00 Mbits/sec   0.025 ms 1050/1903693 (0.055%)
[  3]  0.0-7460.4 sec  143 datagrams received out-of-order

wings-openflow-3.wail.wisc.edu:

------------------------------------------------------------
Client connecting to 10.42.106.54, UDP port 5106
Sending 1470 byte datagrams
UDP buffer size:  110 KByte (default)
------------------------------------------------------------
[  3] local 10.42.106.96 port 51947 connected with 10.42.106.54 port 5106
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-7468.0 sec  2.61 GBytes  3.00 Mbits/sec
[  3] Sent 1905101 datagrams
[  3] Server Report:
[  3]  0.0-7467.6 sec  2.61 GBytes  3.00 Mbits/sec   0.016 ms  541/1905100 (0.028%)
[  3]  0.0-7467.6 sec  41 datagrams received out-of-order

navis.gpolab.bbn.com:

------------------------------------------------------------
Client connecting to 10.42.106.104, UDP port 5106
Sending 1470 byte datagrams
UDP buffer size:   110 KByte (default)
------------------------------------------------------------
[  3] local 10.42.106.55 port 35826 connected with 10.42.106.104 port 5106
[  3]  0.0-7473.4 sec  2.61 GBytes  3.00 Mbits/sec
[  3] Sent 1906481 datagrams
[  3] Server Report:
[  3]  0.0-7471.4 sec  2.61 GBytes  3.00 Mbits/sec  0.065 ms  377/1906481 (0.02%)
[  3]  0.0-7471.4 sec  130 datagrams received out-of-order

Analysis

No significant changes between before and after.

plastic-107

SteadyWeb, using port=4107, file=substrate.doc, md5sum=d4fcf71833327fbfef98be09deef8bfb, and this table of client/server pairs:

client server server address
planetlab5.clemson.edu planetlab4.clemson.edu server=10.42.107.104

One-time prep commands run on each server

sudo yum -y install pyOpenSSL patch
cd
rm -rf ~/gigaweb
mkdir -p ~/gigaweb/docroot

cd ~/gigaweb
wget http://code.activestate.com/recipes/442473-simple-http-server-supporting-ssl-secure-communica/download/1/ -O httpsd.py
wget http://groups.geni.net/geni/attachment/wiki/PlasticSlices/Experiments/httpsd.py.patch?format=raw -O httpsd.py.patch
patch httpsd.py httpsd.py.patch
rm httpsd.py.patch

cd ~/gigaweb/docroot
wget http://groups.geni.net/geni/attachment/wiki/DeliverablePage/Spiral1%20substrate%20catalog.doc?format=raw -O substrate.doc

cd ~/gigaweb
openssl genrsa -passout pass:localhost -des3 -rand /dev/urandom -out localhost.localdomain.key 1024
openssl req -subj /CN=localhost.localdomain -passin pass:localhost -new -key localhost.localdomain.key -out localhost.localdomain.csr
openssl x509 -passin pass:localhost -req -days 3650 -in localhost.localdomain.csr -signkey localhost.localdomain.key -out localhost.localdomain.crt
openssl rsa -passin pass:localhost -in localhost.localdomain.key -out decrypted.localhost.localdomain.key
mv -f decrypted.localhost.localdomain.key localhost.localdomain.key
cat localhost.localdomain.key localhost.localdomain.crt > localhost.localdomain.pem
rm localhost.localdomain.key localhost.localdomain.crt localhost.localdomain.csr

Commands run on each server

server=<ipaddr>
cd ~/gigaweb/docroot
python ../httpsd.py $server 4107

Commands run on each client

server=<ipaddr>
cd
rm -rf ~/gigaweb
mkdir ~/gigaweb
cd ~/gigaweb
while true ; do wget --no-check-certificate https://$server:4107/substrate.doc -O substrate.doc ; echo -n "md5sum: " ; md5sum substrate.doc ; rm substrate.doc ; done

Results

Since we transfered the file to each client hundreds (if not thousands) of times, we didn't save all the copies, but we did generate an MD5 checksum after each download, and log that, so we ran some grep commands on the logs to count the number of total checksums printed in each log, and the number where the checksum had the expected value.

Generated with

subnet=107
for host in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt | sed -r -e 's/.+@//') ; do echo -e -n "$host:\n\n{{{\ntotal md5sum lines: " ; grep "md5sum:" pgenigpolabbbncom_plastic$subnet\@$host.log | wc -l ; echo -e -n "matching md5sum lines: " ; grep "md5sum: d4fcf71833327fbfef98be09deef8bfb" pgenigpolabbbncom_plastic$subnet\@$host.log | wc -l ; echo -e "}}}\n" ; done

Before

planetlab5.clemson.edu:

total md5sum lines: 11536
matching md5sum lines: 11535

After

planetlab5.clemson.edu:

total md5sum lines: 8968
matching md5sum lines: 8967

Analysis

No significant changes between before and after -- we got more transfers before than after just because we ran the experiment for longer.

plastic-108

SteadyWeb, using port=4108, file=substrate.doc, md5sum=d4fcf71833327fbfef98be09deef8bfb, and this table of client/server pairs:

client server server address
wings-openflow-3.wail.wisc.edu of-planet2.stanford.edu server=10.42.108.91
of-planet1.stanford.edu orbitplc1.orbit-lab.org server=10.42.108.111
orbitplc2.orbit-lab.org wings-openflow-2.wail.wisc.edu server=10.42.108.95

One-time prep commands run on each server

sudo yum -y install pyOpenSSL patch
cd
rm -rf ~/gigaweb
mkdir -p ~/gigaweb/docroot

cd ~/gigaweb
wget http://code.activestate.com/recipes/442473-simple-http-server-supporting-ssl-secure-communica/download/1/ -O httpsd.py
wget http://groups.geni.net/geni/attachment/wiki/PlasticSlices/Experiments/httpsd.py.patch?format=raw -O httpsd.py.patch
patch httpsd.py httpsd.py.patch
rm httpsd.py.patch

cd ~/gigaweb/docroot
wget http://groups.geni.net/geni/attachment/wiki/DeliverablePage/Spiral1%20substrate%20catalog.doc?format=raw -O substrate.doc

cd ~/gigaweb
openssl genrsa -passout pass:localhost -des3 -rand /dev/urandom -out localhost.localdomain.key 1024
openssl req -subj /CN=localhost.localdomain -passin pass:localhost -new -key localhost.localdomain.key -out localhost.localdomain.csr
openssl x509 -passin pass:localhost -req -days 3650 -in localhost.localdomain.csr -signkey localhost.localdomain.key -out localhost.localdomain.crt
openssl rsa -passin pass:localhost -in localhost.localdomain.key -out decrypted.localhost.localdomain.key
mv -f decrypted.localhost.localdomain.key localhost.localdomain.key
cat localhost.localdomain.key localhost.localdomain.crt > localhost.localdomain.pem
rm localhost.localdomain.key localhost.localdomain.crt localhost.localdomain.csr

Commands run on each server

server=<ipaddr>
cd ~/gigaweb/docroot
python ../httpsd.py $server 4108

Commands run on each client

server=<ipaddr>
cd
rm -rf ~/gigaweb
mkdir ~/gigaweb
cd ~/gigaweb
while true ; do wget --no-check-certificate https://$server:4108/substrate.doc -O substrate.doc ; echo -n "md5sum: " ; md5sum substrate.doc ; rm substrate.doc ; done

Results

Since we transfered the file to each client hundreds (if not thousands) of times, we didn't save all the copies, but we did generate an MD5 checksum after each download, and log that, so we ran some grep commands on the logs to count the number of total checksums printed in each log, and the number where the checksum had the expected value.

Generated with

subnet=108
for host in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt | sed -r -e 's/.+@//') ; do echo -e -n "$host:\n\n{{{\ntotal md5sum lines: " ; grep "md5sum:" pgenigpolabbbncom_plastic$subnet\@$host.log | wc -l ; echo -e -n "matching md5sum lines: " ; grep "md5sum: d4fcf71833327fbfef98be09deef8bfb" pgenigpolabbbncom_plastic$subnet\@$host.log | wc -l ; echo -e "}}}\n" ; done

Before

wings-openflow-3.wail.wisc.edu:

total md5sum lines: 745
matching md5sum lines: 744

of-planet1.stanford.edu:

total md5sum lines: 662
matching md5sum lines: 661

orbitplc2.orbit-lab.org:

total md5sum lines: 248
matching md5sum lines: 247

After

wings-openflow-3.wail.wisc.edu:

total md5sum lines: 589
matching md5sum lines: 588

of-planet1.stanford.edu:

total md5sum lines: 516
matching md5sum lines: 515

orbitplc2.orbit-lab.org:

total md5sum lines: 195
matching md5sum lines: 194

Analysis

No significant changes between before and after -- we got more transfers before than after just because we ran the experiment for longer.

plastic-109

SteadyNetcat, using port=6109, file=substrate.doc, md5sum=d4fcf71833327fbfef98be09deef8bfb, and this table of client/server pairs:

client server server address
gardil.gpolab.bbn.com planetlab5.clemson.edu server=10.42.109.105
planetlab4.clemson.edu of-planet1.stanford.edu server=10.42.109.90
of-planet2.stanford.edu wings-openflow-3.wail.wisc.edu server=10.42.109.96
wings-openflow-2.wail.wisc.edu ganel.gpolab.bbn.com server=10.42.109.51

One-time prep commands run on each server

sudo yum -y install nc
mkdir -p ~/giganetcat
cd ~/giganetcat
wget http://groups.geni.net/geni/attachment/wiki/DeliverablePage/Spiral1%20substrate%20catalog.doc?format=raw -O substrate.doc

One-time prep commands run on each client

sudo yum -y install nc

Commands run on each server

server=<ipaddr>
cd ~/giganetcat
while true ; do nc -l $server 6109 < substrate.doc ; done

Commands run on each client

server=<ipaddr>
cd
rm -rf ~/giganetcat
mkdir ~/giganetcat
cd ~/giganetcat
while true ; do nc $server 6109 > substrate.doc ; echo -n "$(date "+%F %T")  " ; md5sum substrate.doc ; rm substrate.doc ; done

Results

Since we transfered the file to each client hundreds (if not thousands) of times, we didn't save all the copies, but we did generate an MD5 checksum after each download, and log that, so we ran some grep commands on the logs to count the number of total checksums printed in each log, and the number where the checksum had the expected value.

Generated with

subnet=109
for host in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt | sed -r -e 's/.+@//') ; do echo -e -n "$host:\n\n{{{\ntotal md5sum lines: " ; grep "substrate.doc" pgenigpolabbbncom_plastic$subnet\@$host.log | wc -l ; echo -e -n "matching md5sum lines: " ; grep "d4fcf71833327fbfef98be09deef8bfb  substrate.doc" pgenigpolabbbncom_plastic$subnet\@$host.log | wc -l ; echo -e "}}}\n" ; done

Before

gardil.gpolab.bbn.com:

total md5sum lines: 289
matching md5sum lines: 288

planetlab4.clemson.edu:

total md5sum lines: 830
matching md5sum lines: 811

of-planet2.stanford.edu:

total md5sum lines: 546
matching md5sum lines: 545

wings-openflow-2.wail.wisc.edu:

total md5sum lines: 269
matching md5sum lines: 268

After

gardil.gpolab.bbn.com:

total md5sum lines: 231
matching md5sum lines: 230

planetlab4.clemson.edu:

total md5sum lines: 661
matching md5sum lines: 653

of-planet2.stanford.edu:

total md5sum lines: 434
matching md5sum lines: 433

wings-openflow-2.wail.wisc.edu:

total md5sum lines: 215
matching md5sum lines: 214

Analysis

No significant changes between before and after -- we got more transfers before than after just because we ran the experiment for longer.

(There were a couple of hiccups in traffic to and from Clemson, but they were consistent before and after as well.)

plastic-110

SteadyNetcat, using port=6110, file=substrate.doc, md5sum=d4fcf71833327fbfef98be09deef8bfb, and this table of client/server pairs:

client server server address
bain.gpolab.bbn.com of-planet1.stanford.edu server=10.42.110.90
of-planet2.stanford.edu orbitplc2.orbit-lab.org server=10.42.110.112
orbitplc1.orbit-lab.org navis.gpolab.bbn.com server=10.42.110.55

One-time prep commands run on each server

sudo yum -y install nc
mkdir -p ~/giganetcat
cd ~/giganetcat
wget http://groups.geni.net/geni/attachment/wiki/DeliverablePage/Spiral1%20substrate%20catalog.doc?format=raw -O substrate.doc

One-time prep commands run on each client

sudo yum -y install nc

Commands run on each server

server=<ipaddr>
cd ~/giganetcat
while true ; do nc -l $server 6110 < substrate.doc ; done

Commands run on each client

server=<ipaddr>
cd
rm -rf ~/giganetcat
mkdir ~/giganetcat
cd ~/giganetcat
while true ; do nc $server 6110 > substrate.doc ; echo -n "$(date "+%F %T")  " ; md5sum substrate.doc ; rm substrate.doc ; done

Results

Since we transfered the file to each client hundreds (if not thousands) of times, we didn't save all the copies, but we did generate an MD5 checksum after each download, and log that, so we ran some grep commands on the logs to count the number of total checksums printed in each log, and the number where the checksum had the expected value.

Generated with

subnet=110
for host in $(awk 'NR%2==1' ~/plastic-slices/logins/logins-plastic-$subnet.txt | sed -r -e 's/.+@//') ; do echo -e -n "$host:\n\n{{{\ntotal md5sum lines: " ; grep "substrate.doc" pgenigpolabbbncom_plastic$subnet\@$host.log | wc -l ; echo -e -n "matching md5sum lines: " ; grep "d4fcf71833327fbfef98be09deef8bfb  substrate.doc" pgenigpolabbbncom_plastic$subnet\@$host.log | wc -l ; echo -e "}}}\n" ; done

Before

bain.gpolab.bbn.com:

total md5sum lines: 402
matching md5sum lines: 401

of-planet2.stanford.edu:

total md5sum lines: 655
matching md5sum lines: 654

orbitplc1.orbit-lab.org:

total md5sum lines: 280
matching md5sum lines: 278

After

bain.gpolab.bbn.com:

total md5sum lines: 320
matching md5sum lines: 319

of-planet2.stanford.edu:

total md5sum lines: 513
matching md5sum lines: 512

orbitplc1.orbit-lab.org:

total md5sum lines: 222
matching md5sum lines: 221

Analysis

No significant changes between before and after -- we got more transfers before than after just because we ran the experiment for longer.

Last modified 12 years ago Last modified on 03/12/12 10:42:04