Changes between Version 19 and Version 20 of GENIRacksHome/InstageniRacks/AcceptanceTestStatus/IG-MON-1

Timestamp:

01/07/13 17:12:32 (11 years ago)

Author:

chaos@bbn.com

Comment:

--

GENIRacksHome/InstageniRacks/AcceptanceTestStatus/IG-MON-1

@@ -336 +336 @@
 
 === Results of testing step 1: 2012-05-27 ===
+
+ * In fact `sockstat -lL46` is my goto on FreeBSD.  Get a full list of all binaries of processes which are listening on IPv4 or IPv6 sockets from non-localhost addresses:
+{{{
+boss,[~],09:05(0)$ for pid in $(sockstat -lL46 | awk '{print $3}' | grep -v PID | sort -u); do procstat -b $pid; done | awk '{print $3}' | sort -u
+procstat: sysctl: kern.proc.pathname: 1340: No such file or directory
+procstat: sysctl: kern.proc.pathname: 1341: No such file or directory
+procstat: sysctl: kern.proc.pathname: 1342: No such file or directory
+procstat: sysctl: kern.proc.pathname: 1343: No such file or directory
+procstat: sysctl: kern.proc.pathname: 1344: No such file or directory
+procstat: sysctl: kern.proc.pathname: 1345: No such file or directory
+procstat: sysctl: kern.proc.pathname: 1346: No such file or directory
+procstat: sysctl: kern.proc.pathname: 1347: No such file or directory
+procstat: sysctl: kern.proc.pathname: 1348: No such file or directory
+procstat: sysctl: kern.proc.pathname: 1349: No such file or directory
+procstat: sysctl: kern.proc.pathname: 1350: No such file or directory
+procstat: sysctl: kern.proc.pathname: 1351: No such file or directory
+procstat: sysctl: kern.proc.pathname: 1352: No such file or directory
+procstat: sysctl: kern.proc.pathname: 1353: No such file or directory
+/usr/libexec/sendmail/sendmail
+/usr/local/bin/python2.6
+/usr/local/libexec/pubsubd
+/usr/local/libexec/tftpd
+/usr/local/sbin/dhcpd
+/usr/local/sbin/httpd
+/usr/sbin/inetd
+/usr/sbin/lwresd
+/usr/sbin/mountd
+/usr/sbin/nfsd
+/usr/sbin/ntpd
+/usr/sbin/rpcbind
+/usr/sbin/sshd
+/usr/sbin/syslogd
+/usr/testbed/sbin/bootinfo
+/usr/testbed/sbin/mfrisbeed
+/usr/testbed/sbin/sdcollectd
+PATH
+}}}
+ * Huh, well, that's weird.  All the PIDs procstat choked on seem to be tmcd and its children.  So we can call the list:
+{{{
+/usr/testbed/sbin/tmcd
+/usr/libexec/sendmail/sendmail
+/usr/local/bin/python2.6
+/usr/local/libexec/pubsubd
+/usr/local/libexec/tftpd
+/usr/local/sbin/dhcpd
+/usr/local/sbin/httpd
+/usr/sbin/inetd
+/usr/sbin/lwresd
+/usr/sbin/mountd
+/usr/sbin/nfsd
+/usr/sbin/ntpd
+/usr/sbin/rpcbind
+/usr/sbin/sshd
+/usr/sbin/syslogd
+/usr/testbed/sbin/bootinfo
+/usr/testbed/sbin/mfrisbeed
+/usr/testbed/sbin/sdcollectd
+}}}
+ * The following commands are sourced from freebsd packages:
+{{{
+$ pkg_info -W /usr/local/bin/python2.6
+/usr/local/bin/python2.6 was installed by package python26-2.6.6
+
+$ pkg_info -W /usr/local/libexec/pubsubd
+/usr/local/libexec/pubsubd was installed by package pubsub-0.95
+
+$ pkg_info -W /usr/local/libexec/tftpd
+/usr/local/libexec/tftpd was installed by package emulab-tftp-hpa-0.48
+
+$ pkg_info -W /usr/local/sbin/dhcpd
+/usr/local/sbin/dhcpd was installed by package isc-dhcp42-server-4.2.3_1
+
+$ pkg_info -W /usr/local/sbin/httpd
+/usr/local/sbin/httpd was installed by package apache-2.2.21
+}}}
+   * So the summary of sourced packages here is:
+{{{
+apache-2.2.21
+emulab-tftp-hpa-0.48
+isc-dhcp42-server-4.2.3_1
+pubsub-0.95
+python26-2.6.6
+}}}
+   * For each of these, i can verify using the distinfo that /usr/ports seems to have the same version as is installed:
+{{{
+$ cat /usr/ports/www/apache22/distinfo 
+SHA256 (apache22/httpd-2.2.21.tar.bz2) = 18d5591fe48cfbac44fc20316036ffe17456df60bc3a2aaad238d56c6445577f
+SIZE (apache22/httpd-2.2.21.tar.bz2) = 5324905
+
+$ cat /usr/ports/misc/emulab-tftp-hpa/distinfo 
+MD5 (tftp-hpa-0.48.tar.gz) = 73dd29dfa9062a174163f6a267e0b5f7
+SHA256 (tftp-hpa-0.48.tar.gz) = 0bba7dc69a0174b8a9d5b340fa79c9c4874c61a880fe1cd8129e7644dd0967bb
+SIZE (tftp-hpa-0.48.tar.gz) = 104844
+
+$ cat /usr/ports/net/isc-dhcp42-server/distinfo 
+SHA256 (dhcp-4.2.3-P1.tar.gz) = 4860625e07c290768d513b9a2260e655ae4bad4cc5c4c8f5eaaeb4f9cbfa96af
+SIZE (dhcp-4.2.3-P1.tar.gz) = 9525670
+
+$ cat /usr/ports/misc/emulab-pubsub/distinfo 
+MD5 (pubsub-0.9.tar.gz) = 25216f20821bb7094a1853b1771cb5b8
+MD5 (pubsub-0.95.tar.gz) = 9e012e65ebb4979e99f686e5f8fa8104
+SHA256 (pubsub-0.95.tar.gz) = 7b8eb4f495a531454b16abb8e8399e031fa17a31e09c4ce47486cedaa3ae4410
+
+$ cat /usr/ports/lang/python26/distinfo 
+MD5 (python/Python-2.6.6.tgz) = b2f209df270a33315e62c1ffac1937f0
+SHA256 (python/Python-2.6.6.tgz) = 372f66db46d773214e4619df1794a26449158f626138d4d2141a64c2f017fae1
+SIZE (python/Python-2.6.6.tgz) = 13318547
+}}}
+
+ * The following commands aren't part of packages (`pkg_info -W` reports nothing):
+{{{
+/usr/testbed/sbin/tmcd
+/usr/testbed/sbin/bootinfo
+/usr/testbed/sbin/mfrisbeed
+/usr/testbed/sbin/sdcollectd
+/usr/libexec/sendmail/sendmail
+/usr/sbin/inetd
+/usr/sbin/lwresd             # hard link from /usr/sbin/named
+/usr/sbin/mountd
+/usr/sbin/nfsd
+/usr/sbin/ntpd
+/usr/sbin/rpcbind
+/usr/sbin/sshd
+/usr/sbin/syslogd
+}}}
+ * The assumption is that these are either part of the FreeBSD base system, or are part of Emulab.  How do we find out which?
+   * Since Emulab has been compiled recently, i can look in the canonical source of that compile, which i believe is `/users/stoller/testbed/obj`.  Here's a process for checking various things in `/usr/testbed/sbin`, on the suspicion that they are probably Emulab binaries:
+{{{
+shortname=bootinfo    # or whatever
+shortmd5=$(md5 /usr/testbed/sbin/$shortname | awk '{print $4}')
+for path in $(find . -type f -name $shortname 2> /dev/null); do md5 $path; done | grep $shortmd5
+}}}
+   * That finds that the following items are indeed from Emulab:
+{{{
+/usr/testbed/sbin/bootinfo:            ./pxe/bootinfo
+/usr/testbed/sbin/mfrisbeed:           ./clientside/os/frisbee.redux/mfrisbeed
+/usr/testbed/sbin/sdcollectd:          ./clientside/sensors/slothd/sdcollectd
+/usr/testbed/sbin/tmcd:                ./tmcd/tmcd
+}}}
+   * Note that, in instaticket:24, we found that on a non-development rack, source and object files will be found in `/usr/testbed/{src,obj}/emulab-stable`.
+ * So the following items are not from Emulab, and we assume they would be part of the base install:
+{{{
+/usr/libexec/sendmail/sendmail
+/usr/sbin/inetd
+/usr/sbin/lwresd             # hard link from /usr/sbin/named
+/usr/sbin/mountd
+/usr/sbin/nfsd
+/usr/sbin/ntpd
+/usr/sbin/rpcbind
+/usr/sbin/sshd
+/usr/sbin/syslogd
+}}}
+   * If the OS had been compiled recently, i could look in /usr/obj for binaries which were identical to things on the system.  Since it's running the base install, find out what version that is:
+{{{
+$ uname -r
+8.3-RC1
+}}}
+   * Hmm, so it looks like [http://lists.freebsd.org/pipermail/freebsd-stable/2012-March/066722.html 8.3-RC1] is not exactly the version which became [http://lists.freebsd.org/pipermail/freebsd-announce/2012-April/001417.html 8.3-RELEASE].  I did a bit of poking around to find the i386 install disc for 8.3-RC1, eventually locating a copy at [http://ftp.at.freebsd.org/pub/FreeBSD/ISO-IMAGES-i386/8.3/FreeBSD-8.3-RC1-i386-disc1.iso]
+   * Loopback-mounted that on my desktop:
+{{{
+sudo mount -o loop FreeBSD-8.3-RC1-i386-disc1.iso /mnt/iso
+mkdir -p ~/tmp/8.3-RC1/{base,src}
+cd ~/tmp/8.3-RC1/base
+cat /mnt/iso/8.3-RC1/base/base.?? | tar xvzf -
+cd ~/tmp/8.3-RC1/src
+dists="base bin cddl contrib crypto etc games gnu include krb5 lib libexec release rescue sbin secure share sys tools ubin usbin"
+for dist in $dists; do
+  cat /mnt/iso/8.3-RC1/src/s${dist}.?? | tar xvzf -
+done
+}}}
+   * So, this isn't perfect, in that at a glance, the object checksums don't match between what is on boss and what i found in this iso.  However:
+     * It definitely would tell someone which items are part of the freebsd base distribution (if i find `~/tmp/8.3-RC1/base/usr/sbin/inetd`, then `boss:/usr/sbin/inetd` has been verified to come from FreeBSD)
+     * I can look at the source code from which the object was presumably taken, even if i can't verify that the object is unmodified.
+   * Using this, i verified that all the non-Emulab-sourced, non-packaged listeners on boss are indeed from the FreeBSD base distribution.
+
+All that remains is to retest on the BBN rack once it arrives, and verify that the Emulab source distribution lands in a reasonable place.
+
+=== Results of testing step 1: 2013-01-07 ===
 
  * In fact `sockstat -lL46` is my goto on FreeBSD.  Get a full list of all binaries of processes which are listening on IPv4 or IPv6 sockets from non-localhost addresses: