Changes between Version 16 and Version 17 of GENIRacksHome/InstageniRacks/AcceptanceTestStatus/IG-MON-1


Ignore:
Timestamp:
11/21/12 10:44:23 (11 years ago)
Author:
chaos@bbn.com
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • GENIRacksHome/InstageniRacks/AcceptanceTestStatus/IG-MON-1

    v16 v17  
    2323|| 2          || [[Color(yellow,Complete)]]     ||                      ||                    || ([instaticket:24]) retest on BBN rack to verify availability of Emulab source/object tree ||
    2424|| 3          || [[Color(green,Pass)]]          || 2012-11-21           ||                    ||                                                                                           ||
    25 || 4          || [[Color(orange,Blocked)]]      ||                      ||                    || blocked on sudo access to flowvisor VM                                                    ||
     25|| 4          || [[Color(yellow,Blocked-site)]] ||                      ||                    || blocked on receipt of the BBN rack                                                        ||
    2626|| 5          || [[Color(green,Pass)]]          || 2012-05-17           ||                    ||                                                                                           ||
    2727|| 6          || [[Color(orange,Blocked)]]      ||                      || [instaticket:25]   || blocked on resolution of "how to get Emulab version" question for Emulab images           ||
     
    739739 * The source code and identifiable version (e.g. a git tag) can be found for each non-Debian software source
    740740
     741=== Results of testing step 4: 2012-11-21 ===
     742
     743 * Here's the netstat invocation to get all the IPv4/IPv6 listeners:
     744{{{
     745flowvisor,[~],08:08(0)$ sudo netstat -lnp46
     746Active Internet connections (only servers)
     747Proto Recv-Q Send-Q Local Address           Foreign Address         State       PID/Program name
     748tcp        0      0 0.0.0.0:22              0.0.0.0:*               LISTEN      27632/sshd     
     749tcp6       0      0 :::6633                 :::*                    LISTEN      4527/java       
     750tcp6       0      0 :::8080                 :::*                    LISTEN      4527/java       
     751tcp6       0      0 :::8081                 :::*                    LISTEN      4527/java       
     752tcp6       0      0 :::22                   :::*                    LISTEN      27632/sshd     
     753udp6       0      0 :::59945                :::*                                4527/java       
     754}}}
     755 * Looking up the full paths for those listeners:
     756{{{
     757flowvisor,[~],08:08(0)$ sudo ls -l /proc/{27632,4527}/exe
     758lrwxrwxrwx 1 root      root      0 Nov  8 10:44 /proc/27632/exe -> /usr/sbin/sshd
     759lrwxrwxrwx 1 flowvisor flowvisor 0 Oct 11 15:10 /proc/4527/exe -> /usr/lib/jvm/java-6-openjdk-amd64/jre/bin/java
     760}}}
     761 * Get package names:
     762{{{
     763flowvisor,[~],08:15(0)$ dpkg -S /usr/sbin/sshd /usr/lib/jvm/java-6-openjdk-amd64/jre/bin/java
     764openssh-server: /usr/sbin/sshd
     765openjdk-6-jre-headless: /usr/lib/jvm/java-6-openjdk-amd64/jre/bin/java
     766}}}
     767 * We also want to know what program java is running:
     768{{{
     769flowvisor,[~],08:12(0)$ ps -ef | grep 4527
     7701000      4527  4526  0 Oct11 ?        03:48:01 java -server -Xms100M -Xmx2000M -XX:OnError=flowvisor-crash-logger -XX:+UseConcMarkSweepGC -Dorg.flowvisor.config_dir=/usr/local/etc/flowvisor -Dorg.flowvisor.install_dir=/usr/local/libexec/flowvisor -Dderby.system.home=/usr/local/share/db/flowvisor -Dfvlog.configuration=/usr/local/etc/flowvisor/fvlog.config -Dorg.flowvisor.config_dir=/usr/local/etc/flowvisor -Dorg.flowvisor.install_dir=/usr/local/libexec/flowvisor -Dderby.system.home=/usr/local/share/db/flowvisor -Dfvlog.configuration=/usr/local/etc/flowvisor/fvlog.config -Djavax.net.ssl.keyStore=/usr/local/etc/flowvisor/mySSLKeyStore -Djavax.net.ssl.keyStorePassword=CHANGEME_PASSWD -cp /usr/local/libexec/flowvisor/openflow.jar:/usr/local/libexec/flowvisor/xmlrpc-client-3.1.3.jar:/usr/local/libexec/flowvisor/xmlrpc-common-3.1.3.jar:/usr/local/libexec/flowvisor/xmlrpc-server-3.1.3.jar:/usr/local/libexec/flowvisor/commons-logging-1.1.jar:/usr/local/libexec/flowvisor/ws-commons-util-1.0.2.jar:/usr/local/libexec/flowvisor/jsse.jar:/usr/local/libexec/flowvisor/asm-3.0.jar:/usr/local/libexec/flowvisor/cglib-2.2.jar:/usr/local/libexec/flowvisor/commons-codec-1.4.jar:/usr/local/libexec/flowvisor/commons-collections-3.2.1.jar:/usr/local/libexec/flowvisor/commons-dbcp-1.4.jar:/usr/local/libexec/flowvisor/commons-pool-1.5.6.jar:/usr/local/libexec/flowvisor/gson-2.0.jar:/usr/local/libexec/flowvisor/jetty-continuation-7.0.2.v20100331.jar:/usr/local/libexec/flowvisor/jetty-http-7.0.2.v20100331.jar:/usr/local/libexec/flowvisor/jetty-io-7.0.2.v20100331.jar:/usr/local/libexec/flowvisor/jetty-security-7.0.2.v20100331.jar:/usr/local/libexec/flowvisor/jetty-server-7.0.2.v20100331.jar:/usr/local/libexec/flowvisor/jetty-util-7.0.2.v20100331.jar:/usr/local/libexec/flowvisor/servlet-api-2.5.jar:/usr/local/libexec/flowvisor/derby.jar:/usr/local/libexec/flowvisor/derbytools.jar:/usr/local/libexec/flowvisor/jna.jar:/usr/local/libexec/flowvisor/syslog4j-0.9.46-bin.jar:/usr/local/libexec/flowvisor/log4j-1.2.16.jar:/usr/local/libexec/flowvisor/flowvisor.jar org.flowvisor.FlowVisor
     771}}}
     772 * Unpacking that, here are all the paths mentioned in that invocation:
     773{{{
     774/usr/local/etc/flowvisor
     775/usr/local/libexec/flowvisor
     776/usr/local/share/db/flowvisor
     777/usr/local/etc/flowvisor/fvlog.config
     778/usr/local/etc/flowvisor
     779/usr/local/libexec/flowvisor
     780/usr/local/share/db/flowvisor
     781/usr/local/etc/flowvisor/fvlog.config
     782/usr/local/etc/flowvisor/mySSLKeyStore
     783/usr/local/libexec/flowvisor/openflow.jar
     784/usr/local/libexec/flowvisor/xmlrpc-client-3.1.3.jar
     785/usr/local/libexec/flowvisor/xmlrpc-common-3.1.3.jar
     786/usr/local/libexec/flowvisor/xmlrpc-server-3.1.3.jar
     787/usr/local/libexec/flowvisor/commons-logging-1.1.jar
     788/usr/local/libexec/flowvisor/ws-commons-util-1.0.2.jar
     789/usr/local/libexec/flowvisor/jsse.jar
     790/usr/local/libexec/flowvisor/asm-3.0.jar
     791/usr/local/libexec/flowvisor/cglib-2.2.jar
     792/usr/local/libexec/flowvisor/commons-codec-1.4.jar
     793/usr/local/libexec/flowvisor/commons-collections-3.2.1.jar
     794/usr/local/libexec/flowvisor/commons-dbcp-1.4.jar
     795/usr/local/libexec/flowvisor/commons-pool-1.5.6.jar
     796/usr/local/libexec/flowvisor/gson-2.0.jar
     797/usr/local/libexec/flowvisor/jetty-continuation-7.0.2.v20100331.jar
     798/usr/local/libexec/flowvisor/jetty-http-7.0.2.v20100331.jar
     799/usr/local/libexec/flowvisor/jetty-io-7.0.2.v20100331.jar
     800/usr/local/libexec/flowvisor/jetty-security-7.0.2.v20100331.jar
     801/usr/local/libexec/flowvisor/jetty-server-7.0.2.v20100331.jar
     802/usr/local/libexec/flowvisor/jetty-util-7.0.2.v20100331.jar
     803/usr/local/libexec/flowvisor/servlet-api-2.5.jar
     804/usr/local/libexec/flowvisor/derby.jar
     805/usr/local/libexec/flowvisor/derbytools.jar
     806/usr/local/libexec/flowvisor/jna.jar
     807/usr/local/libexec/flowvisor/syslog4j-0.9.46-bin.jar
     808/usr/local/libexec/flowvisor/log4j-1.2.16.jar
     809/usr/local/libexec/flowvisor/flowvisor.jar
     810}}}
     811 * Searching for packages for those:
     812{{{
     813flowvisor,[~],08:15(0)$ dpkg -S /usr/local/etc/flowvisor /usr/local/libexec/flowvisor /usr/local/share/db/flowvisor /usr/local/etc/flowvisor/fvlog.config /usr/local/etc/flowvisor /usr/local/libexec/flowvisor /usr/local/share/db/flowvisor /usr/local/etc/flowvisor/fvlog.config /usr/local/etc/flowvisor/mySSLKeyStore /usr/local/libexec/flowvisor/openflow.jar /usr/local/libexec/flowvisor/xmlrpc-client-3.1.3.jar /usr/local/libexec/flowvisor/xmlrpc-common-3.1.3.jar /usr/local/libexec/flowvisor/xmlrpc-server-3.1.3.jar /usr/local/libexec/flowvisor/commons-logging-1.1.jar /usr/local/libexec/flowvisor/ws-commons-util-1.0.2.jar /usr/local/libexec/flowvisor/jsse.jar /usr/local/libexec/flowvisor/asm-3.0.jar /usr/local/libexec/flowvisor/cglib-2.2.jar /usr/local/libexec/flowvisor/commons-codec-1.4.jar /usr/local/libexec/flowvisor/commons-collections-3.2.1.jar /usr/local/libexec/flowvisor/commons-dbcp-1.4.jar /usr/local/libexec/flowvisor/commons-pool-1.5.6.jar /usr/local/libexec/flowvisor/gson-2.0.jar /usr/local/libexec/flowvisor/jetty-continuation-7.0.2.v20100331.jar /usr/local/libexec/flowvisor/jetty-http-7.0.2.v20100331.jar /usr/local/libexec/flowvisor/jetty-io-7.0.2.v20100331.jar /usr/local/libexec/flowvisor/jetty-security-7.0.2.v20100331.jar /usr/local/libexec/flowvisor/jetty-server-7.0.2.v20100331.jar /usr/local/libexec/flowvisor/jetty-util-7.0.2.v20100331.jar /usr/local/libexec/flowvisor/servlet-api-2.5.jar /usr/local/libexec/flowvisor/derby.jar /usr/local/libexec/flowvisor/derbytools.jar /usr/local/libexec/flowvisor/jna.jar /usr/local/libexec/flowvisor/syslog4j-0.9.46-bin.jar /usr/local/libexec/flowvisor/log4j-1.2.16.jar /usr/local/libexec/flowvisor/flowvisor.jar
     814dpkg-query: no path found matching pattern /usr/local/etc/flowvisor.
     815dpkg-query: no path found matching pattern /usr/local/libexec/flowvisor.
     816dpkg-query: no path found matching pattern /usr/local/share/db/flowvisor.
     817dpkg-query: no path found matching pattern /usr/local/etc/flowvisor/fvlog.config.
     818dpkg-query: no path found matching pattern /usr/local/etc/flowvisor.
     819dpkg-query: no path found matching pattern /usr/local/libexec/flowvisor.
     820dpkg-query: no path found matching pattern /usr/local/share/db/flowvisor.
     821dpkg-query: no path found matching pattern /usr/local/etc/flowvisor/fvlog.config.
     822dpkg-query: no path found matching pattern /usr/local/etc/flowvisor/mySSLKeyStore.
     823dpkg-query: no path found matching pattern /usr/local/libexec/flowvisor/openflow.jar.
     824dpkg-query: no path found matching pattern /usr/local/libexec/flowvisor/xmlrpc-client-3.1.3.jar.
     825dpkg-query: no path found matching pattern /usr/local/libexec/flowvisor/xmlrpc-common-3.1.3.jar.
     826dpkg-query: no path found matching pattern /usr/local/libexec/flowvisor/xmlrpc-server-3.1.3.jar.
     827dpkg-query: no path found matching pattern /usr/local/libexec/flowvisor/commons-logging-1.1.jar.
     828dpkg-query: no path found matching pattern /usr/local/libexec/flowvisor/ws-commons-util-1.0.2.jar.
     829dpkg-query: no path found matching pattern /usr/local/libexec/flowvisor/jsse.jar.
     830dpkg-query: no path found matching pattern /usr/local/libexec/flowvisor/asm-3.0.jar.
     831dpkg-query: no path found matching pattern /usr/local/libexec/flowvisor/cglib-2.2.jar.
     832dpkg-query: no path found matching pattern /usr/local/libexec/flowvisor/commons-codec-1.4.jar.
     833dpkg-query: no path found matching pattern /usr/local/libexec/flowvisor/commons-collections-3.2.1.jar.
     834dpkg-query: no path found matching pattern /usr/local/libexec/flowvisor/commons-dbcp-1.4.jar.
     835dpkg-query: no path found matching pattern /usr/local/libexec/flowvisor/commons-pool-1.5.6.jar.
     836dpkg-query: no path found matching pattern /usr/local/libexec/flowvisor/gson-2.0.jar.
     837dpkg-query: no path found matching pattern /usr/local/libexec/flowvisor/jetty-continuation-7.0.2.v20100331.jar.
     838dpkg-query: no path found matching pattern /usr/local/libexec/flowvisor/jetty-http-7.0.2.v20100331.jar.
     839dpkg-query: no path found matching pattern /usr/local/libexec/flowvisor/jetty-io-7.0.2.v20100331.jar.
     840dpkg-query: no path found matching pattern /usr/local/libexec/flowvisor/jetty-security-7.0.2.v20100331.jar.
     841dpkg-query: no path found matching pattern /usr/local/libexec/flowvisor/jetty-server-7.0.2.v20100331.jar.
     842dpkg-query: no path found matching pattern /usr/local/libexec/flowvisor/jetty-util-7.0.2.v20100331.jar.
     843dpkg-query: no path found matching pattern /usr/local/libexec/flowvisor/servlet-api-2.5.jar.
     844dpkg-query: no path found matching pattern /usr/local/libexec/flowvisor/derby.jar.
     845dpkg-query: no path found matching pattern /usr/local/libexec/flowvisor/derbytools.jar.
     846dpkg-query: no path found matching pattern /usr/local/libexec/flowvisor/jna.jar.
     847dpkg-query: no path found matching pattern /usr/local/libexec/flowvisor/syslog4j-0.9.46-bin.jar.
     848dpkg-query: no path found matching pattern /usr/local/libexec/flowvisor/log4j-1.2.16.jar.
     849dpkg-query: no path found matching pattern /usr/local/libexec/flowvisor/flowvisor.jar.
     850}}}
     851 * Hmm, indeed, flowvisor isn't installed from a package at all:
     852{{{
     853flowvisor,[~],08:17(0)$ dpkg -l | grep -i flow
     854flowvisor,[~],08:17(1)$
     855}}}
     856 * Verifying that we can get versioning information for the packages:
     857{{{
     858flowvisor,[~],08:19(0)$ dpkg -s openssh-server openjdk-6-jre-headless | egrep "^Package:|^Status:|^Maintainer:|^Version:|^$"
     859Package: openssh-server
     860Status: install ok installed
     861Maintainer: Colin Watson <cjwatson@ubuntu.com>
     862Version: 1:5.9p1-5ubuntu1
     863
     864Package: openjdk-6-jre-headless
     865Status: install ok installed
     866Maintainer: Ubuntu Developers <ubuntu-devel-discuss@lists.ubuntu.com>
     867Version: 6b24-1.11.1-4ubuntu3
     868}}}
     869 * Verifying that we can download source for the packages:
     870{{{
     871flowvisor,[~],08:20(0)$ mkdir tmp
     872flowvisor,[~],08:20(0)$ cd tmp/
     873
     874flowvisor,[~/tmp],08:20(0)$ apt-get --download-only source openssh-server=1:5.9p1-5ubuntu1
     875Reading package lists... Done
     876Building dependency tree       
     877Reading state information... Done
     878Picking 'openssh' as source package instead of 'openssh-server'
     879NOTICE: 'openssh' packaging is maintained in the 'Bzr' version control system at:
     880http://anonscm.debian.org/bzr/pkg-ssh/openssh/trunk
     881Please use:
     882bzr branch http://anonscm.debian.org/bzr/pkg-ssh/openssh/trunk
     883to retrieve the latest (possibly unreleased) updates to the package.
     884Need to get 1,363 kB of source archives.
     885Get:1 http://us.archive.ubuntu.com/ubuntu/ precise/main openssh 1:5.9p1-5ubuntu1 (dsc) [2,651 B]
     886Get:2 http://us.archive.ubuntu.com/ubuntu/ precise/main openssh 1:5.9p1-5ubuntu1 (tar) [1,110 kB]
     887Get:3 http://us.archive.ubuntu.com/ubuntu/ precise/main openssh 1:5.9p1-5ubuntu1 (diff) [251 kB]
     888Fetched 1,363 kB in 1s (1,086 kB/s)
     889Download complete and in download only mode
     890
     891flowvisor,[~/tmp],08:21(0)$ apt-get --download-only source openjdk-6-jre-headless=6b24-1.11.1-4ubuntu3
     892Reading package lists... Done
     893Building dependency tree       
     894Reading state information... Done
     895Picking 'openjdk-6' as source package instead of 'openjdk-6-jre-headless'
     896NOTICE: 'openjdk-6' packaging is maintained in the 'Bzr' version control system at:
     897http://bazaar.launchpad.net/~openjdk/openjdk/openjdk6
     898Please use:
     899bzr branch http://bazaar.launchpad.net/~openjdk/openjdk/openjdk6
     900to retrieve the latest (possibly unreleased) updates to the package.
     901Need to get 66.3 MB of source archives.
     902Err http://us.archive.ubuntu.com/ubuntu/ precise-updates/main openjdk-6 6b24-1.11.1-4ubuntu3 (dsc)
     903  404  Not Found [IP: 91.189.91.15 80]
     904Get:1 http://us.archive.ubuntu.com/ubuntu/ precise-updates/main openjdk-6 6b24-1.11.1-4ubuntu3 (tar) [66.1 MB]
     905Err http://us.archive.ubuntu.com/ubuntu/ precise-updates/main openjdk-6 6b24-1.11.1-4ubuntu3 (diff)
     906  404  Not Found [IP: 91.189.91.15 80]
     907Fetched 66.1 MB in 5s (12.9 MB/s)
     908Failed to fetch http://us.archive.ubuntu.com/ubuntu/pool/main/o/openjdk-6/openjdk-6_6b24-1.11.1-4ubuntu3.dsc  404  Not Found [IP: 91.189.91.15 80]
     909Failed to fetch http://us.archive.ubuntu.com/ubuntu/pool/main/o/openjdk-6/openjdk-6_6b24-1.11.1-4ubuntu3.diff.gz  404  Not Found [IP: 91.189.91.15 80]
     910E: Failed to fetch some archives.
     911
     912flowvisor,[~/tmp],08:21(100)$ ls -l
     913total 65888
     914-rw-r--r-- 1 chaos chaos 66100230 Feb 16  2012 openjdk-6_6b24-1.11.1.orig.tar.gz
     915-rw-r--r-- 1 chaos chaos   250819 Apr  2  2012 openssh_5.9p1-5ubuntu1.debian.tar.gz
     916-rw-r--r-- 1 chaos chaos     2651 Apr  2  2012 openssh_5.9p1-5ubuntu1.dsc
     917-rw-r--r-- 1 chaos chaos  1110014 Oct 17  2011 openssh_5.9p1.orig.tar.gz
     918}}}
     919So we can get openjdk itself, but not the Ubuntu-specific patches for it.  That's somewhat surprising to me, but i think not a big deal.  Looking at [http://us.archive.ubuntu.com/ubuntu/pool/main/o/openjdk-6/], it seems that they do have some diffs there, just not the ones we are looking for.
     920
     921I discussed the flowvisor question with Nick Bastin:
     922 * The version installed on flowvisor.utah.geniracks.net is 0.8.2, and is from a repository, not from a package:
     923{{{
     924changeset:   7:49113872e1be
     925branch:      0.8-MAINT
     926user:        Nick Bastin <nick.bastin@gmail.com>
     927date:        Mon Feb 06 17:00:00 2012 -0800
     928summary:     Added tag FV-0.8.2 for changeset e3ef7c2a3463
     929}}}
     930 * The plan is to installed a packaged version of flowvisor on future racks if possible.
     931 * If not possible, we'll revisit whether there's another way to track the information about what is installed so that site admins can get access to it.
     932
    741933== Step 5: identify network-listening software on the control host ==
    742934