22 | | || 1A || [[Color(#63B8FF,In Progress)]] || || || || |
23 | | || 1B || [[Color(#63B8FF,In Progress)]] || || || || |
24 | | || 2A || [[Color(#63B8FF,In Progress)]] || || || || |
25 | | || 2B || [[Color(#63B8FF,In Progress)]] || || || || |
| 22 | || 1A || [[Color(green,Pass)]] || 2013-03-08 || || || |
| 23 | || 1B || [[Color(green,Pass)]] || 2013-03-08 || || || |
| 24 | || 2A || [[Color(green,Pass)]] || 2013-03-08 || || || |
| 25 | || 2B || [[Color(green,Pass)]] || 2013-03-08 || || || |
83 | | FIXME: Update the date to the date on which we actually do the test. |
84 | | |
85 | | FIXME: Fill this in when we actually do the test. |
| 83 | I was able to log in to control.instageni.gpolab.bbn.com, and sudo: |
| 84 | |
| 85 | {{{ |
| 86 | [14:12:37] jbs@gpolab:/home/jbs |
| 87 | +$ hostname |
| 88 | gpolab.control-nodes.geniracks.net |
| 89 | |
| 90 | [14:12:46] jbs@gpolab:/home/jbs |
| 91 | +$ sudo whoami |
| 92 | root |
| 93 | }}} |
| 94 | |
| 95 | I browsed to https://www.instageni.gpolab.bbn.com/, logged in, and clicked on the green dot (which turned red) to enter "red dot mode". |
| 96 | |
| 97 | I browsed to https://boss.instageni.gpolab.bbn.com/nodecontrol_list.php3?showtype=dl360, and observed that all five nodes are up or free (green dot or white dot in the "Up?" column of the table). |
| 98 | |
| 99 | I browsed to http://monitor.gpolab.bbn.com/nagios/cgi-bin/status.cgi?hostgroup=all&style=detail&sorttype=2&sortoption=3, and found no InstaGENI-relevant errors. |
| 100 | |
| 101 | I ran getversion and listresources against the BBN rack PG AM: |
| 102 | |
| 103 | {{{ |
| 104 | omni -a https://instageni.gpolab.bbn.com:12369/protogeni/xmlrpc/am getversion |
| 105 | omni -a https://instageni.gpolab.bbn.com:12369/protogeni/xmlrpc/am listresources |
| 106 | }}} |
| 107 | |
| 108 | The output was quite long, so I didn't paste it here. |
| 109 | |
| 110 | I ran omni getversion and listresources against the BBN rack FOAM AM: |
| 111 | |
| 112 | {{{ |
| 113 | omni -a https://foam.instageni.gpolab.bbn.com:3626/foam/gapi/1 getversion |
| 114 | omni -a https://foam.instageni.gpolab.bbn.com:3626/foam/gapi/1 listresources |
| 115 | }}} |
| 116 | |
| 117 | The output was quite long, so I didn't paste it here. |
| 118 | |
| 119 | I verified that http://monitor.gpolab.bbn.com/connectivity/campus.html showed that the connection from argos to instageni-vlan1750.bbn.dataplane.geni.net is OK. |
118 | | FIXME: Update the date to the date on which we actually do the test. |
119 | | |
120 | | FIXME: Fill this in when we actually do the test. |
| 152 | On boss, I shut down the testbed: |
| 153 | |
| 154 | {{{ |
| 155 | sudo testbed-control shutdown |
| 156 | }}} |
| 157 | |
| 158 | I then shut down the nodes: |
| 159 | |
| 160 | {{{ |
| 161 | for node in pc{1..5} ; do sudo ssh $node shutdown -H now ; done |
| 162 | }}} |
| 163 | |
| 164 | This didn't actually seem to shut down pc1 or pc2, which I was still able to ping and SSH in to, even after five minutes. I logged in interactively to pc1, and it said |
| 165 | |
| 166 | {{{ |
| 167 | System is going down. |
| 168 | |
| 169 | Last login: Fri Mar 8 14:25:04 2013 from boss.instageni.gpolab.bbn.com |
| 170 | [root@vhost1 ~]# |
| 171 | }}} |
| 172 | |
| 173 | I tried doing the shutdown command there: |
| 174 | |
| 175 | {{{ |
| 176 | [root@vhost1 ~]# shutdown -H now |
| 177 | |
| 178 | Broadcast message from root@vhost1.shared-nodes.emulab-ops.instageni.gpolab.bbn.com on pts/0 (Fri, 08 Mar 2013 14:26:52 -0500): |
| 179 | |
| 180 | The system is going down for system halt NOW! |
| 181 | }}} |
| 182 | |
| 183 | But, the system still didn't shut down. I tried init 0 instead: |
| 184 | |
| 185 | {{{ |
| 186 | [root@vhost1 ~]# sudo init 0 |
| 187 | |
| 188 | Broadcast message from root@vhost1.shared-nodes.emulab-ops.instageni.gpolab.bbn.com on pts/0 (Fri, 08 Mar 2013 14:27:18 -0500): |
| 189 | |
| 190 | The system is going down for power-off NOW! |
| 191 | }}} |
| 192 | |
| 193 | But the system still didn't shut down. |
| 194 | |
| 195 | ...ah, but then finally, about six or seven minutes after I'd first run the shutdown, they did shut down. Ok. |
| 196 | |
| 197 | I logged out of boss, and logged in to control, and shut down the VMs that run there: |
| 198 | |
| 199 | {{{ |
| 200 | sudo xm shutdown -a -w |
| 201 | }}} |
| 202 | |
| 203 | I then shut down control itself: |
| 204 | |
| 205 | {{{ |
| 206 | sudo init 0 && exit |
| 207 | }}} |
| 208 | |
| 209 | I was out of the office, but remote hands (aka "Peter") visually verified that only the control node and pc1 actually powered off; he powered everything else off. |
177 | | FIXME: Update the date to the date on which we actually do the test. |
178 | | |
179 | | FIXME: Fill this in when we actually do the test. |
| 264 | I was able to log in to control.instageni.gpolab.bbn.com, and sudo: |
| 265 | |
| 266 | {{{ |
| 267 | [15:07:23] jbs@gpolab:/home/jbs |
| 268 | +$ hostname |
| 269 | gpolab.control-nodes.geniracks.net |
| 270 | |
| 271 | [15:07:24] jbs@gpolab:/home/jbs |
| 272 | +$ sudo whoami |
| 273 | root |
| 274 | }}} |
| 275 | |
| 276 | I browsed to https://www.instageni.gpolab.bbn.com/, and it said |
| 277 | |
| 278 | {{{ |
| 279 | Web Interface Temporarily Unavailable |
| 280 | Please Try Again Later |
| 281 | Testbed going offline; back in a little while |
| 282 | }}} |
| 283 | |
| 284 | Leigh reports that this was due to a missing instruction in the docs, so I logged in to boss, and ran |
| 285 | |
| 286 | {{{ |
| 287 | sudo testbed-control boot |
| 288 | }}} |
| 289 | |
| 290 | I was then able to browse to https://www.instageni.gpolab.bbn.com/ and log in. |
| 291 | |
| 292 | I browsed to https://boss.instageni.gpolab.bbn.com/nodecontrol_list.php3?showtype=dl360, and observed that all five nodes are up or free (green dot or white dot in the "Up?" column of the table). |
| 293 | |
| 294 | I browsed to http://monitor.gpolab.bbn.com/nagios/cgi-bin/status.cgi?hostgroup=all&style=detail&sorttype=2&sortoption=3, and found errors related to amcanary trying to getversion and listresources from FOAM and PG on the rack. I scheduled a manual check of those, and it passed. |
| 295 | |
| 296 | I ran getversion and listresources against the BBN rack PG AM: |
| 297 | |
| 298 | {{{ |
| 299 | omni -a https://instageni.gpolab.bbn.com:12369/protogeni/xmlrpc/am getversion |
| 300 | omni -a https://instageni.gpolab.bbn.com:12369/protogeni/xmlrpc/am listresources |
| 301 | }}} |
| 302 | |
| 303 | The output was quite long, so I didn't paste it here. |
| 304 | |
| 305 | I ran omni getversion and listresources against the BBN rack FOAM AM: |
| 306 | |
| 307 | {{{ |
| 308 | omni -a https://foam.instageni.gpolab.bbn.com:3626/foam/gapi/1 getversion |
| 309 | omni -a https://foam.instageni.gpolab.bbn.com:3626/foam/gapi/1 listresources |
| 310 | }}} |
| 311 | |
| 312 | The output was quite long, so I didn't paste it here. |
| 313 | |
| 314 | I verified that http://monitor.gpolab.bbn.com/connectivity/campus.html showed that the connection from argos to instageni-vlan1750.bbn.dataplane.geni.net is OK. |