Changes between Version 23 and Version 24 of GENIRacksHome/ExogeniRacks/ConfirmationTestStatus/FIU


Ignore:
Timestamp:
05/02/13 12:48:07 (11 years ago)
Author:
lnevers@bbn.com
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • GENIRacksHome/ExogeniRacks/ConfirmationTestStatus/FIU

    v23 v24  
    11581158== EG-CT-6 - Administrative Tests ==
    11591159
    1160 
    1161 
    11621160Administrator accounts on an ExoGENI rack are documented at https://wiki.exogeni.net/doku.php?id=public:operators:start, which states:
    11631161
     
    11721170LNM:~$ ssh fiu-hn.exogeni.net
    11731171lnevers@fiu-hn.exogeni.net's password:
    1174 Last login: Wed May  1 18:45:03 2013 from dhcp89-073-014.bbn.com
     1172Last login: Thu May  2 14:53:05 2013 from dhcp89-073-116.bbn.com
    11751173|-----------------------------------------------------------------|
    11761174|                ____ ____ ____ ____ ____ ____ ____               |
     
    11831181[sudo] password for lnevers:
    11841182root
     1183[lnevers@fiu-hn ~]$ id
     1184uid=2107(lnevers) gid=2000(nonrenci) groups=2000(nonrenci),2500(fiuadmins),9500(xoadmins),9503(geni-imf),9510(bbnadmins)
    11851185[lnevers@fiu-hn ~]$
    11861186}}}
    11871187
    1188 From head node verified login and administrative access to each of the worker nodes that supply VMs.
     1188From head node verified login and administrative access to each of the worker nodes that supply VMs.
     1189
     1190'' Note:'' For connections to worker nodes must use workaround described in exoticket:171, where the following must be specified: "sudo ssh -i /opt/orca-12080/xcat/id_rsa root@fiu-w1"
    11891191
    11901192For each worker node execute the following:
    11911193{{{
    1192 lnevers@fiu-hn ~]$ ssh fiu-w1
    1193 lnevers@fiu-w1's password:
    1194 Last login: Wed May  1 18:48:35 2013 from fiu-hn.local
    1195 |-----------------------------------------------------------------|
    1196 |                ____ ____ ____ ____ ____ ____ ____               |
    1197 |               ||E |||x |||o |||G |||E |||N |||I ||              |
    1198 |               ||__|||__|||__|||__|||__|||__|||__||              |
    1199 |               |/__\|/__\|/__\|/__\|/__\|/__\|/__\|              |
    1200 |                                                                 |
    1201 |-----------------------------------------------------------------|
    1202 [lnevers@fiu-w1 ~]$ sudo whoami
    1203 
    1204 [sudo] password for lnevers:
    1205 lnevers is not in the sudoers file.  This incident will be reported.
    1206 
    1207 }}}
    1208 
    1209 '' Note:'' For connections to worker nodes must use workaround described in exoticket:171, where the following must be specified: "sudo ssh -i /opt/orca-12080/xcat/id_rsa root@fiu-w1"
     1194[lnevers@fiu-hn ~]$ for i in 1 2 3 4 5 6 7 8 9 10
     1195> do
     1196> echo "===> Connecting to fiu-w$i"
     1197> sudo ssh -i /etc/orca/am+broker-12080/xcat/id_rsa  root@fiu-w$i "whoami;uptime"
     1198> echo ""
     1199> done
     1200===> Connecting to fiu-w1
     1201root
     1202 16:31:01 up 93 days, 19:40,  0 users,  load average: 1.05, 1.05, 1.00
     1203
     1204===> Connecting to fiu-w2
     1205root
     1206 16:31:01 up 82 days, 22:01,  0 users,  load average: 1.06, 1.05, 1.00
     1207
     1208===> Connecting to fiu-w3
     1209root
     1210 16:31:01 up 93 days, 19:41,  0 users,  load average: 1.07, 1.03, 1.00
     1211
     1212===> Connecting to fiu-w4
     1213root
     1214 16:31:02 up 93 days, 19:40,  0 users,  load average: 2.09, 2.10, 2.08
     1215
     1216===> Connecting to fiu-w5
     1217root
     1218 16:31:02 up 93 days, 19:40,  0 users,  load average: 1.05, 1.07, 1.05
     1219
     1220===> Connecting to fiu-w6
     1221root
     1222 16:31:02 up 93 days, 19:40,  0 users,  load average: 1.00, 1.05, 1.07
     1223
     1224===> Connecting to fiu-w7
     1225root
     1226 16:31:02 up 93 days, 19:40,  0 users,  load average: 1.14, 1.10, 1.09
     1227
     1228===> Connecting to fiu-w8
     1229root
     1230 16:31:02 up 93 days, 19:40,  0 users,  load average: 0.92, 1.04, 1.02
     1231
     1232===> Connecting to fiu-w9
     1233ssh: connect to host fiu-w9 port 22: No route to host
     1234
     1235===> Connecting to fiu-w10
     1236root
     1237 11:32:45 up 20:51,  0 users,  load average: 0.00, 0.00, 0.00
     1238}}}
     1239
    12101240
    12111241Connect to the management switch:
    12121242{{{
    12131243[lnevers@fiu-hn ~]$ ssh fiu-8052.fiu.xo
    1214 The authenticity of host 'fiu-8052.fiu.xo (192.168.105.2)' can't be established.
    1215 DSA key fingerprint is 89:b6:13:30:a5:74:e3:3e:a6:aa:71:7a:91:6e:80:fd.
    1216 Are you sure you want to continue connecting (yes/no)? yes
    1217 Warning: Permanently added 'fiu-8052.fiu.xo,192.168.105.2' (DSA) to the list of known hosts.
    12181244Enter radius password:
    12191245
    12201246IBM Networking Operating System RackSwitch G8052.
    12211247
     1248
    12221249fiu-8052.fiu.xo>ena
    12231250
    12241251Enable privilege granted.
    1225 fiu-8052.fiu.xo#
    1226 
    12271252fiu-8052.fiu.xo#show interface status
    12281253------------------------------------------------------------------
     
    1273129843       43      1000     full      no     no       up       fiu-w7 em2
    1274129944       44      1000     full      no     no       up       fiu-w8 em2
    1275 45       45      1000     full      no     no       up       fiu-w9 em2
     130045       45       any      any      no     no      down      fiu-w9 em2
    1276130146       46      1000     full      no     no       up       fiu-w10 em2
    1277130247       47      1000     full      no     no       up       fiu-hn em5
     
    12811306XGE3     51     1G/10G    full      no     no    disabled    XGE3   
    12821307XGE4     52     10000     full      no     no       up       XGE4   
     1308fiu-8052.fiu.xo#
     1309fiu-8052.fiu.xo#show version brief
     1310                             ^
     1311% Invalid input detected at '^' marker.
     1312fiu-8052.fiu.xo#show version       
     1313fiu-8052.fiu.xo#show version b
     1314fiu-8052.fiu.xo#show version ?
     1315  <cr>
     1316  |  Search output for strings
     1317
    12831318fiu-8052.fiu.xo#show version
    1284 System Information at  0:49:25 Fri Aug  3, 2000
     1319System Information at 22:26:55 Fri Aug  3, 2000
    12851320Time zone: America/US/Eastern
    12861321Daylight Savings Time Status: Enabled
     
    12881323IBM Networking Operating System RackSwitch G8052
    12891324
    1290 Switch has been up for 93 days, 22 hours, 36 minutes and 15 seconds.
     1325Switch has been up for 94 days, 20 hours, 26 minutes and 53 seconds.
    12911326Last boot:  0:47:33 Wed May  2, 2000 (reset from Telnet/SSH)
    12921327
     
    13031338
    13041339
    1305 Temperature    Top: 25 C
    1306 Temperature Bottom: 32 C
    1307 Temperature Fan Ctrl 88: 28 C
    1308 Temperature Fan Ctrl 8a: 63 C
     1340Temperature    Top: 26 C
     1341Temperature Bottom: 33 C
     1342Temperature Fan Ctrl 88: 29 C
     1343Temperature Fan Ctrl 8a: 64 C
    13091344Temperature Fan Ctrl 8c: 60 C
    13101345Temperature Phy 0x01: 64 C
    13111346Temperature Phy 0x09: 67 C
    1312 Temperature Phy 0x11: 66 C
    1313 Temperature Phy 0x21: 58 C
     1347Temperature Phy 0x11: 67 C
     1348Temperature Phy 0x21: 59 C
    13141349Temperature Phy 0x29: 69 C
    1315 Temperature Phy 0x31: 66 C
     1350Temperature Phy 0x31: 64 C
    13161351
    13171352Warning at 55 C and Recover at 80 C
     
    13191354Fan 1 in Module 1: Not Installed
    13201355Fan 2 in Module 1: Not Installed
    1321 Fan 3 in Module 2: RPM= 9608 PWM= 25 ( 9%) Back-To-Front [J]
     1356Fan 3 in Module 2: RPM= 9574 PWM= 25 ( 9%) Back-To-Front [J]
    13221357Fan 4 in Module 2: RPM= 3854 PWM= 25 ( 9%) Back-To-Front [J]
    1323 Fan 5 in Module 3: RPM= 9836 PWM= 25 ( 9%) Back-To-Front [J]
    1324 Fan 6 in Module 3: RPM= 4011 PWM= 25 ( 9%) Back-To-Front [J]
    1325 Fan 7 in Module 4: RPM= 9712 PWM= 25 ( 9%) Back-To-Front [J]
    1326 Fan 8 in Module 4: RPM= 3873 PWM= 25 ( 9%) Back-To-Front [J]
     1358Fan 5 in Module 3: RPM= 9800 PWM= 25 ( 9%) Back-To-Front [J]
     1359Fan 6 in Module 3: RPM= 4017 PWM= 25 ( 9%) Back-To-Front [J]
     1360Fan 7 in Module 4: RPM= 9642 PWM= 25 ( 9%) Back-To-Front [J]
     1361Fan 8 in Module 4: RPM= 3870 PWM= 25 ( 9%) Back-To-Front [J]
    13271362
    13281363System Fan Airflow: Back-To-Front
     
    13351370Service Faults: ()
    13361371
    1337 fiu-8052.fiu.xo# exit
    1338 
     1372fiu-8052.fiu.xo#exit
     1373Received disconnect from 192.168.105.2: 11: Logged out.
    13391374
    13401375}}}
    13411376
    13421377Connect to the !OpenFlow switch:
    1343 {{{
    1344 [lnevers@fiu-hn ~]$  ssh lnevers@FIU-8264.fiu.xo
    1345 The authenticity of host 'fiu-8264.fiu.xo (192.168.105.4)' can't be established.
    1346 DSA key fingerprint is 2c:a8:07:ac:83:14:03:01:7a:87:96:14:df:b7:26:03.
    1347 Are you sure you want to continue connecting (yes/no)? yes
    1348 Warning: Permanently added 'fiu-8264.fiu.xo,192.168.105.4' (DSA) to the list of known hosts.
     1378{{{[lnevers@fiu-hn ~]$ ssh lnevers@FIU-8264.fiu.xo
    13491379Enter radius password:
    13501380
     
    13551385
    13561386Enable privilege granted.
    1357 
    1358 
    1359 #fiu-8264.fiu.xo#show interface status
     1387fiu-8264.fiu.xo#show interface status
    13601388------------------------------------------------------------------
    13611389Alias   Port   Speed    Duplex     Flow Ctrl      Link       Name
     
    1374140224       24    10000     full      no     no       up        24     
    1375140325       25    10000     full      no     no      down       25     
    1376 26       26    10000     full      no     no      down       26     
     140426       26    10000     full      no     no       up        26     
    1377140527       27    1G/10G    full      no     no      down       27     
    1378140628       28    1G/10G    full      no     no      down       28     
     
    1398142648       48    10000     full      no     no       up        48     
    1399142749       49    10000     full      no     no      down       49     
    1400 50       50    10000     full      no     no      down       50     
     142850       50    10000     full      no     no       up        50     
    1401142951       51    1G/10G    full      no     no      down       51     
    1402143052       52    1G/10G    full      no     no      down       52     
     
    1413144163       63    10000     full      no     no       up        63     
    1414144264       64    10000     full      no     no       up        64     
    1415 MGT      65     1000     full     yes    yes       up        MGT   
    1416 
    1417 fiu-8264.fiu.xo#show version       
    1418 System Information at 14:58:25 Wed May  1, 2013
     1443MGT      65     1000     full     yes    yes       up        MGT     
     1444fiu-8264.fiu.xo#show version             
     1445System Information at 12:34:30 Thu May  2, 2013
    14191446Time zone: America/US/Eastern
    14201447Daylight Savings Time Status: Enabled
     
    14221449IBM Networking Operating System RackSwitch G8264 (BW build)
    14231450
    1424 Switch has been up for 76 days, 0 hours, 31 minutes and 16 seconds.
     1451Switch has been up for 76 days, 22 hours, 7 minutes and 22 seconds.
    14251452Last boot: 13:27:55 Thu Feb 14, 2013 (reset from Telnet/SSH)
    14261453
     
    14521479Warning at 75 C and Recover at 90 C
    14531480
    1454 Fan 1 in Module 1: RPM= 7736 PWM= 15( 5%) Back-To-Front
    1455 Fan 2 in Module 1: RPM= 3703 PWM= 15( 5%) Back-To-Front
    1456 Fan 3 in Module 2: RPM= 7605 PWM= 15( 5%) Back-To-Front
    1457 Fan 4 in Module 2: RPM= 3802 PWM= 15( 5%) Back-To-Front
    1458 Fan 5 in Module 3: RPM= 7894 PWM= 15( 5%) Back-To-Front
    1459 Fan 6 in Module 3: RPM= 3770 PWM= 15( 5%) Back-To-Front
    1460 Fan 7 in Module 4: RPM= 7929 PWM= 15( 5%) Back-To-Front
    1461 Fan 8 in Module 4: RPM= 3835 PWM= 15( 5%) Back-To-Front
     1481Fan 1 in Module 1: RPM= 7725 PWM= 15( 5%) Back-To-Front
     1482Fan 2 in Module 1: RPM= 3693 PWM= 15( 5%) Back-To-Front
     1483Fan 3 in Module 2: RPM= 7627 PWM= 15( 5%) Back-To-Front
     1484Fan 4 in Module 2: RPM= 3800 PWM= 15( 5%) Back-To-Front
     1485Fan 5 in Module 3: RPM= 7906 PWM= 15( 5%) Back-To-Front
     1486Fan 6 in Module 3: RPM= 3752 PWM= 15( 5%) Back-To-Front
     1487Fan 7 in Module 4: RPM= 7941 PWM= 15( 5%) Back-To-Front
     1488Fan 8 in Module 4: RPM= 3827 PWM= 15( 5%) Back-To-Front
    14621489
    14631490System Fan Airflow: Back-To-Front
     
    14711498Service Faults: ()
    14721499
    1473 fiu-8264.fiu.xo# exit
     1500fiu-8264.fiu.xo# exitReceived disconnect from 192.168.105.4: 11: Logged out.
    14741501
    14751502}}}
     
    14771504Verify FOAM and !FlowVisor configuration files ownership and paths:
    14781505{{{
    1479 [lnevers@fiu-hn ~]$  ls -l /etc/foam.passwd  /etc/flowvisor.passwd /etc/flowvisor/fvpasswd /opt/foam/etc/foampasswd
     1506[lnevers@fiu-hn ~]$ ls -l /etc/foam.passwd  /etc/flowvisor.passwd /etc/flowvisor/fvpasswd /opt/foam/etc/foampasswd
     1507lrwxrwxrwx 1 root      flowvisor 21 Jan 31 03:05 /etc/flowvisor/fvpasswd -> /etc/flowvisor.passwd
     1508-r--r----- 1 flowvisor fiuadmins 25 Jan 31 03:05 /etc/flowvisor.passwd
     1509-r--r----- 1 root      fiuadmins 25 Jan 31 03:05 /etc/foam.passwd
     1510lrwxrwxrwx 1 root      root      16 Jan 31 03:05 /opt/foam/etc/foampasswd -> /etc/foam.passwd
    14801511}}}
    14811512
    14821513Check FOAM version and FOAM configuration for site.admin.email, geni.site-tag, email.from settings on the FIU head node:
    14831514{{{
    1484 [lnevers@fiu-hn ~]$ sudo foamctl admin:get-version  --passwd-file=/etc/foam.passwd
     1515[lnevers@fiu-hn ~]$ foamctl admin:get-version  --passwd-file=/etc/foam.passwd
    14851516[sudo] password for lnevers:
    14861517{
    14871518 "version": "0.8.2"
    14881519}
    1489 [lnevers@fiu-hn ~]$ sudo foamctl config:get-value --key="site.admin.email"  --passwd-file=/opt/foam/etc/foampasswd
     1520[lnevers@fiu-hn ~]$ foamctl config:get-value --key="site.admin.email"  --passwd-file=/opt/foam/etc/foampasswd
    14901521{
    14911522 "value": "exogeni-foam-admin@gpolab.bbn.com"
     
    14951526 "value": "fiu-hn.exogeni.net"
    14961527}
    1497 [lnevers@fiu-hn ~]$ sudo foamctl config:get-value --key="email.from"  --passwd-file=/opt/foam/etc/foampasswd
     1528[lnevers@fiu-hn ~]$ foamctl config:get-value --key="email.from"  --passwd-file=/opt/foam/etc/foampasswd
    14981529{
    14991530 "value": "esj@cs.fiu.edu"
    15001531}
    1501 [lnevers@fiu-hn ~]$ sudo foamctl config:get-value --key="geni.approval.approve-on-creation"  --passwd-file=/opt/foam/etc/foampasswd
     1532[lnevers@fiu-hn ~]$ foamctl config:get-value --key="geni.approval.approve-on-creation"  --passwd-file=/opt/foam/etc/foampasswd
    15021533{
    15031534 "value": 0
     
    15071538Show FOAM slivers details:
    15081539{{{
    1509 [lnevers@fiu-hn ~]$ sudo foamctl geni:list-slivers --passwd-file=/opt/foam/etc/foampasswd
     1540[lnevers@fiu-hn ~]$ foamctl geni:list-slivers --passwd-file=/opt/foam/etc/foampasswd
    15101541{
    15111542 "slivers": [
     
    15801611  {
    15811612   "status": "Pending",
    1582    "sliver_urn": "urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+EG-CT-4:15acd240-5b08-4ead-9c31-5fd217f25960",
    1583    "creation": "2013-05-01 18:07:49.231589+00:00",
     1613   "sliver_urn": "urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+EG-CT-4:b0103bb9-5d34-4c32-b177-1f4224839e6a",
     1614   "creation": "2013-05-02 14:42:09.785630+00:00",
    15841615   "pend_reason": "Request has underspecified VLAN requests",
    15851616   "expiration": "2013-05-14 00:00:00+00:00",
     
    15891620   "enabled": false,
    15901621   "email": "lnevers@bbn.com",
    1591    "flowvisor_slice": "15acd240-5b08-4ead-9c31-5fd217f25960",
     1622   "flowvisor_slice": "b0103bb9-5d34-4c32-b177-1f4224839e6a",
    15921623   "desc": "IG-CT-4 over 3716 ",
    15931624   "ref": null,
    1594    "id": 20,
    1595    "uuid": "15acd240-5b08-4ead-9c31-5fd217f25960"
     1625   "id": 21,
     1626   "uuid": "b0103bb9-5d34-4c32-b177-1f4224839e6a"
    15961627  }
    15971628 ]
     
    15991630[lnevers@fiu-hn ~]$
    16001631
    1601 {'T.+6!kX_28
    16021632}}}
    16031633
    16041634Check the !FlowVisor version, list of devices, get details for a device, list of active slices, and details for one of the slices on the FIU Head node:
    16051635{{{
    1606 [lnevers@fiu-hn ~]$ sudo /opt/flowvisor/bin/fvctl --passwd-file=/etc/flowvisor/fvpasswd ping hello
     1636[lnevers@fiu-hn ~]$ /opt/flowvisor/bin/fvctl --passwd-file=/etc/flowvisor/fvpasswd ping hello
    16071637Got reply:
    16081638PONG(fvadmin): FV version=flowvisor-0.8.1::hello
    1609 [lnevers@fiu-hn ~]$
    1610 [lnevers@fiu-hn ~]$ sudo /opt/flowvisor/bin/fvctl --passwd-file=/etc/flowvisor/fvpasswd listDevices
     1639
     1640[lnevers@fiu-hn ~]$ /opt/flowvisor/bin/fvctl --passwd-file=/etc/flowvisor/fvpasswd listDevices
    16111641Device 0: 00:01:74:99:75:24:61:00
    1612 [lnevers@fiu-hn ~]$ sudo /opt/flowvisor/bin/fvctl --passwd-file=/etc/flowvisor/fvpasswd getDeviceInfo 00:01:74:99:75:24:61:00
     1642
     1643[lnevers@fiu-hn ~]$ /opt/flowvisor/bin/fvctl --passwd-file=/etc/flowvisor/fvpasswd getDeviceInfo 00:01:74:99:75:24:61:00
    16131644nPorts=51
    1614 portList=1,5,9,13,17,18,19,20,21,22,23,24,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47,48,51,52,53,54,55,56,57,58,59,60,61,62,64,49,25,50,26
     1645portList=1,5,9,13,17,18,19,20,21,22,23,24,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47,48,51,52,53,54,55,56,57,58,59,60,61,62,64,49,25,26,50
    16151646dpid=00:01:74:99:75:24:61:00
    16161647remote=/192.168.105.10:6633-->/192.168.105.4:34802
    1617 portNames=1(1),5(5),9(9),13(13),17(17),18(18),19(19),20(20),21(21),22(22),23(23),24(24),27(27),28(28),29(29),30(30),31(31),32(32),33(33),34(34),35(35),36(36),37(37),38(38),39(39),40(40),41(41),42(42),43(43),44(44),45(45),46(46),47(47),48(48),51(51),52(52),53(53),54(54),55(55),56(56),57(57),58(58),59(59),60(60),61(61),62(62),64(64),49(49),25(25),50(50),26(26)
    1618 
    1619 [lnevers@fiu-hn ~]$ sudo /opt/flowvisor/bin/fvctl --passwd-file=/etc/flowvisor/fvpasswd listSlices
     1648portNames=1(1),5(5),9(9),13(13),17(17),18(18),19(19),20(20),21(21),22(22),23(23),24(24),27(27),28(28),29(29),30(30),31(31),32(32),33(33),34(34),35(35),36(36),37(37),38(38),39(39),40(40),41(41),42(42),43(43),44(44),45(45),46(46),47(47),48(48),51(51),52(52),53(53),54(54),55(55),56(56),57(57),58(58),59(59),60(60),61(61),62(62),64(64),49(49),25(25),26(26),50(50)
     1649
     1650[lnevers@fiu-hn ~]$ /opt/flowvisor/bin/fvctl --passwd-file=/etc/flowvisor/fvpasswd listSlices
    16201651Slice 0: ffe8b0d9-53ba-4080-977d-1ff12c56d44f
    16211652Slice 1: 5487fe77-f7e9-47d2-ab60-ae3e6cb2b0e8
    16221653Slice 2: orca-1762
    1623 Slice 3: orca-1760
    1624 Slice 4: fvadmin
    1625 Slice 5: orca-1761
    1626 Slice 6: e6cc224f-13be-42c1-bdb1-bd1deae8a0a6
    1627 Slice 7: orca-2
    1628 Slice 8: 17705df6-adce-4842-9481-28ac02068240
    1629 [lnevers@fiu-hn ~]$ sudo /opt/flowvisor/bin/fvctl --passwd-file=/etc/flowvisor/fvpasswd getSliceInfo  e6cc224f-13be-42c1-bdb1-bd1deae8a0a6
    1630 Got reply:
    1631 connection_1=00:01:74:99:75:24:61:00-->/131.94.144.6:23531-->hafmet.gpolab.bbn.com/192.1.249.178:33012
    1632 contact_email=tupty@bbn.com
    1633 controller_hostname=hafmet.gpolab.bbn.com
    1634 controller_port=33012
    1635 creator=fvadmin
    1636 [lnevers@fiu-hn ~]$
    1637 
     1654Slice 3: fvadmin
     1655Slice 4: e6cc224f-13be-42c1-bdb1-bd1deae8a0a6
     1656Slice 5: orca-2
     1657Slice 6: 17705df6-adce-4842-9481-28ac02068240
    16381658}}}
    16391659