Changes between Version 1 and Version 2 of GENIRacksHome/ExogeniRacks/AcceptanceTestStatus/EG-ADM-3


Ignore:
Timestamp:
08/30/12 09:34:11 (7 years ago)
Author:
chaos@bbn.com
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • GENIRacksHome/ExogeniRacks/AcceptanceTestStatus/EG-ADM-3

    v1 v2  
    55''This page is GPO's working page for performing EG-ADM-3.  It is public for informational purposes, but it is not an official status report.  See [wiki:GENIRacksHome/ExogeniRacks/AcceptanceTestStatus] for the current status of ExoGENI acceptance tests.''
    66
    7 ''Last substantive edit of this page: 2012-08-29''
     7''Last substantive edit of this page: 2012-08-30''
    88
    99== Page format ==
     
    5353 * If SSH is successful, attempt to sudo on bbn-hn:
    5454{{{
    55 sudo -v
     55sudo whoami
    5656}}}
    5757 * Browse to [https://bbn-hn.exogeni.net/rack_bbn/] and attempt to login to nagios
     
    6161 * Run omni getversion and listresources against the BBN rack ORCA AM:
    6262{{{
    63 omni -a https://bbn-hn.exogeni.gpolab.bbn.com:11443/orca/xmlrpc getversion
    64 omni -a https://bbn-hn.exogeni.gpolab.bbn.com:11443/orca/xmlrpc listresources
     63omni -a https://bbn-hn.exogeni.gpolab.bbn.com:11443/orca/xmlrpc getversion -o
     64omni -a https://bbn-hn.exogeni.gpolab.bbn.com:11443/orca/xmlrpc listresources -o
    6565}}}
    6666 * Run omni getversion and listresources against the BBN rack FOAM AM:
     
    7070}}}
    7171 * Verify that [http://monitor.gpolab.bbn.com/connectivity/campus.html] currently shows a successful connection from argos to exogeni-vlan1750.bbn.dataplane.geni.net
     72
     73==== Results of testing step 1A on 2012-08-30 ====
     74
     75 * SSH and sudo were successful
     76 * I could login to nagios.  Outstanding errors:
     77   * critical:
     78     * Updates needed on bbn-w1, bbn-w2, bbn-w3
     79     * 8052.bbn.xo reports that interfaces: 31-36,45-46 are down
     80     * `proc_ImageProxy` is critical on bbn-hn.  This is unexpected, and i sent mail about it in case anyone wants to investigate
     81   * warning:
     82     * Updates needed on bbn-hn
     83     * 8052.bbn.xo reports that interfaces: 10-15,41-44 are the "wrong speed" (running at 1Gbps, expected 100Mbps)
     84 * GPO nagios shows that orca getversion and listresources have been failing for about 18 hours, and that the ping to the BBN rack is failing
     85 * omni getversion does not succeed against orca:
     86{{{
     87jericho,[~],09:28(2)$ omni -a https://bbn-hn.exogeni.gpolab.bbn.com:11443/orca/xmlrpc getversion -o
     88INFO:omni:Loading config file /home/chaos/omni/omni_pgeni
     89INFO:omni:Using control framework pg
     90ERROR:omni.protogeni:Call for GetVersion at https://bbn-hn.exogeni.gpolab.bbn.com:11443/orca/xmlrpc failed.: Unknown socket error: [Errno 111] Connection refused
     91ERROR:omni.protogeni:    ..... Run with --debug for more information
     92WARNING:omni:URN: unspecified_AM_URN (url:https://bbn-hn.exogeni.gpolab.bbn.com:11443/orca/xmlrpc) call failed: [Errno 111] Connection refused
     93
     94INFO:omni: ------------------------------------------------------------
     95INFO:omni: Completed getversion:
     96
     97  Options as run:
     98                aggregate: https://bbn-hn.exogeni.gpolab.bbn.com:11443/orca/xmlrpc
     99                configfile: /home/chaos/omni/omni_pgeni
     100                framework: pg
     101                native: True
     102                output: True
     103
     104  Args: getversion
     105
     106  Result Summary: Cannot GetVersion at https://bbn-hn.exogeni.gpolab.bbn.com:11443/orca/xmlrpc: [Errno 111] Connection refused
     107
     108Got version for 0 out of 1 aggregates
     109 
     110INFO:omni: ============================================================
     111}}}
     112 * omni getversion does succeed against foam:
     113{{{
     114jericho,[~],09:29(0)$ omni -a https://bbn-hn.exogeni.gpolab.bbn.com:3626/foam/gapi/1 getversion
     115INFO:omni:Loading config file /home/chaos/omni/omni_pgeni
     116INFO:omni:Using control framework pg
     117INFO:omni:AM URN: unspecified_AM_URN (url: https://bbn-hn.exogeni.gpolab.bbn.com:3626/foam/gapi/1) has version:
     118INFO:omni:{   'ad_rspec_versions': [   {   'extensions': [   'http://www.geni.net/resources/rspec/ext/openflow/3'],
     119                                 'namespace': 'http://www.geni.net/resources/rspec/3',
     120                                 'schema': 'http://www.geni.net/resources/rspec/3/ad.xsd',
     121                                 'type': 'GENI',
     122                                 'version': '3'}],
     123    'foam_version': '0.8.2',
     124    'geni_api': 1,
     125    'request_rspec_versions': [   {   'extensions': [   'http://www.geni.net/resources/rspec/ext/openflow/3',
     126                                                        'http://www.geni.net/resources/rspec/ext/openflow/4',
     127                                                        'http://www.geni.net/resources/rspec/ext/flowvisor/1'],
     128                                      'namespace': 'http://www.geni.net/resources/rspec/3',
     129                                      'schema': 'http://www.geni.net/resources/rspec/3/request.xsd',
     130                                      'type': 'GENI',
     131                                      'version': '3'}],
     132    'site_info': {   }}
     133INFO:omni: ------------------------------------------------------------
     134INFO:omni: Completed getversion:
     135
     136  Options as run:
     137                aggregate: https://bbn-hn.exogeni.gpolab.bbn.com:3626/foam/gapi/1
     138                configfile: /home/chaos/omni/omni_pgeni
     139                framework: pg
     140                native: True
     141
     142  Args: getversion
     143
     144  Result Summary:
     145Got version for 1 out of 1 aggregates
     146 
     147INFO:omni: ============================================================
     148}}}
     149 * The campus connectivity graph shows that the BBN ExoGENI ping has been down for about 18 hours
    72150
    73151=== Step 1B: shutdown all rack components ===