Changes between Initial Version and Version 1 of GENIRacksHome/OpenGENIRacks/AcceptanceTestStatusMay2013/OG-MON-5


Ignore:
Timestamp:
05/23/14 11:36:00 (8 years ago)
Author:
lnevers@bbn.com
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • GENIRacksHome/OpenGENIRacks/AcceptanceTestStatusMay2013/OG-MON-5

    v1 v1  
     1= GR-MON-5: GMOC Data Collection Test =
     2
     3This page captures status for the test case GR-MON-5. For additional information see the [wiki:GENIRacksHome/GRAMRacks/AcceptanceTestStatusMay2013 Acceptance Test Status - May 2013] page overall status, or the [wiki:GENIRacksHome/AcceptanceTests/GRAMAcceptanceTestsPlan GRAM Acceptance Test Plan] for details about the planned evaluation.
     4
     5
     6''Last Update: 2013/05/14"
     7
     8|| '''Step''' || '''State'''||''' Notes '''            || '''Tickets'''  ||
     9|| Step 1     ||[[span(Fail, style=background-color: red)]] ||No Monitoring data collection or reporting available ||                ||
     10|| Step 2     ||[[span(Fail, style=background-color: red)]] ||                         ||                ||
     11             
     12
     13[[BR]]
     14|| '''State Legend'''                                   || '''Description'''                                                    ||
     15||[[span(Pass, style=background-color: green )]]        || Test completed and met all criteria                                  ||
     16||[[span(Pass: most criteria, style=background-color: #98FB98)]]|| Test completed and met most criteria. Exceptions documented  ||
     17||[[span(Fail, style=background-color: red)]]           || Test completed and failed to meet criteria.                          ||
     18||[[span(Complete, style=background-color: yellow)]]    || Test completed but will require re-execution due to expected changes ||
     19||[[span(Blocked, style=background-color: orange)]]     || Blocked by ticketed issue(s).                                        ||
     20||[[span(In Progress, style=background-color: #63B8FF)]]|| Currently under test.                                                ||
     21
     22
     23= Test Steps =
     24
     25''Evaluation Note:'' There is no GMOC Data Collection and no GRAM monitoring data reporting, unable to execute.
     26
     27== Step 1. Review GMOC Data Collection for GRAM aggregate ==
     28
     29View the dataset collected at GMOC for the BBN and Site2 GRAM racks.  For each piece of required data, attempt to verify that:
     30 * The data is being collected and accepted by GMOC and can be viewed at gmoc-db.grnoc.iu.edu
     31 * The data's "site" tag indicates that it is being reported for the GRAM rack located at the `gpolab` or GRAM site2 site (as appropriate for that rack).
     32 * The data has been reported within the past 10 minutes.
     33 * For each piece of data, either verify that it is being collected at least once a minute, or verify that it requires more complicated processing than a simple file read to collect, and thus can be collected less often.
     34
     35== Step 2. Review GMOC Data Reporting for GRAM aggregate ==
     36
     37Verify that the following pieces of data are being reported:
     38 * Is each of the rack GRAM and VMOC AMs reachable via the GENI AM API right now?
     39 * Is each compute or unbound VLAN resource at each rack AM online?  Is it available or in use?
     40 * Sliver count and percentage of rack compute and unbound VLAN resources in use.
     41 * Identities of current slivers on each rack AM, including creation time for each.
     42 * Per-sliver interface counters for compute and VLAN resources (where these values can be easily collected).
     43 * Is the rack data plane switch online?
     44 * Interface counters and VLAN memberships for each rack data plane switch interface
     45 * MAC address table contents for shared VLANs which appear on rack data plane switches
     46 * Is each rack experimental node online?
     47 * For each rack experimental node configured as an !OpenStack VM server, overall CPU, disk, and memory utilization for the host, current VM count and total VM capacity of the host.
     48 * For each rack experimental node configured as an !OpenStack VM server, interface counters for each data plane interface.
     49 * Results of at least one end-to-end health check which simulates an experimenter reserving and using at least one resource in the rack.
     50
     51Verify that per-rack or per-aggregate summaries are collected of the count of distinct users who have been active on the rack, either by providing raw sliver data containing sliver users to GMOC, or by collecting data locally and producing trending summaries on demand.