Changes between Version 1 and Version 2 of GENIRacksHome/OpenGENIRacks/AcceptanceTestStatusDec2013/OG-ADM-7


Ignore:
Timestamp:
05/23/14 13:14:28 (10 years ago)
Author:
lnevers@bbn.com
Comment:

--

Legend:

Unmodified
Added
Removed
Modified

  • GENIRacksHome/OpenGENIRacks/AcceptanceTestStatusDec2013/OG-ADM-7

    v1 v2  
    1 = GR-ADM-7: Documentation Review Test =
    2 
    3 
    4 This page captures status for the test case GR-ADM-7. For additional information see the [wiki:GENIRacksHome/GRAMRacks/AcceptanceTestStatusDec2013 Acceptance Test Status - December 2013] page overall status, or the [wiki:GENIRacksHome/AcceptanceTests/GRAMAcceptanceTestsPlan GRAM Acceptance Test Plan] for details about the planned evaluation.
     1= OG-ADM-7: Documentation Review Test =
     2
     3
     4This page captures status for the test case OG-ADM-7. For additional information see the [wiki:GENIRacksHome/OpenGENIRacks/AcceptanceTestStatusDec2013 Acceptance Test Status - December 2013] page overall status, or the [wiki:GENIRacksHome/AcceptanceTests/OpenGENIAcceptanceTestsPlan OpenGENI Acceptance Test Plan] for details about the planned evaluation.
    55
    66''Last Update: 2013/12/18"
    … …  
    1111
    1212|| '''Documentation'''                                                        ||'''State'''                                      || ''' Tickets ''' || '''Notes''' ||
    13 ||1. GRAM Rack Installation Documentation                                     ||[[span(Pass: most criteria, style=background-color: #98FB98)]]||#74                 ||             ||
    14 ||2. GRAM Rack Part List Documentation                                        ||[[span(Pass: most criteria, style=background-color: #98FB98)]]||#75                 ||             ||
    15 ||3. GRAM Software Components Identification Documentation                    ||[[span(Pass, style=background-color: green )]]                ||#76                 ||             ||
    16 ||4. GRAM and OS Upgrade Plans                                                ||[[span(In Progress, style=background-color: #63B8FF)]]        ||#77                 ||             ||
    17 ||5. GRAM Software Components Functional Description and Access to Source code||[[span(Pass, style=background-color: green )]]                ||#78             ||
    18 ||6. GRAM Rack Resources Usage and Policy Documentation                       ||[[span(Fail, style=background-color: red)]]                   ||#79                 ||            ||
    19 ||7. GRAM Rack Resources Administration                                       ||[[span(Pass: most criteria, style=background-color: #98FB98)]]||#80                 ||            ||
    20 ||8. GRAM Rack Administrative procedure for user accounts                     ||[[span(Pass: most criteria, style=background-color: #98FB98)]]||#81                 ||            ||
    21 ||9. GRAM Rack Administrative procedure for rack operations                   ||[[span(Fail, style=background-color: red)]]                   ||#82                 ||            ||
    22 ||10. GRAM Rack Administrative procedure for rack scheduled shutdown          ||[[span(In Progress, style=background-color: #63B8FF)]]        ||#83              ||            ||
    23 ||11. GRAM Rack Administrative procedure for Emergency Stop.                  ||[[span(In Progress, style=background-color: #63B8FF)]]        ||#84              ||            ||
    24 ||12. GRAM Rack Administrative procedure for health status                    ||[[span(Fail, style=background-color: red)]]                   ||#85              ||            ||
    25 ||13. GRAM Rack Site Operations documentation                                 ||[[span(Fail, style=background-color: red)]]                   ||#86              ||            ||
    26 ||14. Site Specific GRAM Deployment Data                                      ||[[span(Fail, style=background-color: red)]]                   ||#87              ||            ||
     13||1. OpenGENI Rack Installation Documentation                                     ||[[span(Pass: most criteria, style=background-color: #98FB98)]]||#74                 ||             ||
     14||2. OpenGENI Rack Part List Documentation                                        ||[[span(Pass: most criteria, style=background-color: #98FB98)]]||#75                 ||             ||
     15||3. OpenGENI Software Components Identification Documentation                    ||[[span(Pass, style=background-color: green )]]                ||#76                 ||             ||
     16||4. OpenGENI and OS Upgrade Plans                                                ||[[span(In Progress, style=background-color: #63B8FF)]]        ||#77                 ||             ||
     17||5. OpenGENI Software Components Functional Description and Access to Source code||[[span(Pass, style=background-color: green )]]                ||#78             ||
     18||6. OpenGENI Rack Resources Usage and Policy Documentation                       ||[[span(Fail, style=background-color: red)]]                   ||#79                 ||            ||
     19||7. OpenGENI Rack Resources Administration                                       ||[[span(Pass: most criteria, style=background-color: #98FB98)]]||#80                 ||            ||
     20||8. OpenGENI Rack Administrative procedure for user accounts                     ||[[span(Pass: most criteria, style=background-color: #98FB98)]]||#81                 ||            ||
     21||9. OpenGENI Rack Administrative procedure for rack operations                   ||[[span(Fail, style=background-color: red)]]                   ||#82                 ||            ||
     22||10. OpenGENI Rack Administrative procedure for rack scheduled shutdown          ||[[span(In Progress, style=background-color: #63B8FF)]]        ||#83              ||            ||
     23||11. OpenGENI Rack Administrative procedure for Emergency Stop.                  ||[[span(In Progress, style=background-color: #63B8FF)]]        ||#84              ||            ||
     24||12. OpenGENI Rack Administrative procedure for health status                    ||[[span(Fail, style=background-color: red)]]                   ||#85              ||            ||
     25||13. OpenGENI Rack Site Operations documentation                                 ||[[span(Fail, style=background-color: red)]]                   ||#86              ||            ||
     26||14. Site Specific OpenGENI Deployment Data                                      ||[[span(Fail, style=background-color: red)]]                   ||#87              ||            ||
    2727
    2828
    … …  
    3838[[BR]]
    3939
    40 = GRAM Documentation Tests =
    41 
    42 The GRAM Documentation Tests focus on documentation review, and apply the following criteria for each document:
     40= OpenGENI Documentation Tests =
     41
     42The OpenGENI Documentation Tests focus on documentation review, and apply the following criteria for each document:
    4343 * The document has been provided in a public location. This criteria failed to be met, all documentation is internal for initial evaluation.
    4444 * The document contains the required information.
    … …  
    4646
    4747Rack documentation available and reviewed to find required information includes:
    48  * [https://superior.bbn.com/trac/bbn-rack/wiki/AdministrationGuide GRAM Administration Guide] - No changes were made to this page in since the last evaluation.
    49  * [https://superior.bbn.com/trac/bbn-rack/wiki/InstallationGuideGrizzly GRAM Installation Guide with Grizzly !OpenStack] Significant changes where made to this guide.
    50  * [https://superior.bbn.com/trac/bbn-rack/wiki/ArchitectureDescription GRAM Network and Software Architecture Description]  - Minimal changes were made to this document since last evaluation.
    51  * [https://superior.bbn.com/trac/bbn-rack/wiki/TestGuide GRAM Testing Guide] - No changes were made to this page in since the last evaluation.
    52  * [https://superior.bbn.com/trac/bbn-rack/wiki/UserGuide  GRAM Users Guide] - Changes have been made to this guide to capture new features.
    53  * [https://superior.bbn.com/trac/bbn-rack/wiki/DellRackDetails Details on BBN-CAM GRAM Rack Installation and Configuration] details pages.
    54 
    55 
    56 == 1. GRAM Rack Installation Documentation ==   
     48 * [https://superior.bbn.com/trac/bbn-rack/wiki/AdministrationGuide OpenGENI Administration Guide] - No changes were made to this page in since the last evaluation.
     49 * [https://superior.bbn.com/trac/bbn-rack/wiki/InstallationGuideGrizzly OpenGENI Installation Guide with Grizzly !OpenStack] Significant changes where made to this guide.
     50 * [https://superior.bbn.com/trac/bbn-rack/wiki/ArchitectureDescription OpenGENI Network and Software Architecture Description]  - Minimal changes were made to this document since last evaluation.
     51 * [https://superior.bbn.com/trac/bbn-rack/wiki/TestGuide OpenGENI Testing Guide] - No changes were made to this page in since the last evaluation.
     52 * [https://superior.bbn.com/trac/bbn-rack/wiki/UserGuide  OpenGENI Users Guide] - Changes have been made to this guide to capture new features.
     53 * [https://superior.bbn.com/trac/bbn-rack/wiki/DellRackDetails Details on BBN-CAM OpenGENI Rack Installation and Configuration] details pages.
     54
     55
     56== 1. OpenGENI Rack Installation Documentation ==   
    5757
    5858'''The goal of this evaluation:'''
    … …  
    6262'''Evaluation Results''': [[span(Pass: most criteria, style=background-color: #98FB98)]]
    6363
    64 The page [https://superior.bbn.com/trac/bbn-rack/wiki/DellRackDetails Details on BBN-CAM GRAM Rack Installation and Configuration] and found:
     64The page [https://superior.bbn.com/trac/bbn-rack/wiki/DellRackDetails Details on BBN-CAM OpenGENI Rack Installation and Configuration] and found:
    6565 - Rack space requirements
    6666 - Power requirements 
    … …  
    7272 - Core backbone connectivity requirements (layer2).
    7373
    74 == 2. GRAM Rack Part List Documentation ==     
    75 
    76 
    77 '''The goal of this evaluation:'''
    78 
    79 To find a summary GRAM Rack parts list, including vendor part numbers for "standard" equipment intended for all sites (e.g. a VM server) and per-site equipment options (e.g. transceivers, PDUs etc.), if any.  This document should also indicate approximately how much headroom, if any, remains in the standard rack PDUs' power budget to support other equipment that sites may add to the rack.
     74== 2. OpenGENI Rack Part List Documentation ==     
     75
     76
     77'''The goal of this evaluation:'''
     78
     79To find a summary OpenGENI Rack parts list, including vendor part numbers for "standard" equipment intended for all sites (e.g. a VM server) and per-site equipment options (e.g. transceivers, PDUs etc.), if any.  This document should also indicate approximately how much headroom, if any, remains in the standard rack PDUs' power budget to support other equipment that sites may add to the rack.
    8080
    8181'''Evaluation Results''': [[span(Pass: most criteria, style=background-color: #98FB98)]]
    8282
    83 A parts list was found in the page [https://superior.bbn.com/trac/bbn-rack/wiki/DellRackDetails Details on BBN-CAM GRAM Rack Installation and Configuration].
     83A parts list was found in the page [https://superior.bbn.com/trac/bbn-rack/wiki/DellRackDetails Details on BBN-CAM OpenGENI Rack Installation and Configuration].
    8484 
    8585Not found:
    8686 - Document that indicates approximately how much headroom, if any, remains in the standard rack PDUs' power budget to support additional equipment added by site to the rack.
    8787
    88 == 3. GRAM Software Components Identification Documentation  ==       
     88== 3. OpenGENI Software Components Identification Documentation  ==       
    8989
    9090'''The goal of this evaluation:'''
    … …  
    9595
    9696Found:
    97  - Clearly defined components in [https://superior.bbn.com/trac/bbn-rack/wiki/ArchitectureDescription GRAM Network and Software Architecture Description].
    98  - Information for system configurations used in GRAM rack in the  [https://superior.bbn.com/trac/bbn-rack/wiki/InstallationGuideRevised  GRAM Installation Guide - Revised].
     97 - Clearly defined components in [https://superior.bbn.com/trac/bbn-rack/wiki/ArchitectureDescription OpenGENI Network and Software Architecture Description].
     98 - Information for system configurations used in OpenGENI rack in the  [https://superior.bbn.com/trac/bbn-rack/wiki/InstallationGuideRevised  OpenGENI Installation Guide - Revised].
    9999 - Software Configuration versioning for components installed on the   [https://superior.bbn.com/trac/bbn-rack/wiki/DellRackDetails#SoftwareConfiguration BBN-CAM] rack.
    100100 - [https://superior.bbn.com/trac/bbn-rack/wiki/SoftwareRepository Software Repository] page provides a pointer to gram-dev@bbn.com for software help and for access to git repository, where recent configuration and software changes are captured.
    101101
    102 == 4. GRAM and OS Upgrade Plans   ==                     
    103 
    104 '''The goal of this evaluation:'''
    105 
    106 Find documentation that explains how and when GRAM software and OS updates can be performed on a rack, including plans for notification and update if important security vulnerabilities in rack software are discovered.
     102== 4. OpenGENI and OS Upgrade Plans   ==                     
     103
     104'''The goal of this evaluation:'''
     105
     106Find documentation that explains how and when OpenGENI software and OS updates can be performed on a rack, including plans for notification and update if important security vulnerabilities in rack software are discovered.
    107107
    108108'''Evaluation Results:''' [[span(In Progress, style=background-color: #63B8FF)]]
    109109
    110110Found software update information in:
    111  - [https://superior.bbn.com/trac/bbn-rack/wiki/InstallationGuideGrizzly GRAM Installation Guide with OpenStack Grizzly] includes:
     111 - [https://superior.bbn.com/trac/bbn-rack/wiki/InstallationGuideGrizzly OpenGENI Installation Guide with OpenStack Grizzly] includes:
    112112    * Configuration Overview
    113113    * Network Configuration for !OpenFlow Switch for the Data Network and for Management Switch
    114     * GRAM and OpenStack Installation and Configuration
    115     * Testing GRAM installation
     114    * OpenGENI and OpenStack Installation and Configuration
     115    * Testing OpenGENI installation
    116116    * Debugging Notes
    117117
    118  - [https://superior.bbn.com/trac/bbn-rack/wiki/InstallationGuideRevised  GRAM Installation Guide - Revised] includes instructions for installing !OpenStack and GRAM on the control and compute nodes.
     118 - [https://superior.bbn.com/trac/bbn-rack/wiki/InstallationGuideRevised  OpenGENI Installation Guide - Revised] includes instructions for installing !OpenStack and OpenGENI on the control and compute nodes.
    119119
    120120
    … …  
    127127 
    128128
    129 == 5. GRAM Software Components Functional Description and Access to Source code ==   
     129== 5. OpenGENI Software Components Functional Description and Access to Source code ==   
    130130   
    131131'''The goal of this evaluation:'''
    132132
    133 Find documentation that provides a description of the GRAM software running on a standard rack, and explanation of how to get access to the source code of each piece of standard GENI software.
     133Find documentation that provides a description of the OpenGENI software running on a standard rack, and explanation of how to get access to the source code of each piece of standard GENI software.
    134134
    135135'''Evaluation Results:''' [[span(Pass, style=background-color: green )]]
    136136
    137137Found:
    138  - Clearly defined components in [https://superior.bbn.com/trac/bbn-rack/wiki/ArchitectureDescription GRAM Network and Software Architecture Description].
    139  - [https://superior.bbn.com/trac/bbn-rack/wiki/InstallationGuideGrizzly Installation Instructions] for OpenStack Grizzly package and GRAM installation.
     138 - Clearly defined components in [https://superior.bbn.com/trac/bbn-rack/wiki/ArchitectureDescription OpenGENI Network and Software Architecture Description].
     139 - [https://superior.bbn.com/trac/bbn-rack/wiki/InstallationGuideGrizzly Installation Instructions] for OpenStack Grizzly package and OpenGENI installation.
    140140 - [https://superior.bbn.com/trac/bbn-rack/wiki/SoftwareRepository Software Repository] page with instructions for getting account.
    141141
    142142
    143143 
    144 == 6. GRAM Rack Resources Usage and Policy Documentation ==   
     144== 6. OpenGENI Rack Resources Usage and Policy Documentation ==   
    145145 
    146146'''The goal of this evaluation:'''
    … …  
    153153
    154154
    155 == 7. GRAM Rack Resources Administration ==               
     155== 7. OpenGENI Rack Resources Administration ==               
    156156
    157157'''The goal of this evaluation:'''
    … …  
    162162
    163163Found:
    164  - [https://superior.bbn.com/trac/bbn-rack/wiki/InstallationGuideGrizzly Installation Instructions] for OpenStack Grizzly package and GRAM installation.
    165  - [https://superior.bbn.com/trac/bbn-rack/wiki/UserGuide  GRAM Users Guide] give minimal insight into node roles in GRAM
    166  - [https://superior.bbn.com/trac/bbn-rack/wiki/BOSRackDetails BBN GRAM Rack Details] which defines the actual node settings for the GRAM Rack.
     164 - [https://superior.bbn.com/trac/bbn-rack/wiki/InstallationGuideGrizzly Installation Instructions] for OpenStack Grizzly package and OpenGENI installation.
     165 - [https://superior.bbn.com/trac/bbn-rack/wiki/UserGuide  OpenGENI Users Guide] give minimal insight into node roles in OpenGENI
     166 - [https://superior.bbn.com/trac/bbn-rack/wiki/BOSRackDetails BBN OpenGENI Rack Details] which defines the actual node settings for the OpenGENI Rack.
    167167
    168168Did not find:
    169169 - documentation that would give an administrator a description of the expected state of all the GENI experimental resources in the rack.
    170170
    171 == 8. GRAM Rack Administrative procedure for user accounts ==         
     171== 8. OpenGENI Rack Administrative procedure for user accounts ==         
    172172
    173173'''The goal of this evaluation:'''
    … …  
    186186
    187187
    188 == 9.  GRAM Rack Administrative procedure for rack operations ==   
     188== 9.  OpenGENI Rack Administrative procedure for rack operations ==   
    189189
    190190'''The goal of this evaluation:'''
    … …  
    196196No procedure was found for changing IP addresses for all rack components.
    197197
    198 == 10. GRAM Rack Administrative procedure for rack scheduled shutdown == 
     198== 10. OpenGENI Rack Administrative procedure for rack scheduled shutdown == 
    199199
    200200'''The goal of this evaluation:'''
    … …  
    207207 - Skeleton outline for [https://superior.bbn.com/trac/bbn-rack/wiki/PowerDown Rack Shutdown] and [https://superior.bbn.com/trac/bbn-rack/wiki/PowerUp Rack Power up]. 
    208208
    209 Was not able to verify, expect to execute [https://superior.bbn.com/trac/bbn-rack/wiki/AcceptanceTestStatusDec2013/GR-ADM-3 GR-ADM-3: Full Rack Reboot Test] which will allow verification of the procedure.   
     209Was not able to verify, expect to execute [https://superior.bbn.com/trac/bbn-rack/wiki/AcceptanceTestStatusDec2013/OG-ADM-3 OG-ADM-3: Full Rack Reboot Test] which will allow verification of the procedure.   
    210210
    211211     
    212 == 11. GRAM Rack Administrative procedure for Emergency Stop. ==     
     212== 11. OpenGENI Rack Administrative procedure for Emergency Stop. ==     
    213213 
    214214'''The goal of this evaluation:'''
    … …  
    221221 - Skeleton outline for [https://superior.bbn.com/trac/bbn-rack/wiki/EmergencyStop Emergency Stop Procedure].
    222222
    223 Was unable to verify, expect to execute [https://superior.bbn.com/trac/bbn-rack/wiki/AcceptanceTestStatusDec2013/GR-ADM-4 GR-ADM-4: Emergency Stop Test] in order to verify content of procedure.
    224 
    225 == 12. GRAM Rack Administrative procedure for health status ==   
     223Was unable to verify, expect to execute [https://superior.bbn.com/trac/bbn-rack/wiki/AcceptanceTestStatusDec2013/OG-ADM-4 OG-ADM-4: Emergency Stop Test] in order to verify content of procedure.
     224
     225== 12. OpenGENI Rack Administrative procedure for health status ==   
    226226     
    227227'''The goal of this evaluation:'''
    … …  
    231231'''Evaluation Results:''' [[span(Fail, style=background-color: red)]]
    232232
    233 No documentation exist that defines how to monitor GRAM component health.  Found healthcheck.py but there is no documentation for it.????
     233No documentation exist that defines how to monitor OpenGENI component health.  Found healthcheck.py but there is no documentation for it.????
    234234 
    235 == 13. GRAM Rack Site Operations documentation ==     
     235== 13. OpenGENI Rack Site Operations documentation ==     
    236236 
    237237'''The goal of this evaluation:'''
    … …  
    244244No documentation found.
    245245
    246 == 14. Site Specific GRAM Deployment Data ==               
     246== 14. Site Specific OpenGENI Deployment Data ==               
    247247   
    248248'''The goal of this evaluation:'''