Changes between Version 14 and Version 15 of GENIRacksHome/ExogeniRacks/AcceptanceTestStatus/EG-ADM-4


Ignore:
Timestamp:
03/06/13 15:48:57 (11 years ago)
Author:
tupty@bbn.com
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • GENIRacksHome/ExogeniRacks/AcceptanceTestStatus/EG-ADM-4

    v14 v15  
    108108}}}
    109109
     110The GMOC followed up at 2:54 PM EST with:
     111{{{
     112Greetings Aggregate Operator or GENI Rack site Operator,
     113
     114We received an emergency stop request from a GENI Experimenter (Chaos
     115Golubinski) for the following GENI resource:
     116
     117Slice URN: urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+jbs15 of which
     118RENIC is listed as Aggregate Operator and BBN/GPO is the Rack site
     119contact. Please acknowledge within an hour that you are looking into
     120this Emergency Stop request and are working to shut-down this
     121resource. If no response is received in one hour, we will proceed to
     122contact your Escalation contact and/or perform an isolation of your
     123slice/resource from the GENI Core network.
     124
     125NOTE: Please feel free to reference the following document for
     126details of the GMOC Emergency Stop process:
     127http://gmoc.grnoc.iu.edu/gmoc/documents/geni-standards/gmoc-support-e
     128mergency-stop-procedure-and-workflow.html
     129}}}
     130
    110131= Step 5: Site Administrator receives ES request =
    111132
     
    122143 * The Site Administrator can identify the experimenter's email address, username, and affiliation with the information provided by the GMOC and GMOC monitoring tools
    123144
     145=== Results of testing step 5A: 2013-03-06 ===
     146 * The GMOC's email included the slice URN, which was as expected for today's test.  The ExoGENI procedure can be followed with a slice URN.
     147 * The example procedure includes a step to ack the GMOC's ES request, and I acked the request at 2:56 PM EST.
     148 * I can see the experimenter's email address, user URN, and operator organization when I look at [https://gmoc-db.grnoc.iu.edu/protected-openid/index.pl?method=slice_details;slice=urn%3Apublicid%3AIDN%2Bpgeni.gpolab.bbn.com%2Bslice%2Bjbs15 the GMOC web UI].
     149
    124150== Step 5B (verify): Shut down procedure can be followed to successfully shut down a sliver ==
    125151
     
    134160 * Experimental traffic from the sliver is no longer being sent
    135161
     162=== Results of testing step 5B: 2013-03-06 ===
     163 * I followed only the steps in the documented procedure, and the sliver was successfully shut down.  There was an issue with verifying that the sliver was shut down if the documented procedure was followed.  We did verify that the sliver had been shut down, but we used steps that were not in the documented procedure.  We will need to follow up with the ExoGENI team:
     164{{{
     165pequod>show sms
     166bbn-sm  sm      6f72d5ac-5190-46c8-bc10-cc4af5dcab6e
     167        http://localhost:14080/orca/spring-services
     168        [Service Manager at BBN ExoGENI Site for topology embedding]
     169
     170pequod>show slices for bbn-sm filter "jbs15"
     171urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+jbs15
     1728780bcef-6b72-4897-b750-f47a713e176c
     173urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+jbs15
     1744993ad93-7db4-4070-9e2b-756f9af653b6
     175urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+jbs15
     176c8bb5fbb-c680-437c-be18-c02a8e433542
     177
     178Total: 3 slices
     179pequod>
     180Logging out of containers
     181Shutting down commands help file set show aux manage
     182Resetting terminal and exiting. Goodbye.
     183
     184[tupty@bbn-hn ~]$ pequod
     185Pequod ORCA Shell v.4.0-SNAPSHOT.build-5214 built on 02/28/2013 12:19
     186(c) 2012-2013 RENCI/UNC Chapel Hill
     187
     188  help: Returns help for individual commands
     189  file: File-related commands
     190  set: Modify internal set variables
     191  show: Show the state of things
     192  aux: Auxiliary commands
     193  manage: Manage actor state
     194  history: show command history (!<command index> invokes the command)
     195  exit: Exit from the shell (Ctrl-D or Ctrl-C also works)
     196Type the entire command, or enter the first word of the command to
     197enter subcommand with intelligent auto-completion (Using TAB).
     198
     199"It is not down on any map; true places never are."
     200                -Herman Melville, Moby Dick
     201
     202pequod>show slices for bbn-sm filter "jbs15"
     203urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+jbs15
     2048780bcef-6b72-4897-b750-f47a713e176c
     205urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+jbs15
     2064993ad93-7db4-4070-9e2b-756f9af653b6
     207urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+jbs15
     208c8bb5fbb-c680-437c-be18-c02a8e433542
     209
     210Total: 3 slices
     211pequod>
     212Logging out of containers
     213Shutting down commands help file set show aux manage
     214Resetting terminal and exiting. Goodbye.
     215[tupty@bbn-hn ~]$ pequod
     216Pequod ORCA Shell v.4.0-SNAPSHOT.build-5214 built on 02/28/2013 12:19
     217(c) 2012-2013 RENCI/UNC Chapel Hill
     218
     219  help: Returns help for individual commands
     220  file: File-related commands
     221  set: Modify internal set variables
     222  show: Show the state of things
     223  aux: Auxiliary commands
     224  manage: Manage actor state
     225  history: show command history (!<command index> invokes the command)
     226  exit: Exit from the shell (Ctrl-D or Ctrl-C also works)
     227Type the entire command, or enter the first word of the command to
     228enter subcommand with intelligent auto-completion (Using TAB).
     229
     230"It is not down on any map; true places never are."
     231                -Herman Melville, Moby Dick
     232
     233pequod>show reservations for c8bb5fbb-c680-437c-be18-c02a8e433542
     234actor bbn-sm state active
     23542b5b5f6-6d39-4359-b37f-5cb9f435f066    bbn-sm
     236        1       bbnvmsite.vm    [ active, activeticketed]
     237        Notices: Reservation 42b5b5f6-6d39-4359-b37f-5cb9f435f066
     238(Slice urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+jbs15) is in state
     239[Active,ExtendingTicket]
     240        Start: Mon Feb 25 20:25:26 UTC 2013     End:Mon Mar 11 19:25:27 UTC 2013
     241
     242Total: 1 reservations
     243pequod>manage close slice c8bb5fbb-c680-437c-be18-c02a8e433542 actor bbn-sm
     244Closed slice c8bb5fbb-c680-437c-be18-c02a8e433542 on bbn-sm with result true
     245pequod>show reservations for current actor bbn-sm
     246ERROR: Current slice not set
     247Total: 0 reservations
     248}}}
     249
     250The above final command is missing a step to set the variable "current", which is why it did not work.  This should be addressed in the documentation.
     251
     252 * To verify that the reservations were gone, we ran:
     253{{{
     254pequod>show reservations for c8bb5fbb-c680-437c-be18-c02a8e433542 actor bbn-sm
     25542b5b5f6-6d39-4359-b37f-5cb9f435f066    bbn-sm
     256        1       bbnvmsite.vm    [ closed, nascent]
     257        Notices: Reservation 42b5b5f6-6d39-4359-b37f-5cb9f435f066 (Slice urn:pub
     258        Start: Mon Feb 25 20:25:26 UTC 2013     End:Mon Mar 11 19:25:27 UTC 2013
     259
     260Total: 1 reservations
     261}}}
     262This lists the reservation as being in the "closed" state as described in the document.  The document says "The next to last command should show a list of active slivers within a slice. The last command verifies that all reservations in the slice are either closed or failed".  That should probably actually say "The third-to-last command...".
     263
     264 * Traffic dropped to expected levels.  See [http://monitor.gpolab.bbn.com/ganglia/graph.php?&c=BBN%20External&h=poblano.gpolab.bbn.com&v=1308320.37838&m=RX_BYTES_gi0_15&r=day&z=medium&jr=&js=&st=1362602331&vl=bytes%2Fsec&z=large the graph for the previous 24 hours as of 3:39.]
     265
    136266== Step 5C (verify): Documented procedure includes a step to follow up with GMOC ==
    137267
     
    142272 * There is a step for the site administrator to follow up with the GMOC that a sliver has been shut down
    143273
     274=== Results of testing step 5C: 2013-03-06 ===
     275 * The GMOC ack-ed my ack at 3:01 PM EST, although I don't think that is a requirement.
     276 * There is a step to follow up with the GMOC, and I did so at 3:11 PM EST.
     277
    144278= Step 6 (verify): Sliver shut down procedure includes a clean-up step (if necessary) =
    145279
     
    149283'''Verify:'''
    150284 * Ensure the ExoGENI sliver shut down procedure contains a recovery step describing what to do if the shut down affects other experimenters.
     285
     286== Results of testing step 6: 2013-03-06 ==
     287There were no clean up steps necessary for the pieces involving the ExoGENI doc in today's test.