Changes between Version 44 and Version 45 of GENIRacksHome/InstageniRacks/AcceptanceTestStatus/IG-EXP-1


Ignore:
Timestamp:
02/06/13 11:02:18 (11 years ago)
Author:
lnevers@bbn.com
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • GENIRacksHome/InstageniRacks/AcceptanceTestStatus/IG-EXP-1

    v44 v45  
    227227
    228228
    229     a. Checked resource InstaGENI GPO rack to find a dedicated node that is available for re-allocation
     229    a. Checked resource InstaGENI GPO rack to find available dedicated node.
    230230    b. Follow the instructions to add the  node to the shared pool as defined at the [https://wiki.emulab.net/Emulab/wiki/SetupSharedNodes Setup Shared Nodes] page.
    231     c. Verify that the node becomes part of the shared pool via listresources component_id "exclusive" tag.
     231    c. Verify that the node becomes part of the shared pool.
    232232    d. Verify that no VMs are in use for the new shared node by checking  that the tag "<emulab:node_type type_slots="100"/> ".
    233233    e. Modify shared-nodes experiment to remove the node, (if not in use).
     
    295295}}}
    296296
    297 
    298 
     297Submitted the modifications and the following was reported as the allocation was modified:
     298{{{
     299Doing a preswapmod on the experiment archive ...
     300Backing up old experiment state ... 10:42:28:275547
     301Running 'tbprerun  -e 13 shared-nodes-modify.ns'
     302Beginning pre run for emulab-ops/shared-nodes. 10:42:28:567671
     303Running parser ... 10:42:28:901234
     304Parser done! 10:42:31:271349
     305Setting up static routes (if requested) ...
     306*** WARNING: staticroutes:
     307***   No links or lans in experiment emulab-ops/shared-nodes!
     308Generating topomap ...
     309Verifying parse ...
     310Doing a pre-assign: '/usr/testbed/bin/vtopgen -p emulab-ops shared-nodes' ...
     311Checking for feature LibVtopTest.
     312Using test version of libvtop ...
     313Minimum nodes   = 3
     314Maximum nodes   = 3
     315Writing environment strings ...
     316Setting up additional program agent support ...
     317Setting up additional network agent support ...
     318Writing program agent info ...
     319Pre run finished. 10:42:34:348647
     320Running 'tbswap modify -reboot -eventsys_restart -noswapout -noreconfig emulab-ops shared-nodes'
     321Beginning swap-modify for emulab-ops/shared-nodes (13). 02/06/2013 10:42:34
     322TIMESTAMP: 10:42:34:635812 tbswap modify started
     323Checking for feature SyncVlans.
     324Checking with Admission Control ...
     325Backing up physical state...
     326Stopping the event system
     327Checking for feature NewEventScheduler.
     328Mapping to physical reality ...
     329TIMESTAMP: 10:42:36:53970 mapper wrapper started
     330Checking for feature OldMapper.
     331Checking for feature NewAssign.
     332Checking for feature ControlNetVlans.
     333Checking for feature LibVtopTest.
     334Using test version of libvtop ...
     335Starting the new and improved mapper wrapper.
     336Minimum nodes   = 3
     337Maximum nodes   = 3
     338Reserved pnodes   = 2
     339Clearing physical state before updating.
     340Mapper loop 1
     341ptopargs: '-p emulab-ops -e shared-nodes '
     342assign command: 'assign -P -f text emulab-ops-shared-nodes-864.ptop emulab-ops-shared-nodes-864.vtop'
     343Reading assign results.
     344[Node: pc1] already reserved in holding reservation.
     345[Node: pc2] already reserved in holding reservation.
     346pc4
     347pc1
     348pc2
     349TIMESTAMP: 10:42:39:703877 mapper wrapper finished
     350Mapped to physical reality!
     351Synchronizing VLANs.
     352getTrunksForVlan: 8: procurve2
     353mapVlansToSwitches: procurve2
     354getExperimentTrunksForVlan: 8: procurve2
     355mapStaleVlansToSwitches: procurve2
     356procurve2 -> startChildCall(FlipDebug)
     357Experiment vlans: 8
     358Trunk Ports: pc1:3.1 pc2:3.1 pc2:2.1 pc4:1.1 pc2:1.1 pc4:3.1 pc4:2.1 pc1:2.1 pc1:1.1
     359Existing vlans: 8
     360Stale vlans:
     361Existing Trunk Ports: pc1:3.1 pc2:3.1 pc2:1.1 pc1:1.1
     362Creating dual mode trunking vlan 8: pc4:1.1 pc4:2.1 pc4:3.1
     363snmpit_stack::findVlans(  )
     364procurve2 -> startChildCall(findVlans)
     365procurve2::findVlans
     366snmpit_stack::reapCall(findVlans)
     367stack::findVlans calling procurve2
     368  VLAN 8 already exists
     369snmpit_stack::findVlan( 8 )
     370snmpit_stack::findVlans( 8 )
     371procurve2 -> startChildCall(findVlans)
     372procurve2::findVlans
     373snmpit_stack::reapCall(findVlans)
     374stack::findVlans calling procurve2
     375snmpit_stack::findVlans(  )
     376procurve2 -> startChildCall(findVlans)
     377procurve2::findVlans
     378snmpit_stack::reapCall(findVlans)
     379stack::findVlans calling procurve2
     380getTrunksForVlan: 8: procurve2
     381procurve2 -> startChildCall(vlanNumberExists)
     382Vlan 8 already exists on procurve2
     383jitdev::setPortVlan( 257 pc4:1.1 pc4:2.1 pc4:3.1 )
     384procurve2 -> startChildCall(setPortVlan)
     385procurve2::setPortVlan(257)as ifIndexes: 106,107,108
     386portControl: enable -> (pc4:1.1 pc4:2.1 pc4:3.1)
     387checking row 106 for up ...
     388Port pc4:1.1, row 106 was down
     389Setting pc4:1.1 (r 106) to up...succeeded.
     390checking row 107 for up ...
     391Port pc4:2.1, row 107 was down
     392Setting pc4:2.1 (r 107) to up...succeeded.
     393checking row 108 for up ...
     394Port pc4:3.1, row 108 was down
     395Setting pc4:3.1 (r 108) to up...succeeded.
     396procurve2 -> startChildCall(portControl)
     397portControl: 1000mbit -> (pc4:1.1)
     398checking row 106 for auto-1000Mbits ...
     399Port pc4:1.1, row 106 was auto-1000Mbits
     400procurve2 -> startChildCall(portControl)
     401portControl: full -> (pc4:1.1)
     402checking row 106 for full ...
     403Port pc4:1.1, row 106 was auto-1000Mbits
     404procurve2 -> startChildCall(portControl)
     405portControl: 1000mbit -> (pc4:2.1)
     406checking row 107 for auto-1000Mbits ...
     407Port pc4:2.1, row 107 was auto-1000Mbits
     408procurve2 -> startChildCall(portControl)
     409portControl: full -> (pc4:2.1)
     410checking row 107 for full ...
     411Port pc4:2.1, row 107 was auto-1000Mbits
     412procurve2 -> startChildCall(portControl)
     413portControl: 1000mbit -> (pc4:3.1)
     414checking row 108 for auto-1000Mbits ...
     415Port pc4:3.1, row 108 was auto-1000Mbits
     416procurve2 -> startChildCall(portControl)
     417portControl: full -> (pc4:3.1)
     418checking row 108 for full ...
     419Port pc4:3.1, row 108 was auto-1000Mbits
     420Enabling dual mode trunking on pc1:2.1:8
     421Enabling dual trunking (tagging) on pc1:2.1 8
     422procurve2 -> startChildCall(findVlan)
     423procurve2::findVlans
     424Enable trunking: Port is pc1:2.1 native VLAN is 8
     425procurve2 -> startChildCall(enablePortTrunking2)
     426procurve2::setPortVlan(257)as ifIndexes: 98
     427portControl: enable -> (pc1:2.1)
     428checking row 98 for up ...
     429Port pc1:2.1, row 98 was down
     430Setting pc1:2.1 (r 98) to up...succeeded.
     431procurve2::updateOneVlan(0,0,1) as ifIndexes: 98
     432Enabling dual mode trunking on pc2:2.1:8
     433Enabling dual trunking (tagging) on pc2:2.1 8
     434procurve2 -> startChildCall(findVlan)
     435procurve2::findVlans
     436Enable trunking: Port is pc2:2.1 native VLAN is 8
     437procurve2 -> startChildCall(enablePortTrunking2)
     438procurve2::setPortVlan(257)as ifIndexes: 101
     439portControl: enable -> (pc2:2.1)
     440checking row 101 for up ...
     441Port pc2:2.1, row 101 was down
     442Setting pc2:2.1 (r 101) to up...succeeded.
     443procurve2::updateOneVlan(0,0,1) as ifIndexes: 101
     444Enabling dual mode trunking on pc4:1.1:8
     445Enabling dual trunking (tagging) on pc4:1.1 8
     446procurve2 -> startChildCall(findVlan)
     447procurve2::findVlans
     448Enable trunking: Port is pc4:1.1 native VLAN is 8
     449procurve2 -> startChildCall(enablePortTrunking2)
     450procurve2::updateOneVlan(0,0,1) as ifIndexes: 106
     451Enabling dual mode trunking on pc4:2.1:8
     452Enabling dual trunking (tagging) on pc4:2.1 8
     453procurve2 -> startChildCall(findVlan)
     454procurve2::findVlans
     455Enable trunking: Port is pc4:2.1 native VLAN is 8
     456procurve2 -> startChildCall(enablePortTrunking2)
     457procurve2::updateOneVlan(0,0,1) as ifIndexes: 107
     458Enabling dual mode trunking on pc4:3.1:8
     459Enabling dual trunking (tagging) on pc4:3.1 8
     460procurve2 -> startChildCall(findVlan)
     461procurve2::findVlans
     462Enable trunking: Port is pc4:3.1 native VLAN is 8
     463procurve2 -> startChildCall(enablePortTrunking2)
     464procurve2::updateOneVlan(0,0,1) as ifIndexes: 108
     465Fetching tarballs and RPMs (if any) ...
     466TIMESTAMP: 10:42:42:105102 tarfiles_setup started
     467TIMESTAMP: 10:42:42:428132 tarfiles_setup finished
     468Updating dynamic blobs.
     469Setting up mountpoints.
     470TIMESTAMP: 10:42:42:486896 mountpoints started
     471TIMESTAMP: 10:42:44:738628 mountpoints finished
     472TIMESTAMP: 10:42:44:740361 named started
     473Setting up named maps.
     474TIMESTAMP: 10:42:45:231283 named finished
     475TIMESTAMP: 10:42:45:232917 gentopofile started
     476Generating ltmap (again) ...
     477TIMESTAMP: 10:42:45:418914 gentopofile finished
     478Resetting OS and rebooting.
     479TIMESTAMP: 10:42:45:421243 launching os_setup
     480Checking for feature OldOsSetup.
     481TIMESTAMP: 10:42:46:11935 os_setup started
     482Checking for feature NewOsload.
     483Adding pc1 to type object pc
     484pc1 - [OS 10016: emulab-ops,FEDORA15-OPENVZ-STD]
     485Adding pc2 to type object pc
     486pc2 - [OS 10016: emulab-ops,FEDORA15-OPENVZ-STD]
     487Adding pc4 to type object pc
     488pc4 - [OS 10016: emulab-ops,FEDORA15-OPENVZ-STD]
     489Asking [pc] for volunteers
     490[pc] returns volunteers: [Node: pc4] [Node: pc1] [Node: pc2]
     491Lighting up nodes in parallel ...
     492Lighting up nodes: [Node: pc4] [Node: pc1] [Node: pc2]
     493pc4 will be reloaded with [Image 10016: emulab-ops,FEDORA15-OPENVZ-STD]
     494Checking for feature NewOsload.
     495osload: Using [Image 10016: emulab-ops,FEDORA15-OPENVZ-STD] for pc4
     496[Image 10016: emulab-ops,FEDORA15-OPENVZ-STD]: loadpart=2, loadlen=1, \
     497 imagepath=/usr/testbed/images/FEDORA15-OPENVZ-STD.ndz, imagesize=1217396736, defosid=10016, maxloadwait=1354
     498osload (pc4): Changing default OS to [OS 10016: emulab-ops,FEDORA15-OPENVZ-STD]
     499Setting up reload for pc4 (mode: Frisbee)
     500TIMESTAMP: 10:42:47:373034 osload: database setup done
     501osload: Issuing reboot for pc4 and then waiting ...
     502TIMESTAMP: 10:42:47:376165 osload: event handler enabled
     503reboot: no privs; invoking real nodereboot script!
     504reboot: Running in pipemode (30).
     505reboot (pc4): Attempting to reboot ...
     506reboot (pc4): in PXEWAIT: sending wakeup command.
     507Built 17-Jan-2013 by elabman@boss:/users/elabman/testbed/obj-real/pxe
     508Sending event PXEWAKEUP for node pc4
     509192.1.242.143: SEND: query bootinfo
     510reboot (pc4): Successful!
     511reboot: Done. There were 0 failures.
     512reboot (pc4): child returned 0 status.
     513Waiting for pc4 to finish reloading
     514Wed Feb  6 10:42:47 EST 2013
     515TIMESTAMP: 10:42:47:992938 osload: starting reload-done wait
     516osload: eventhandler: pc4 => RELOADSETUP @ 1360165393
     517osload: eventhandler: pc4 => RELOADING @ 1360165393
     518got 2 events
     519osload (pc4): still waiting; it has been 1 minute(s)
     520osload (pc4): still waiting; it has been 2 minute(s)
     521osload (pc4): still waiting; it has been 3 minute(s)
     522osload (pc4): still waiting; it has been 4 minute(s)
     523osload (pc4): still waiting; it has been 5 minute(s)
     524osload (pc4): still waiting; it has been 6 minute(s)
     525osload (pc4): still waiting; it has been 7 minute(s)
     526osload (pc4): left reloading mode at Wed Feb  6 10:50:08 EST 2013
     527osload: Done! There were 0 failures.
     528reload (pc4): child returned 0 status.
     529Waiting for nodes ...
     530pc1 has reported state ISUP
     531Checking for feature OsloadFailNonfatal.
     532pc1 is alive and well
     533pc2 has reported state ISUP
     534Checking for feature OsloadFailNonfatal.
     535pc2 is alive and well
     536*** os_setup: Still waiting for pc4 (SHUTDOWN) - it's been 1 minute(s).
     537*** os_setup: Still waiting for pc4 (SHUTDOWN) - it's been 2 minute(s).
     538*** os_setup: Still waiting for pc4 (BOOTING) - it's been 3 minute(s).
     539pc4 has reported state ISUP
     540Checking for feature OsloadFailNonfatal.
     541pc4 is alive and well
     542Asking [pc] for volunteers
     543TIMESTAMP: 10:53:34:398383 os_setup finished
     544Starting the event system.
     545TIMESTAMP: 10:53:34:416968 eventsys_control started
     546Checking for feature NewEventScheduler.
     547/usr/testbed/sbin/event-sched -d -s localhost -k /proj/emulab-ops/exp/shared-nodes/tbdata/eventkey emulab-ops \
     548 shared-nodes
     549Beginning call to experiment.metadata
     550Error occured: problem setting up certificate
     551could not get experiment metadata
     552Finished with call to experiment.metadata
     553*** eventsys.proxy:
     554    Failed to start event system for emulab-ops/shared-nodes: 47835 0!
     555*** WARNING: tbswap:
     556***   Failed to start the event system, must restart manually.
     557Successfully finished swap-modify for emulab-ops/shared-nodes. 10:53:37:300754
     558TIMESTAMP: 10:53:37:301712 tbswap modify finished (succeeded)
     559Image rendering proceeding in background mode ...
     560Running 'tbreport -b emulab-ops shared-nodes'
     561cp: utimes: /usr/testbed/expinfo/emulab-ops/shared-nodes/13/pstate.DvOhzX: Operation not permitted
     562cp: utimes: /usr/testbed/expinfo/emulab-ops/shared-nodes/13/vstate.12tonR: Operation not permitted
     563cp: utimes: /usr/testbed/expinfo/emulab-ops/shared-nodes/13/vstate.FdQ9Eq: Operation not permitted
     564cp: utimes: /usr/testbed/expinfo/emulab-ops/shared-nodes/13/vstate.Qk8L8S: Operation not permitted
     565cp: utimes: /usr/testbed/expinfo/emulab-ops/shared-nodes/13: Operation not permitted
     566Doing a commit on the previous experiment archive ...
     567Doing a savepoint on the experiment archive ...
     568Swap Success!
     569}}}
     570
     571c. Verified that the node becomes part of the shared pool.
     572Checked the details for the shared-node experiment which shows pc4 as one of the nodes in the shared nodes pool:
     573
     574[[Image(IG-EXP-1-pc4-shared.jpg)]]
     575
     576d. Verify that no VMs are in use for the new shared node by checking  that the tag "<emulab:node_type type_slots="100"/> ".
     577
     578{{{
     579  <node component_id="urn:publicid:IDN+instageni.gpolab.bbn.com+node+pc4" component_manager_id="urn:publicid:IDN+instageni.gpolab.bbn.com+authority+cm" component_name="pc4" exclusive="false">
     580
     581      <hardware_type name="dl360-vm">
     582          <emulab:node_type type_slots="100"/>
     583      </hardware_type>
     584}}}
     585
     586    e. Modify shared-nodes experiment to remove the node, (if not in use).
     587
     588Selected modify experiment and removed:
     589{{{
     590set vhost3 [$ns node]
     591tb-set-node-os $vhost3 FEDORA15-OPENVZ-STD
     592tb-set-node-sharingmode $vhost3 "shared_local"
     593tb-fix-node $vhost3 pc4
     594}}}
     595
     596Submited the changes and the following operations took place:
     597{{{
     598
     599    f. Verify that the node is no longer part of the shared pool via listresources component_id "exclusive" tag.
     600
     601