Sliver reports "Nascent" state 30 minutes after createsliver

[lnevers@bbn.com]

Created a sliver at 3:39 and over 30 minutes later the sliver is still in "configuring" state.

The sliver is urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+EG-EXP-4-exp2 and it includes 2 VMs @ RENCI and 1 VM @BBN and 1 Bare Metal @BBN.

The sliverstatus shows all geni_urns as active, except for #BT1:

$ omni.py sliverstatus -a eg-sm EG-EXP-4-exp2   
Mon Mar 11 16:11:47 EDT 2013
INFO:omni:Loading config file /home/lnevers2/.gcf/omni_config
INFO:omni:Using control framework pg
INFO:omni:Substituting AM nickname eg-sm with URL https://geni.renci.org:11443/orca/xmlrpc, URN unspecified_AM_URN
INFO:omni:Slice urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+EG-EXP-4-exp2 expires on 2013-03-12 20:39:37 UTC
INFO:omni:Substituting AM nickname eg-sm with URL https://geni.renci.org:11443/orca/xmlrpc, URN unspecified_AM_URN
INFO:omni:Status of Slice urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+EG-EXP-4-exp2:
INFO:omni:Slice urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+EG-EXP-4-exp2 at AM https://geni.renci.org:11443/orca/xmlrpc has overall SliverStatus: configuring
INFO:omni:Sliver status for Slice urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+EG-EXP-4-exp2 at AM URL https://geni.renci.org:11443/orca/xmlrpc
INFO:omni:{
  "geni_status": "configuring", 
  "geni_urn": "urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+EG-EXP-4-exp2", 
  "geni_resources": [
    {
      "orca_expires": "Mon Mar 25 14:40:26 EDT 2013", 
      "geni_urn": "urn:publicid:IDN+exogeni.net:bbnNet+sliver+bbnNet.rdf#bbnNet/Domain/vlan/c55744b7-b4a5-4e52-b7cb-ad3d5caae72f/vlan", 
      "geni_error": "", 
      "geni_status": "Active"
    }, 
    {
      "orca_expires": "Mon Mar 25 14:40:26 EDT 2013", 
      "geni_urn": "urn:publicid:IDN+exogeni.net:bbnvmsite+sliver+24b571d0-f9ac-42c7-85a7-a9a468d5de1b#BT1-bbnvm2", 
      "geni_error": "", 
      "geni_status": "Active"
    }, 
    {
      "orca_expires": "Mon Mar 25 14:40:26 EDT 2013", 
      "geni_urn": "urn:publicid:IDN+exogeni.net:ben+sliver+ben.rdf#ben/Domain/vlan/3b071876-e226-4cd7-980a-5ea88deb334b/vlan", 
      "geni_error": "", 
      "geni_status": "Active"
    }, 
    {
      "orca_expires": "Mon Mar 25 14:40:26 EDT 2013", 
      "geni_urn": "urn:publicid:IDN+exogeni.net:nlr+sliver+nlr.rdf#nlr/Domain/vlan/5c02b858-80a0-4550-a964-0e6b4d5fadc8/vlan", 
      "geni_error": "", 
      "geni_status": "Active"
    }, 
    {
      "orca_expires": "Mon Mar 25 14:40:26 EDT 2013", 
      "geni_urn": "urn:publicid:IDN+exogeni.net:nlr+sliver+nlr.rdf#nlr/Domain/vlan/012217bc-6958-47c5-b2bc-7e17d2c56d37/vlan", 
      "geni_error": "", 
      "geni_status": "Active"
    }, 
    {
      "orca_expires": "Mon Mar 25 14:40:26 EDT 2013", 
      "geni_urn": "urn:publicid:IDN+exogeni.net:rcivmsite+sliver+24b571d0-f9ac-42c7-85a7-a9a468d5de1b#rcivm2", 
      "geni_error": "", 
      "geni_status": "Active"
    }, 
    {
      "orca_expires": "Mon Mar 25 14:40:26 EDT 2013", 
      "geni_urn": "urn:publicid:IDN+exogeni.net:rcivmsite+sliver+24b571d0-f9ac-42c7-85a7-a9a468d5de1b#rcivm1", 
      "geni_error": "", 
      "geni_status": "Active"
    }, 
    {
      "orca_expires": "Mon Mar 25 14:40:26 EDT 2013", 
      "geni_urn": "urn:publicid:IDN+exogeni.net:bbnvmsite+sliver+24b571d0-f9ac-42c7-85a7-a9a468d5de1b#BT1", 
      "geni_error": "", 
      "geni_status": "Nascent"
    }, 
    {
      "orca_expires": "Mon Mar 25 14:40:26 EDT 2013", 
      "geni_urn": "urn:publicid:IDN+exogeni.net:rciNet+sliver+rciNet.rdf#rciNet/Domain/vlan/5cb49146-a47f-43e0-9b4d-c63e0b5cfc6a/vlan", 
      "geni_error": "", 
      "geni_status": "Active"
    }, 
    {
      "orca_expires": "Mon Mar 25 14:40:26 EDT 2013", 
      "geni_urn": "urn:publicid:IDN+exogeni.net:bbnvmsite+sliver+24b571d0-f9ac-42c7-85a7-a9a468d5de1b#BT1", 
      "geni_error": "", 
      "geni_status": "Active"
    }, 
    {
      "orca_expires": "Mon Mar 25 14:40:26 EDT 2013", 
      "geni_urn": "urn:publicid:IDN+exogeni.net:rciNet+sliver+rciNet.rdf#rciNet/Domain/vlan/cfed6776-e9fb-444a-a841-b0795adefc3b/vlan", 
      "geni_error": "", 
      "geni_status": "Active"
    }, 
    {
      "orca_expires": "Mon Mar 25 14:40:26 EDT 2013", 
      "geni_urn": "urn:publicid:IDN+exogeni.net:bbnvmsite+sliver+24b571d0-f9ac-42c7-85a7-a9a468d5de1b#bbnvm2", 
      "geni_error": "", 
      "geni_status": "Active"
    }, 
    {
      "orca_expires": "Mon Mar 25 14:40:26 EDT 2013", 
      "geni_urn": "urn:publicid:IDN+exogeni.net:bbnNet+sliver+bbnNet.rdf#bbnNet/Domain/vlan/dfae06cb-1928-4ee4-a68f-516215350b66/vlan", 
      "geni_error": "", 
      "geni_status": "Active"
    }, 
    {
      "orca_expires": "Mon Mar 25 14:40:26 EDT 2013", 
      "geni_urn": "urn:publicid:IDN+exogeni.net:ben+sliver+ben.rdf#ben/Domain/vlan/76fae948-f2da-4b2a-98dc-f8fef0181869/vlan", 
      "geni_error": "", 
      "geni_status": "Active"
    }
  ]
}
<.....>

[ibaldin@renci.org]

I see *two* reservations for baremetal nodes in this slice. One has booted, the other has nowhere to go, because another experiment (IG-EXP-1) is holding a reservation for the second baremetal node in that rack.

[ibaldin@renci.org]

Looking at it some more, I think this is a funky topology embedding bug (possibly). Can you attach a slice request please?

[lnevers@bbn.com]

Attaching request Rspec.

[ibaldin@renci.org]

It is a topology embedding bug. The fix is on the trunk, will be deployed at next maintenance.