wiki:GENIRacksHome/CiscoGENIRacks/AcceptanceTestStatus/CG-EXP-6

Version 30 (modified by lnevers@bbn.com, 5 years ago) (diff)

--

CG-EXP-6: Limits Tests

This test allocated resources in both NCSU2 and NCSU Cisco racks. Note the following Omni nick names are used:

ncsu2-eg=urn:publicid:IDN+exogeni.net:ncsu2vmsite+authority+am,https://ncsu2-hn.exogeni.net:11443/orca/xmlrpc
ncsu-eg=urn:publicid:IDN+exogeni.net:ncsuvmsite+authority+am,https://ncsu-hn.exogeni.net:11443/orca/xmlrpc

Test Status

This section captures the status for each step in the acceptance test plan.

Test State Tickets/Comments
NCSU2 Results:
100 VM - 50 slices w/2 VMsColor(yellow,Complete)?Run2: Only 40 slivers were created; Run1: Only 39 slivers were created; able to exchange traffic between the VMs in both runs.
100 VMs - 10 slices w/10 VMsColor(green,Pass)? Able to exchange traffic between the 100 VMs.
100 VMs - 4 slices w/25 VMs Color(red,Fail)?Error from Aggregate: code 2: Invalid slice urn reported at NCSU2, but same slice and unbound rspec works at GPO EG
NCSU Results:
100 VM - 50 slices w/2 VMsColor(green,Pass)?Run2: 50 slivers created; Run1: Only 49 slivers were created; Able to exchange traffic between all VMs allocated.
100 VMs - 10 slices w/10 VMsColor(green,Pass)? Able to exchange traffic between the 100 VMs.
100 VMs - 4 slices w/25 VMs Color(red,Fail)?Error from Aggregate: code 2: Invalid slice urn reported at NCSU, but same slice and unbound rspec works at GPO EG (ORCA5)


State Legend Description
Color(green,Pass)? Test completed and met all criteria
Color(#98FB98,Pass: most criteria)? Test completed and met most criteria. Exceptions documented
Color(red,Fail)? Test completed and failed to meet criteria.
Color(yellow,Complete)? Test completed but will require re-execution due to expected changes
Color(orange,Blocked)? Blocked by ticketed issue(s).
Color(#63B8FF,In Progress)? Currently under test.


NCSU2 Limits Tests

100 VM - 50 slices w/2 VMs

The following is the approach taken to create the 50 slices with cisco-2vm.rspec:

 for i in {1..50}
 do
 omni createslice ncsu2-$i
 omni createsliver -a ncsu2-eg ncsu-$i ./cisco-2vm.rspec
 sleep 60
 done

RUN 2: Slice 1-40 were all created without any problem; All 80 VMs were accessible and could exchange traffic. The slice 41-50 failed to be created due to lack of resources, just as with Run 1 below.

RUN 1: Slices were all created without any problem; slices 40-50 failed as follows:

13:48:53 WARNING : Failed CreateSliver for slice ncsu-40 at ncsu2-eg.  
Error from Aggregate: code 2: Embedding workflow ERROR: 1: Cannot create 
the network reservation, likely no available resource, the user specified 
label or hybrid OF is not valid in this site:
http://geni-orca.renci.org/owl/ncsu2vmsite.rdf#ncsu2vmsite/Domain.

For each of the 39 successful slivers slivers verified that geni_status "ready" existed, and then executed a ping between the two nodes in each slice.

100 VMs - 10 slices w/10 VMs

The following is the approach taken to create the 10 slices with cisco-10vm-1lan-ncsu2.rspec:

for i in {1..10}
  do 
  omni createslice ncsu-$i 
  omni createsliver -a ncsu2-eg ncsu-$i cisco-10vm-1lan-ncsu2.rspec; done
  sleep 90
  done

Was able to create 10 slices and verified exchange of traffic between the 100 VMs.

100 VMs - 4 slices w/25 VMs

Created first sliver manually with cisco-25vm.rspec:

Same as Run 1, initial sliver fails with the warning:

12:34:46 WARNING : Failed CreateSliver for slice ncsu25-2 at ncsu-eg.  
Error from Aggregate: code 2: Embedding workflow ERROR: 1:
Cannot create the network reservation, likely no available resource, 
the user specified label or hybrid OF is not valid in this site:
http://geni-orca.renci.org/owl/ncsuvmsite.rdf#ncsuvmsite/Domain.

Run 1:

$ omni createsliver 25vm-1 -a ncsu2-eg ./cisco-25vm.rspec -o
15:15:26 INFO    : Loading agg_nick_cache file '/home/lnevers/.gcf/agg_nick_cache'
15:15:26 INFO    : Loading config file '/home/lnevers/.gcf/omni_config'
15:15:26 INFO    : Using control framework portal
15:15:26 INFO    : Member Authority is https://ch.geni.net/MA (from config)
15:15:26 INFO    : Slice Authority is https://ch.geni.net/SA (from config)
15:15:26 INFO    : Substituting AM nickname ncsu2-eg with URL https://ncsu2-hn.exogeni.net:11443/orca/xmlrpc, URN urn:publicid:IDN+exogeni.net:ncsu2vmsite+authority+am
15:15:26 INFO    : Slice urn:publicid:IDN+ch.geni.net:ln-test+slice+25vm-1 expires on 2014-12-22 20:15:00 UTC
15:15:26 INFO    : Creating sliver(s) from rspec file ./cisco-25vm.rspec for slice urn:publicid:IDN+ch.geni.net:ln-test+slice+25vm-1
15:15:46 INFO    : Got return from CreateSliver for slice 25vm-1 at ncsu2-eg:
15:15:46 INFO    : Writing to '25vm-1-manifest-rspec-exogeni-net-ncsu2vmsite.xml'
15:15:46 INFO    : Wrote result of createsliver for slice: 25vm-1 at AM: ncsu2-eg to file 25vm-1-manifest-rspec-exogeni-net-ncsu2vmsite.xml
15:15:54 INFO    :  ------------------------------------------------------
15:15:54 INFO    :  Completed createsliver:

  Options as run:
		aggregate: ['ncsu2-eg']
		framework: portal
		output: True
		project: ln-test

  Args: createsliver 25vm-1 ./cisco-25vm.rspec

  Result Summary: Got Reserved resources RSpec from exogeni-net-ncsu2vmsite
   Saved createsliver results to 25vm-1-manifest-rspec-exogeni-net-ncsu2vmsite.xml.  
15:15:54 INFO    :  ======================================================

Creates an additional sliver (25vm-2) with the same RSpec, but had failure:

$ omni createsliver 25vm-2 -a ncsu2-eg ./cisco-25vm.rspec -o
15:16:22 INFO    : Loading agg_nick_cache file '/home/lnevers/.gcf/agg_nick_cache'
15:16:22 INFO    : Loading config file '/home/lnevers/.gcf/omni_config'
15:16:22 INFO    : Using control framework portal
15:16:22 INFO    : Member Authority is https://ch.geni.net/MA (from config)
15:16:22 INFO    : Slice Authority is https://ch.geni.net/SA (from config)
15:16:22 INFO    : Substituting AM nickname ncsu2-eg with URL https://ncsu2-hn.exogeni.net:11443/orca/xmlrpc, URN urn:publicid:IDN+exogeni.net:ncsu2vmsite+authority+am
15:16:22 INFO    : Slice urn:publicid:IDN+ch.geni.net:ln-test+slice+25vm-2 expires on 2014-12-22 20:16:15 UTC
15:16:22 INFO    : Creating sliver(s) from rspec file ./cisco-25vm.rspec for slice urn:publicid:IDN+ch.geni.net:ln-test+slice+25vm-2
15:17:32 WARNING : Failed CreateSliver for slice 25vm-2 at ncsu2-eg.  Error from Aggregate: 
code 2: Embedding workflow ERROR: 1:Cannot create the network reservation, likely no available 
resource, the user specified label or hybrid OF is not valid in this site:
http://geni-orca.renci.org/owl/ncsu2vmsite.rdf#ncsu2vmsite/Domain.
 Please see https://geni-orca.renci.org/trac/wiki/orca-errors for possible solutions.
15:17:32 INFO    :  ------------------------------------------------------
15:17:32 INFO    :  Completed createsliver:

  Options as run:
		aggregate: ['ncsu2-eg']
		framework: portal
		output: True
		project: ln-test

  Args: createsliver 25vm-2 ./cisco-25vm.rspec

  Result Summary: Failed CreateSliver for slice 25vm-2 at ncsu2-eg.  Error from Aggregate: code 2: 
Embedding workflow ERROR: 1:Cannot create the network reservation, likely no available resource, 
the user specified label or hybrid OF is not valid in this site:http://geni-orca.renci.org/owl/ncsu2vmsite.rdf#ncsu2vmsite/Domain.
 Please see https://geni-orca.renci.org/trac/wiki/orca-errors for possible solutions. 
15:17:32 INFO    :  ======================================================

NCSU Limits Tests

100 VM - 50 slices w/2 VMs

The following is the approach taken to create the 50 slices with cisco-2vm.rspec:

 for i in {1..50}
 do
 omni createslice ncsu-$i
 omni createsliver -a ncsu-eg ncsu-$i ./cisco-2vm.rspec
 sleep 60
 done

RUN 2:

Slice 1-50 were all created without any problem; All VMs were accessible and could exchange traffic.

RUN 1: Slice 1-49 worked, and the 50th slice failed with:

14:22:38 WARNING : Failed CreateSliver for slice ncsu-50 at ncsu-eg.  Error from Aggregate: code 2: Embedding workflow ERROR: 1:Cannot create the network reservation, likely no available resource, the user specified label or hybrid OF is not valid in this site:http://geni-orca.renci.org/owl/ncsuvmsite.rdf#ncsuvmsite/Domain.

For each of the 49 successful slivers verified that geni_status "ready" existed, and then executed a ping between the two nodes in each slice.

100 VMs - 10 slices w/10 VMs

The following is the approach taken to create the 10 slices with cisco-10vm-1lan-ncsu.rspec:

for i in {1..10}
  do 
  omni createslice ncsu-$i 
  omni createsliver -a ncsu-eg ncsu-$i cisco-10vm-1lan-ncsu.rspec; done
  sleep 90
  done

Was able to create 10 slices and verified exchange of traffic between the 100 VMs.

100 VMs - 4 slices w/25 VMs

Run 2:

Same as Run 1, second sliver fails with the warning:

12:34:46 WARNING : Failed CreateSliver for slice ncsu25-2 at ncsu-eg.  
Error from Aggregate: code 2: Embedding workflow ERROR: 1:
Cannot create the network reservation, likely no available resource, 
the user specified label or hybrid OF is not valid in this site:
http://geni-orca.renci.org/owl/ncsuvmsite.rdf#ncsuvmsite/Domain.

Created first sliver manually with cisco-25vm.rspec:

$ omni createsliver 25vm -a ncsu-eg ./cisco-25vm.rspec -o
16:43:29 INFO    : Loading agg_nick_cache file '/home/lnevers/.gcf/agg_nick_cache'
16:43:29 INFO    : Loading config file '/home/lnevers/.gcf/omni_config'
16:43:29 INFO    : Using control framework portal
16:43:29 INFO    : Member Authority is https://ch.geni.net/MA (from config)
16:43:29 INFO    : Slice Authority is https://ch.geni.net/SA (from config)
16:43:29 INFO    : Substituting AM nickname ncsu-eg with URL https://ncsu-hn.exogeni.net:11443/orca/xmlrpc, URN urn:publicid:IDN+exogeni.net:ncsuvmsite+authority+am
16:43:30 INFO    : Slice urn:publicid:IDN+ch.geni.net:ln-test+slice+25vm expires on 2014-12-15 21:43:29 UTC
16:43:30 INFO    : Creating sliver(s) from rspec file ./cisco-25vm.rspec for slice urn:publicid:IDN+ch.geni.net:ln-test+slice+25vm
16:43:33 WARNING : Failed CreateSliver for slice 25vm at ncsu-eg.  Error from Aggregate: code 2: Invalid slice urn urn:publicid:IDN+ch.geni.net:ln-test+slice+25vm.
16:43:33 INFO    :  ------------------------------------------------------
16:43:33 INFO    :  Completed createsliver:

  Options as run:
		aggregate: ['ncsu-eg']
		framework: portal
		output: True
		project: ln-test

  Args: createsliver 25vm ./cisco-25vm.rspec

  Result Summary: Failed CreateSliver for slice 25vm at ncsu-eg.  Error from Aggregate: code 2: Invalid slice urn urn:publicid:IDN+ch.geni.net:ln-test+slice+25vm. 
16:43:33 INFO    :  ======================================================