CG-EXP-6: Limits Tests

This test allocated resources in both NCSU2 and NCSU Cisco racks. Note the following Omni nick names are used:

ncsu2-eg=urn:publicid:IDN+exogeni.net:ncsu2vmsite+authority+am,https://ncsu2-hn.exogeni.net:11443/orca/xmlrpc
ncsu-eg=urn:publicid:IDN+exogeni.net:ncsuvmsite+authority+am,https://ncsu-hn.exogeni.net:11443/orca/xmlrpc

Test Status

This section captures the status for each step in the acceptance test plan.

Test	State	Tickets/Comments
NCSU2 Results:
100 VM - 50 slices w/2 VMs	Color(yellow,Complete)?	Only 39 slivers were created; able to exchange traffic between the 78 VMs allocated.
100 VMs - 10 slices w/10 VMs
100 VMs - 4 slices w/25 VMs	Color(red,Fail)?	Error from Aggregate: code 2: Invalid slice urn reported at NCSU2, but same slice and unbound rspec works at GPO EG
NCSU Results:
100 VM - 50 slices w/2 VMs	Color(yellow,Complete)?	Only 49 slivers were created; able to exchange traffic between the 98 VMs allocated.
100 VMs - 10 slices w/10 VMs	Color(green,Pass)?	All 10 slivers created; able to exchange traffic between the 100 VMs.
100 VMs - 4 slices w/25 VMs	Color(red,Fail)?	Error from Aggregate: code 2: Invalid slice urn reported at NCSU, but same slice and unbound rspec works at GPO EG

State Legend	Description
Color(green,Pass)?	Test completed and met all criteria
Color(#98FB98,Pass: most criteria)?	Test completed and met most criteria. Exceptions documented
Color(red,Fail)?	Test completed and failed to meet criteria.
Color(yellow,Complete)?	Test completed but will require re-execution due to expected changes
Color(orange,Blocked)?	Blocked by ticketed issue(s).
Color(#63B8FF,In Progress)?	Currently under test.

NCSU2 Limits Tests

100 VM - 50 slices w/2 VMs

The following is the approach taken to create the 50 slices:

 for i in {1..50}
 do
 omni createslice ncsu2-$i
 omni createsliver -a ncsu2-eg ncsu-$i ./cisco-2vm.rspec
 sleep 60
 done

See attached 100vm-50slices-ncsu2-log.txt for details. The slices 40-50 failed as follows:

13:48:53 WARNING : Failed CreateSliver for slice ncsu-40 at ncsu2-eg.  
Error from Aggregate: code 2: Embedding workflow ERROR: 1: Cannot create 
the network reservation, likely no available resource, the user specified 
label or hybrid OF is not valid in this site:
http://geni-orca.renci.org/owl/ncsu2vmsite.rdf#ncsu2vmsite/Domain.

For each of the 39 successful slivers slivers verified that geni_status "ready" existed, and then executed a ping between the two nodes in each slice.

100 VMs - 10 slices w/10 VMs

The following is the approach taken to create the 10 slices:

for i in {1..10}
  do 
  omni createslice ncsu-$i 
  omni createsliver -a ncsu2-eg ncsu-$i ./cisco-10vm-1lan.rspec; done
  done

100 VMs - 4 slices w/25 VMs

Created first sliver manually:

$ omni createsliver 25vm -a ncsu2-eg ./cisco-25vm.rspec -o
16:48:50 INFO    : Loading agg_nick_cache file '/home/lnevers/.gcf/agg_nick_cache'
16:48:50 INFO    : Loading config file '/home/lnevers/.gcf/omni_config'
16:48:50 INFO    : Using control framework portal
16:48:50 INFO    : Member Authority is https://ch.geni.net/MA (from config)
16:48:50 INFO    : Slice Authority is https://ch.geni.net/SA (from config)
16:48:50 INFO    : Substituting AM nickname ncsu2-eg with URL https://ncsu2-hn.exogeni.net:11443/orca/xmlrpc, URN urn:publicid:IDN+exogeni.net:ncsu2vmsite+authority+am
16:48:50 INFO    : Slice urn:publicid:IDN+ch.geni.net:ln-test+slice+25vm expires on 2014-12-15 21:43:29 UTC
16:48:50 INFO    : Creating sliver(s) from rspec file ./cisco-25vm.rspec for slice urn:publicid:IDN+ch.geni.net:ln-test+slice+25vm
16:48:55 WARNING : Failed CreateSliver for slice 25vm at ncsu2-eg.  Error from Aggregate: code 2: Invalid slice urn urn:publicid:IDN+ch.geni.net:ln-test+slice+25vm.
16:48:55 INFO    :  ------------------------------------------------------
16:48:55 INFO    :  Completed createsliver:

  Options as run:
		aggregate: ['ncsu2-eg']
		framework: portal
		output: True
		project: ln-test

  Args: createsliver 25vm ./cisco-25vm.rspec

  Result Summary: Failed CreateSliver for slice 25vm at ncsu2-eg.  Error from Aggregate: code 2: Invalid slice urn urn:publicid:IDN+ch.geni.net:ln-test+slice+25vm. 
16:48:55 INFO    :  ======================================================

NCSU Limits Tests

100 VM - 50 slices w/2 VMs

The following is the approach taken to create the 50 slices:

 for i in {1..50}
 do
 omni createslice ncsu-$i
 omni createsliver -a ncsu-eg ncsu-$i ./cisco-2vm.rspec
 sleep 60
 done

See attached 100vm-50slices-ncsu-log.txt for details. The 50th slice failed with:

14:22:38 WARNING : Failed CreateSliver for slice ncsu-50 at ncsu-eg.  Error from Aggregate: code 2: Embedding workflow ERROR: 1:Cannot create the network reservation, likely no available resource, the user specified label or hybrid OF is not valid in this site:http://geni-orca.renci.org/owl/ncsuvmsite.rdf#ncsuvmsite/Domain.

For each of the 49 successful slivers verified that geni_status "ready" existed, and then executed a ping between the two nodes in each slice.

100 VMs - 10 slices w/10 VMs

The following is the approach taken to create the 10 slices:

for i in {1..10}
  do 
  omni createslice ncsu-$i 
  omni createsliver -a ncsu-eg ncsu-$i ./cisco-10vm-1lan.rspec; done
  done

100 VMs - 4 slices w/25 VMs

Created first sliver manually:

$ omni createsliver 25vm -a ncsu-eg ./cisco-25vm.rspec -o
16:43:29 INFO    : Loading agg_nick_cache file '/home/lnevers/.gcf/agg_nick_cache'
16:43:29 INFO    : Loading config file '/home/lnevers/.gcf/omni_config'
16:43:29 INFO    : Using control framework portal
16:43:29 INFO    : Member Authority is https://ch.geni.net/MA (from config)
16:43:29 INFO    : Slice Authority is https://ch.geni.net/SA (from config)
16:43:29 INFO    : Substituting AM nickname ncsu-eg with URL https://ncsu-hn.exogeni.net:11443/orca/xmlrpc, URN urn:publicid:IDN+exogeni.net:ncsuvmsite+authority+am
16:43:30 INFO    : Slice urn:publicid:IDN+ch.geni.net:ln-test+slice+25vm expires on 2014-12-15 21:43:29 UTC
16:43:30 INFO    : Creating sliver(s) from rspec file ./cisco-25vm.rspec for slice urn:publicid:IDN+ch.geni.net:ln-test+slice+25vm
16:43:33 WARNING : Failed CreateSliver for slice 25vm at ncsu-eg.  Error from Aggregate: code 2: Invalid slice urn urn:publicid:IDN+ch.geni.net:ln-test+slice+25vm.
16:43:33 INFO    :  ------------------------------------------------------
16:43:33 INFO    :  Completed createsliver:

  Options as run:
		aggregate: ['ncsu-eg']
		framework: portal
		output: True
		project: ln-test

  Args: createsliver 25vm ./cisco-25vm.rspec

  Result Summary: Failed CreateSliver for slice 25vm at ncsu-eg.  Error from Aggregate: code 2: Invalid slice urn urn:publicid:IDN+ch.geni.net:ln-test+slice+25vm. 
16:43:33 INFO    :  ======================================================