Version 9 (modified by 9 years ago) (diff) | ,
---|
CG-EXP-1: GENI AM API Compliance
GENI AM API v2 tests for NCSU2 and NCSU Cisco racks.
Test Status
This section captures the status for each step in the acceptance test plan.
Test | State | Tickets/Comments |
Omni Commands | unknown component id | |
NCSU Compliance | ||
NCSU2 Compliance |
State Legend | Description |
Color(green,Pass)? | Test completed and met all criteria |
Color(#98FB98,Pass: most criteria)? | Test completed and met most criteria. Exceptions documented |
Color(red,Fail)? | Test completed and failed to meet criteria. |
Color(yellow,Complete)? | Test completed but will require re-execution due to expected changes |
Color(orange,Blocked)? | Blocked by ticketed issue(s). |
Color(#63B8FF,In Progress)? | Currently under test. |
Test Details
Omni Commands
Collect getversion information to verify that NCSU is running the same Orca version as NCSU2.
$ omni getversion -a ncsu-eg -o ; omni getversion -a ncsu2-eg -o $ egrep orca_version getversion-exogeni-net-ncsu* getversion-exogeni-net-ncsu2vmsite.json: 'orca_version': 'ORCA Dungeness: v.4.0-SNAPSHOT.build-6427'} getversion-exogeni-net-ncsuvmsite.json: 'orca_version': 'ORCA Dungeness: v.4.0-SNAPSHOT.build-6427'}
Both racks are running the same version.
Verify compute resources available in NCSU2 rack:
$ omni listresources -a ncsu2-eg -o; egrep "node c" rspec-exogeni-net-ncsu2vmsite.xml <node component_id="urn:publicid:IDN+exogeni.net:ncsu2vmsite+node+orca-vm-cloud" component_manager_id="urn:publicid:IDN+exogeni.net:ncsu2vmsite+authority+am" component_name="orca-vm-cloud" exclusive="false"> <node component_id="urn:publicid:IDN+exogeni.net:ncsu2Net+node+orca-transit-net-vlan" component_manager_id="urn:publicid:IDN+exogeni.net:ncsu2Net+authority+am" component_name="orca-transit-net-vlan" exclusive="false">
Verify compute resources available in NCSU rack:
$ omni listresources -a ncsu-eg -o; egrep "node c" rspec-exogeni-net-ncsuvmsite.xml <node component_id="urn:publicid:IDN+exogeni.net:ncsuvmsite+node+unknown" component_manager_id="urn:publicid:IDN+exogeni.net:ncsuvmsite+authority+am" component_name="unknown" exclusive="false"> <node component_id="urn:publicid:IDN+exogeni.net:ncsuvmsite+node+orca-vm-cloud" component_manager_id="urn:publicid:IDN+exogeni.net:ncsuvmsite+authority+am" component_name="orca-vm-cloud" exclusive="false">
Note: What is "unknown" component_id for both NCSU and NCSU2?
CG-EXP-1a GENI AM API Compliance - NCSU2
This test verifies compliance for the NCSU2 Cisco rack.
NCSU2 Unbound Resources
The AM API Acceptance test results for NCSU2:
lnevers@sendaria:~/gcf-2.7/acceptance_tests/AM_API$ ./am_api_accept.py -a am-undertest --un-bound E.E.......... ====================================================================== ERROR: test_CreateSliver: Passes if the sliver creation workflow succeeds. ---------------------------------------------------------------------- Traceback (most recent call last): File "./am_api_accept.py", line 773, in test_CreateSliver self.subtest_CreateSliverWorkflow() File "./am_api_accept.py", line 803, in subtest_CreateSliverWorkflow numslivers, manifest, slivers = self.subtest_generic_CreateSliver( slicename, doProvision, doPOA, expectedExpiration=sliceExpiration ) File "./am_api_accept.py", line 1881, in subtest_generic_CreateSliver numslivers, manifest = self.subtest_CreateSliver( slicename ) File "./am_api_accept.py", line 1610, in subtest_CreateSliver text, manifest = self.call(omniargs, self.options_copy) File "/home/lnevers/gcf-2.7/src/omni_unittest.py", line 172, in call ret_val = omni.call( cmd, options=options, verbose=True ) File "/home/lnevers/gcf-2.7/src/gcf/oscript.py", line 719, in call return API_call( framework, config, args, opts, verbose=verbose ) File "/home/lnevers/gcf-2.7/src/gcf/oscript.py", line 793, in API_call result = handler._handle(args) File "/home/lnevers/gcf-2.7/src/gcf/omnilib/handler.py", line 90, in _handle (message, val) = getattr(self.amhandler,call)(args[1:]) File "/home/lnevers/gcf-2.7/src/gcf/omnilib/amhandler.py", line 1840, in createsliver (result, message) = self._retrieve_value(result, message, self.framework) File "/home/lnevers/gcf-2.7/src/gcf/omnilib/amhandler.py", line 5382, in _retrieve_value self._raise_omni_error(message, AMAPIError, result) File "/home/lnevers/gcf-2.7/src/gcf/omnilib/amhandler.py", line 5486, in _raise_omni_error raise err, (msg, triple) AMAPIError: AMAPIError: Error from Aggregate: code 2: Embedding workflow ERROR: 1:No available resources in domain: http://geni-orca.renci.org/owl/ncsuvmsite.rdf#ncsuvmsite/Domain/vlan:vlan; Requested: vlan:1. Please see https://geni-orca.renci.org/trac/wiki/orca-errors for possible solutions.. ====================================================================== ERROR: test_CreateSliverWorkflow_multiSlice: Do CreateSliver workflow with multiple slices ---------------------------------------------------------------------- Traceback (most recent call last): File "./am_api_accept.py", line 1141, in test_CreateSliverWorkflow_multiSlice createReturn = self.subtest_generic_CreateSliver( slicenames[i], expectedExpiration=sliceExpiration ) File "./am_api_accept.py", line 1881, in subtest_generic_CreateSliver numslivers, manifest = self.subtest_CreateSliver( slicename ) File "./am_api_accept.py", line 1610, in subtest_CreateSliver text, manifest = self.call(omniargs, self.options_copy) File "/home/lnevers/gcf-2.7/src/omni_unittest.py", line 172, in call ret_val = omni.call( cmd, options=options, verbose=True ) File "/home/lnevers/gcf-2.7/src/gcf/oscript.py", line 719, in call return API_call( framework, config, args, opts, verbose=verbose ) File "/home/lnevers/gcf-2.7/src/gcf/oscript.py", line 793, in API_call result = handler._handle(args) File "/home/lnevers/gcf-2.7/src/gcf/omnilib/handler.py", line 90, in _handle (message, val) = getattr(self.amhandler,call)(args[1:]) File "/home/lnevers/gcf-2.7/src/gcf/omnilib/amhandler.py", line 1840, in createsliver (result, message) = self._retrieve_value(result, message, self.framework) File "/home/lnevers/gcf-2.7/src/gcf/omnilib/amhandler.py", line 5382, in _retrieve_value self._raise_omni_error(message, AMAPIError, result) File "/home/lnevers/gcf-2.7/src/gcf/omnilib/amhandler.py", line 5486, in _raise_omni_error raise err, (msg, triple) AMAPIError: AMAPIError: Error from Aggregate: code 2: Embedding workflow ERROR: 1:No available resources in domain: http://geni-orca.renci.org/owl/ncsuvmsite.rdf#ncsuvmsite/Domain/vlan:vlan; Requested: vlan:1. Please see https://geni-orca.renci.org/trac/wiki/orca-errors for possible solutions.. ---------------------------------------------------------------------- Ran 13 tests in 210.520s FAILED (errors=2)
Note: no compliance problem, only a lack or VLAN resources is reported... investigating
NCSU2 Bound Resource
CG-EXP-1b GENI AM API Compliance - NCSU
This test verifies compliance for the NCSU Cisco rack.
NCSU Unbound Resources
The AM API Acceptance test results:
$ ./am_api_accept.py -a am-undertest --un-bound E.E.......... ====================================================================== ERROR: test_CreateSliver: Passes if the sliver creation workflow succeeds. ---------------------------------------------------------------------- Traceback (most recent call last): File "./am_api_accept.py", line 773, in test_CreateSliver self.subtest_CreateSliverWorkflow() File "./am_api_accept.py", line 929, in subtest_CreateSliverWorkflow self.subtest_generic_RenewSliver_many( slicename ) File "./am_api_accept.py", line 1933, in subtest_generic_RenewSliver_many self.subtest_RenewSliver_many( slicename ) File "./am_api_accept.py", line 1410, in subtest_RenewSliver_many self.subtest_RenewSliver( slicename, twodays ) File "./am_api_accept.py", line 1375, in subtest_RenewSliver text, (succList, failList) = self.call(omniargs, self.options_copy) File "/home/lnevers/gcf-2.7/src/omni_unittest.py", line 172, in call ret_val = omni.call( cmd, options=options, verbose=True ) File "/home/lnevers/gcf-2.7/src/gcf/oscript.py", line 719, in call return API_call( framework, config, args, opts, verbose=verbose ) File "/home/lnevers/gcf-2.7/src/gcf/oscript.py", line 793, in API_call result = handler._handle(args) File "/home/lnevers/gcf-2.7/src/gcf/omnilib/handler.py", line 90, in _handle (message, val) = getattr(self.amhandler,call)(args[1:]) File "/home/lnevers/gcf-2.7/src/gcf/omnilib/amhandler.py", line 2749, in renewsliver (res, message) = self._retrieve_value(res, message, self.framework) File "/home/lnevers/gcf-2.7/src/gcf/omnilib/amhandler.py", line 5382, in _retrieve_value self._raise_omni_error(message, AMAPIError, result) File "/home/lnevers/gcf-2.7/src/gcf/omnilib/amhandler.py", line 5486, in _raise_omni_error raise err, (msg, triple) AMAPIError: AMAPIError: Error from Aggregate: code 1: renewSlice(): renewal term shorter than original slice end is not valid.. ====================================================================== ERROR: test_CreateSliverWorkflow_multiSlice: Do CreateSliver workflow with multiple slices ---------------------------------------------------------------------- Traceback (most recent call last): File "./am_api_accept.py", line 1267, in test_CreateSliverWorkflow_multiSlice self.subtest_generic_RenewSliver_many( slicenames[i] ) File "./am_api_accept.py", line 1933, in subtest_generic_RenewSliver_many self.subtest_RenewSliver_many( slicename ) File "./am_api_accept.py", line 1410, in subtest_RenewSliver_many self.subtest_RenewSliver( slicename, twodays ) File "./am_api_accept.py", line 1375, in subtest_RenewSliver text, (succList, failList) = self.call(omniargs, self.options_copy) File "/home/lnevers/gcf-2.7/src/omni_unittest.py", line 172, in call ret_val = omni.call( cmd, options=options, verbose=True ) File "/home/lnevers/gcf-2.7/src/gcf/oscript.py", line 719, in call return API_call( framework, config, args, opts, verbose=verbose ) File "/home/lnevers/gcf-2.7/src/gcf/oscript.py", line 793, in API_call result = handler._handle(args) File "/home/lnevers/gcf-2.7/src/gcf/omnilib/handler.py", line 90, in _handle (message, val) = getattr(self.amhandler,call)(args[1:]) File "/home/lnevers/gcf-2.7/src/gcf/omnilib/amhandler.py", line 2749, in renewsliver (res, message) = self._retrieve_value(res, message, self.framework) File "/home/lnevers/gcf-2.7/src/gcf/omnilib/amhandler.py", line 5382, in _retrieve_value self._raise_omni_error(message, AMAPIError, result) File "/home/lnevers/gcf-2.7/src/gcf/omnilib/amhandler.py", line 5486, in _raise_omni_error raise err, (msg, triple) AMAPIError: AMAPIError: Error from Aggregate: code 1: renewSlice(): renewal term shorter than original slice end is not valid.. ---------------------------------------------------------------------- Ran 13 tests in 674.790s FAILED (errors=2)
Note: New issue... Investigating