Changes between Version 43 and Version 44 of GENIRacksHome/ExogeniRacks/AggregateSurvey

Timestamp:

04/25/12 16:10:23 (12 years ago)

Author:

lnevers@bbn.com

Comment:

--

GENIRacksHome/ExogeniRacks/AggregateSurvey

@@ -13 +13 @@
 == AM API Acceptance Tests ==
 
-Using the RSpec from the previous survey was not able to run the test with the same options as on 04/25/2012.  The AM API acceptance tests default to RSpec V3 while the RSpec are V2, this was not a problem last time, but now seems to cause all 13 tests to fail, see [xxx] for details. So  Re-run acceptance test with the new argument "--ProtoGENIv2" for the V2 RSpecs:
-{{{
-
-}}}
-
-
-
-}}}
-
-The acceptance test log is attached as [http://groups.geni.net/geni/attachment/wiki/GENIRacksHome/ExogeniRacks/AggregateSurvey/exogeni-log-20120425.txt exogeni-log-20120425.txt].
+Using the RSpec from the previous survey was not able to run the test with the same options as on 04/25/2012.  The AM API acceptance test defaults to RSpec V3 while the RSpec are V2, this was not reported as a problem last time, but now seems to cause all 13 tests to fail. If interested in this mismatched scenario, see the [http://groups.geni.net/geni/attachment/wiki/GENIRacksHome/ExogeniRacks/AggregateSurvey/failed-v3-support.txt command output] and the [http://groups.geni.net/geni/attachment/wiki/GENIRacksHome/ExogeniRacks/AggregateSurvey/exogeni-log-20120425.txt log] for details.
+
+Re-run acceptance test with the new argument "--ProtoGENIv2" for the V2 RSpecs:
+{{{
+$ ./am_api_accept.py -a am-undertest -V 2 --debug --ProtoGENIv2
+F.F....E..EE.
+======================================================================
+ERROR: test_ListResources: Passes if 'ListResources' returns an advertisement RSpec.
+----------------------------------------------------------------------
+Traceback (most recent call last):
+  File "./am_api_accept.py", line 328, in test_ListResources
+    self.subtest_ListResources()
+  File "./am_api_accept.py", line 607, in subtest_ListResources
+    self.assertRspecType( rspec, 'advertisement', typeOnly=typeOnly)
+  File "/home/lnevers/gcf-1.6.1/src/omni_unittest.py", line 161, in assertRspecType
+    if not rspec_util.is_rspec_of_type( rspec, type=type, version=version, typeOnly=typeOnly ):
+  File "/home/lnevers/gcf-1.6.1/src/geni/util/rspec_util.py", line 110, in is_rspec_of_type
+    if actual_type.lower() != type.lower():
+AttributeError: 'NoneType' object has no attribute 'lower'
+
+======================================================================
+ERROR: test_ListResources_geni_available: Passes if 'ListResources' returns an advertisement RSpec.
+----------------------------------------------------------------------
+Traceback (most recent call last):
+  File "./am_api_accept.py", line 342, in test_ListResources_geni_available
+    self.subtest_ListResources()
+  File "./am_api_accept.py", line 607, in subtest_ListResources
+    self.assertRspecType( rspec, 'advertisement', typeOnly=typeOnly)
+  File "/home/lnevers/gcf-1.6.1/src/omni_unittest.py", line 161, in assertRspecType
+    if not rspec_util.is_rspec_of_type( rspec, type=type, version=version, typeOnly=typeOnly ):
+  File "/home/lnevers/gcf-1.6.1/src/geni/util/rspec_util.py", line 110, in is_rspec_of_type
+    if actual_type.lower() != type.lower():
+AttributeError: 'NoneType' object has no attribute 'lower'
+
+======================================================================
+ERROR: test_ListResources_geni_compressed: Passes if 'ListResources' returns an advertisement RSpec.
+----------------------------------------------------------------------
+Traceback (most recent call last):
+  File "./am_api_accept.py", line 335, in test_ListResources_geni_compressed
+    self.subtest_ListResources()
+  File "./am_api_accept.py", line 607, in subtest_ListResources
+    self.assertRspecType( rspec, 'advertisement', typeOnly=typeOnly)
+  File "/home/lnevers/gcf-1.6.1/src/omni_unittest.py", line 161, in assertRspecType
+    if not rspec_util.is_rspec_of_type( rspec, type=type, version=version, typeOnly=typeOnly ):
+  File "/home/lnevers/gcf-1.6.1/src/geni/util/rspec_util.py", line 110, in is_rspec_of_type
+    if actual_type.lower() != type.lower():
+AttributeError: 'NoneType' object has no attribute 'lower'
+
+======================================================================
+FAIL: test_CreateSliver: Passes if the sliver creation workflow succeeds.  Use --rspec-file to replace the default request RSpec.
+----------------------------------------------------------------------
+Traceback (most recent call last):
+  File "./am_api_accept.py", line 625, in test_CreateSliver
+    self.subtest_CreateSliverWorkflow()
+  File "./am_api_accept.py", line 659, in subtest_CreateSliverWorkflow
+    self.assertRspecType( request, 'request')
+  File "/home/lnevers/gcf-1.6.1/src/omni_unittest.py", line 165, in assertRspecType
+    raise WrongRspecType, msg
+WrongRspecType: RSpec expected to have type 'request' but schema was not correct.
+
+======================================================================
+FAIL: test_CreateSliverWorkflow_multiSlice: Do CreateSliver workflow with multiple slices and ensure can not do ListResources on slices with the wrong credential.
+----------------------------------------------------------------------
+Traceback (most recent call last):
+  File "./am_api_accept.py", line 935, in test_CreateSliverWorkflow_multiSlice
+    self.assertRspecType( "".join(request[i]), 'request')
+  File "/home/lnevers/gcf-1.6.1/src/omni_unittest.py", line 165, in assertRspecType
+    raise WrongRspecType, msg
+WrongRspecType: RSpec expected to have type 'request' but schema was not correct.
+
+----------------------------------------------------------------------
+Ran 13 tests in 319.353s
+
+FAILED (failures=2, errors=3)
+
+}}}
+
+The acceptance test log for the 2 failures and 3 errors is attached as [xxxx].
 
 == Experiments with Omni Commands ==