Changes between Version 42 and Version 43 of GENIRacksHome/ExogeniRacks/AggregateSurvey


Ignore:
Timestamp:
04/25/12 16:05:25 (12 years ago)
Author:
lnevers@bbn.com
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • GENIRacksHome/ExogeniRacks/AggregateSurvey

    v42 v43  
    1313== AM API Acceptance Tests ==
    1414
    15 {{{
    16 lnevers@sendaria:~/gcf-1.6.1/acceptance_tests/AM_API$ ./am_api_accept.py -a am-undertest -V 2 --debug
    17 FFFFFFFFFFFFF
    18 ======================================================================
    19 FAIL: test_CreateSliver: Passes if the sliver creation workflow succeeds.  Use --rspec-file to replace the default request RSpec.
    20 ----------------------------------------------------------------------
    21 Traceback (most recent call last):
    22   File "./am_api_accept.py", line 625, in test_CreateSliver
    23     self.subtest_CreateSliverWorkflow()
    24   File "./am_api_accept.py", line 652, in subtest_CreateSliverWorkflow
    25     manifest = self.subtest_CreateSliver( slicename )
    26   File "./am_api_accept.py", line 1098, in subtest_CreateSliver
    27     self.assertTrue( self.checkRequestRSpecVersion() )
    28   File "./am_api_accept.py", line 126, in checkRequestRSpecVersion
    29     return self.checkRSpecVersion(type='request')
    30   File "./am_api_accept.py", line 175, in checkRSpecVersion
    31     "Agg doesn't support requested version: %s %s" % (rtype, rver))
    32 AssertionError: Agg doesn't support requested version: GENI 3
    33 
    34 ======================================================================
    35 FAIL: test_CreateSliverWorkflow_fail_notexist:  Passes if the sliver creation workflow fails when the sliver has never existed.
    36 ----------------------------------------------------------------------
    37 Traceback (most recent call last):
    38   File "./am_api_accept.py", line 835, in test_CreateSliverWorkflow_fail_notexist
    39     self.subtest_CreateSliverWorkflow_failure( slicename )
    40   File "./am_api_accept.py", line 844, in subtest_CreateSliverWorkflow_failure
    41     self.assertRaises(NotDictAssertionError, self.subtest_ListResources, slicename )
    42 AssertionError: Agg doesn't support requested version: GENI 3
    43 
    44 ======================================================================
    45 FAIL: test_CreateSliverWorkflow_multiSlice: Do CreateSliver workflow with multiple slices and ensure can not do ListResources on slices with the wrong credential.
    46 ----------------------------------------------------------------------
    47 Traceback (most recent call last):
    48   File "./am_api_accept.py", line 931, in test_CreateSliverWorkflow_multiSlice
    49     manifest[i] = "".join(self.subtest_CreateSliver( slicenames[i] ))
    50   File "./am_api_accept.py", line 1098, in subtest_CreateSliver
    51     self.assertTrue( self.checkRequestRSpecVersion() )
    52   File "./am_api_accept.py", line 126, in checkRequestRSpecVersion
    53     return self.checkRSpecVersion(type='request')
    54   File "./am_api_accept.py", line 175, in checkRSpecVersion
    55     "Agg doesn't support requested version: %s %s" % (rtype, rver))
    56 AssertionError: Agg doesn't support requested version: GENI 3
    57 
    58 ======================================================================
    59 FAIL: test_CreateSliver_badrspec_emptyfile: Passes if the sliver creation workflow fails when the request RSpec is an empty file.
    60 ----------------------------------------------------------------------
    61 Traceback (most recent call last):
    62   File "./am_api_accept.py", line 1214, in test_CreateSliver_badrspec_emptyfile
    63     self.subtest_MinCreateSliverWorkflow, slice_name )
    64 AssertionError: Agg doesn't support requested version: GENI 3
    65 
    66 ======================================================================
    67 FAIL: test_CreateSliver_badrspec_malformed: Passes if the sliver creation workflow fails when the request RSpec is not well-formed XML.
    68 ----------------------------------------------------------------------
    69 Traceback (most recent call last):
    70   File "./am_api_accept.py", line 1242, in test_CreateSliver_badrspec_malformed
    71     self.subtest_MinCreateSliverWorkflow, slice_name )
    72 AssertionError: Agg doesn't support requested version: GENI 3
    73 
    74 ======================================================================
    75 FAIL: test_CreateSliver_badrspec_manifest: Passes if the sliver creation workflow fails when the request RSpec is a manifest RSpec.  --bad-rspec-file allows you to replace the RSpec with an alternative.
    76 ----------------------------------------------------------------------
    77 Traceback (most recent call last):
    78   File "./am_api_accept.py", line 1258, in test_CreateSliver_badrspec_manifest
    79     self.subtest_MinCreateSliverWorkflow, slice_name)
    80 AssertionError: Agg doesn't support requested version: GENI 3
    81 
    82 ======================================================================
    83 FAIL: test_GetVersion: Passes if a 'GetVersion' returns an XMLRPC struct containing 'geni_api' and other parameters defined in Change Set A.
    84 ----------------------------------------------------------------------
    85 Traceback (most recent call last):
    86   File "./am_api_accept.py", line 280, in test_GetVersion
    87     % (agg, exp_type, exp_num) )
    88 AssertionError: Return from 'GetVersion' at https://bbn-hn.exogeni.net:11443/orca/xmlrpc expected to have entry 'geni_request_rspec_versions' of type='GENI' and value='3' but did not.
    89 
    90 ======================================================================
    91 FAIL: test_ListResources: Passes if 'ListResources' returns an advertisement RSpec.
    92 ----------------------------------------------------------------------
    93 Traceback (most recent call last):
    94   File "./am_api_accept.py", line 328, in test_ListResources
    95     self.subtest_ListResources()
    96   File "./am_api_accept.py", line 502, in subtest_ListResources
    97     self.assertTrue( self.checkAdRSpecVersion() )
    98   File "./am_api_accept.py", line 124, in checkAdRSpecVersion
    99     return self.checkRSpecVersion(type='ad')
    100   File "./am_api_accept.py", line 175, in checkRSpecVersion
    101     "Agg doesn't support requested version: %s %s" % (rtype, rver))
    102 AssertionError: Agg doesn't support requested version: GENI 3
    103 
    104 ======================================================================
    105 FAIL: test_ListResources_badCredential_alteredObject: Run ListResources with a User Credential that has been altered (so the signature doesn't match).
    106 ----------------------------------------------------------------------
    107 Traceback (most recent call last):
    108   File "./am_api_accept.py", line 351, in test_ListResources_badCredential_alteredObject
    109     self.subtest_ListResources_badCredential(self.alterSignedObject)
    110   File "./am_api_accept.py", line 395, in subtest_ListResources_badCredential
    111     self.assertRaises(NotDictAssertionError, self.subtest_ListResources, usercred=broken_usercred)
    112 AssertionError: Agg doesn't support requested version: GENI 3
    113 
    114 ======================================================================
    115 FAIL: test_ListResources_badCredential_malformedXML: Run ListResources with a User Credential that is missing it's first character (so that it is invalid XML).
    116 ----------------------------------------------------------------------
    117 Traceback (most recent call last):
    118   File "./am_api_accept.py", line 347, in test_ListResources_badCredential_malformedXML
    119     self.subtest_ListResources_badCredential(self.removeFirstChar)
    120   File "./am_api_accept.py", line 395, in subtest_ListResources_badCredential
    121     self.assertRaises(NotDictAssertionError, self.subtest_ListResources, usercred=broken_usercred)
    122 AssertionError: Agg doesn't support requested version: GENI 3
    123 
    124 ======================================================================
    125 FAIL: test_ListResources_geni_available: Passes if 'ListResources' returns an advertisement RSpec.
    126 ----------------------------------------------------------------------
    127 Traceback (most recent call last):
    128   File "./am_api_accept.py", line 342, in test_ListResources_geni_available
    129     self.subtest_ListResources()
    130   File "./am_api_accept.py", line 502, in subtest_ListResources
    131     self.assertTrue( self.checkAdRSpecVersion() )
    132   File "./am_api_accept.py", line 124, in checkAdRSpecVersion
    133     return self.checkRSpecVersion(type='ad')
    134   File "./am_api_accept.py", line 175, in checkRSpecVersion
    135     "Agg doesn't support requested version: %s %s" % (rtype, rver))
    136 AssertionError: Agg doesn't support requested version: GENI 3
    137 
    138 ======================================================================
    139 FAIL: test_ListResources_geni_compressed: Passes if 'ListResources' returns an advertisement RSpec.
    140 ----------------------------------------------------------------------
    141 Traceback (most recent call last):
    142   File "./am_api_accept.py", line 335, in test_ListResources_geni_compressed
    143     self.subtest_ListResources()
    144   File "./am_api_accept.py", line 502, in subtest_ListResources
    145     self.assertTrue( self.checkAdRSpecVersion() )
    146   File "./am_api_accept.py", line 124, in checkAdRSpecVersion
    147     return self.checkRSpecVersion(type='ad')
    148   File "./am_api_accept.py", line 175, in checkRSpecVersion
    149     "Agg doesn't support requested version: %s %s" % (rtype, rver))
    150 AssertionError: Agg doesn't support requested version: GENI 3
    151 
    152 ======================================================================
    153 FAIL: test_ListResources_untrustedCredential: Passes if 'ListResources' FAILS to return an advertisement RSpec when using a credential from an untrusted Clearinghouse.
    154 ----------------------------------------------------------------------
    155 Traceback (most recent call last):
    156   File "./am_api_accept.py", line 496, in test_ListResources_untrustedCredential
    157     self.assertRaises(NotDictAssertionError, self.subtest_ListResources, usercredfile=self.options_copy.untrusted_usercredfile)
    158 AssertionError: Agg doesn't support requested version: GENI 3
    159 
    160 ----------------------------------------------------------------------
    161 Ran 13 tests in 176.410s
    162 
    163 FAILED (failures=13)
     15Using the RSpec from the previous survey was not able to run the test with the same options as on 04/25/2012.  The AM API acceptance tests default to RSpec V3 while the RSpec are V2, this was not a problem last time, but now seems to cause all 13 tests to fail, see [xxx] for details. So  Re-run acceptance test with the new argument "--ProtoGENIv2" for the V2 RSpecs:
     16{{{
     17
     18}}}
     19
     20
     21
    16422}}}
    16523