Changes between Version 40 and Version 41 of GENIRacksHome/ExogeniRacks/AggregateSurvey


Ignore:
Timestamp:
04/25/12 15:52:12 (12 years ago)
Author:
lnevers@bbn.com
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • GENIRacksHome/ExogeniRacks/AggregateSurvey

    v40 v41  
    77 2. Results from the GENI AM API Acceptance Tests
    88 3. Experiment using Omni commands.
     9
     10
     11= Status 04/25/2012 =
     12== GPO Dev Team Analysis ==
     13== AM API Acceptance Tests ==
     14
     15{{{
     16lnevers@sendaria:~/gcf-1.6.1/acceptance_tests/AM_API$ ./am_api_accept.py -a am-undertest -V 2 --debug
     17FFFFFFFFFFFFF
     18======================================================================
     19FAIL: test_CreateSliver: Passes if the sliver creation workflow succeeds.  Use --rspec-file to replace the default request RSpec.
     20----------------------------------------------------------------------
     21Traceback (most recent call last):
     22  File "./am_api_accept.py", line 625, in test_CreateSliver
     23    self.subtest_CreateSliverWorkflow()
     24  File "./am_api_accept.py", line 652, in subtest_CreateSliverWorkflow
     25    manifest = self.subtest_CreateSliver( slicename )
     26  File "./am_api_accept.py", line 1098, in subtest_CreateSliver
     27    self.assertTrue( self.checkRequestRSpecVersion() )
     28  File "./am_api_accept.py", line 126, in checkRequestRSpecVersion
     29    return self.checkRSpecVersion(type='request')
     30  File "./am_api_accept.py", line 175, in checkRSpecVersion
     31    "Agg doesn't support requested version: %s %s" % (rtype, rver))
     32AssertionError: Agg doesn't support requested version: GENI 3
     33
     34======================================================================
     35FAIL: test_CreateSliverWorkflow_fail_notexist:  Passes if the sliver creation workflow fails when the sliver has never existed.
     36----------------------------------------------------------------------
     37Traceback (most recent call last):
     38  File "./am_api_accept.py", line 835, in test_CreateSliverWorkflow_fail_notexist
     39    self.subtest_CreateSliverWorkflow_failure( slicename )
     40  File "./am_api_accept.py", line 844, in subtest_CreateSliverWorkflow_failure
     41    self.assertRaises(NotDictAssertionError, self.subtest_ListResources, slicename )
     42AssertionError: Agg doesn't support requested version: GENI 3
     43
     44======================================================================
     45FAIL: test_CreateSliverWorkflow_multiSlice: Do CreateSliver workflow with multiple slices and ensure can not do ListResources on slices with the wrong credential.
     46----------------------------------------------------------------------
     47Traceback (most recent call last):
     48  File "./am_api_accept.py", line 931, in test_CreateSliverWorkflow_multiSlice
     49    manifest[i] = "".join(self.subtest_CreateSliver( slicenames[i] ))
     50  File "./am_api_accept.py", line 1098, in subtest_CreateSliver
     51    self.assertTrue( self.checkRequestRSpecVersion() )
     52  File "./am_api_accept.py", line 126, in checkRequestRSpecVersion
     53    return self.checkRSpecVersion(type='request')
     54  File "./am_api_accept.py", line 175, in checkRSpecVersion
     55    "Agg doesn't support requested version: %s %s" % (rtype, rver))
     56AssertionError: Agg doesn't support requested version: GENI 3
     57
     58======================================================================
     59FAIL: test_CreateSliver_badrspec_emptyfile: Passes if the sliver creation workflow fails when the request RSpec is an empty file.
     60----------------------------------------------------------------------
     61Traceback (most recent call last):
     62  File "./am_api_accept.py", line 1214, in test_CreateSliver_badrspec_emptyfile
     63    self.subtest_MinCreateSliverWorkflow, slice_name )
     64AssertionError: Agg doesn't support requested version: GENI 3
     65
     66======================================================================
     67FAIL: test_CreateSliver_badrspec_malformed: Passes if the sliver creation workflow fails when the request RSpec is not well-formed XML.
     68----------------------------------------------------------------------
     69Traceback (most recent call last):
     70  File "./am_api_accept.py", line 1242, in test_CreateSliver_badrspec_malformed
     71    self.subtest_MinCreateSliverWorkflow, slice_name )
     72AssertionError: Agg doesn't support requested version: GENI 3
     73
     74======================================================================
     75FAIL: test_CreateSliver_badrspec_manifest: Passes if the sliver creation workflow fails when the request RSpec is a manifest RSpec.  --bad-rspec-file allows you to replace the RSpec with an alternative.
     76----------------------------------------------------------------------
     77Traceback (most recent call last):
     78  File "./am_api_accept.py", line 1258, in test_CreateSliver_badrspec_manifest
     79    self.subtest_MinCreateSliverWorkflow, slice_name)
     80AssertionError: Agg doesn't support requested version: GENI 3
     81
     82======================================================================
     83FAIL: test_GetVersion: Passes if a 'GetVersion' returns an XMLRPC struct containing 'geni_api' and other parameters defined in Change Set A.
     84----------------------------------------------------------------------
     85Traceback (most recent call last):
     86  File "./am_api_accept.py", line 280, in test_GetVersion
     87    % (agg, exp_type, exp_num) )
     88AssertionError: Return from 'GetVersion' at https://bbn-hn.exogeni.net:11443/orca/xmlrpc expected to have entry 'geni_request_rspec_versions' of type='GENI' and value='3' but did not.
     89
     90======================================================================
     91FAIL: test_ListResources: Passes if 'ListResources' returns an advertisement RSpec.
     92----------------------------------------------------------------------
     93Traceback (most recent call last):
     94  File "./am_api_accept.py", line 328, in test_ListResources
     95    self.subtest_ListResources()
     96  File "./am_api_accept.py", line 502, in subtest_ListResources
     97    self.assertTrue( self.checkAdRSpecVersion() )
     98  File "./am_api_accept.py", line 124, in checkAdRSpecVersion
     99    return self.checkRSpecVersion(type='ad')
     100  File "./am_api_accept.py", line 175, in checkRSpecVersion
     101    "Agg doesn't support requested version: %s %s" % (rtype, rver))
     102AssertionError: Agg doesn't support requested version: GENI 3
     103
     104======================================================================
     105FAIL: test_ListResources_badCredential_alteredObject: Run ListResources with a User Credential that has been altered (so the signature doesn't match).
     106----------------------------------------------------------------------
     107Traceback (most recent call last):
     108  File "./am_api_accept.py", line 351, in test_ListResources_badCredential_alteredObject
     109    self.subtest_ListResources_badCredential(self.alterSignedObject)
     110  File "./am_api_accept.py", line 395, in subtest_ListResources_badCredential
     111    self.assertRaises(NotDictAssertionError, self.subtest_ListResources, usercred=broken_usercred)
     112AssertionError: Agg doesn't support requested version: GENI 3
     113
     114======================================================================
     115FAIL: test_ListResources_badCredential_malformedXML: Run ListResources with a User Credential that is missing it's first character (so that it is invalid XML).
     116----------------------------------------------------------------------
     117Traceback (most recent call last):
     118  File "./am_api_accept.py", line 347, in test_ListResources_badCredential_malformedXML
     119    self.subtest_ListResources_badCredential(self.removeFirstChar)
     120  File "./am_api_accept.py", line 395, in subtest_ListResources_badCredential
     121    self.assertRaises(NotDictAssertionError, self.subtest_ListResources, usercred=broken_usercred)
     122AssertionError: Agg doesn't support requested version: GENI 3
     123
     124======================================================================
     125FAIL: test_ListResources_geni_available: Passes if 'ListResources' returns an advertisement RSpec.
     126----------------------------------------------------------------------
     127Traceback (most recent call last):
     128  File "./am_api_accept.py", line 342, in test_ListResources_geni_available
     129    self.subtest_ListResources()
     130  File "./am_api_accept.py", line 502, in subtest_ListResources
     131    self.assertTrue( self.checkAdRSpecVersion() )
     132  File "./am_api_accept.py", line 124, in checkAdRSpecVersion
     133    return self.checkRSpecVersion(type='ad')
     134  File "./am_api_accept.py", line 175, in checkRSpecVersion
     135    "Agg doesn't support requested version: %s %s" % (rtype, rver))
     136AssertionError: Agg doesn't support requested version: GENI 3
     137
     138======================================================================
     139FAIL: test_ListResources_geni_compressed: Passes if 'ListResources' returns an advertisement RSpec.
     140----------------------------------------------------------------------
     141Traceback (most recent call last):
     142  File "./am_api_accept.py", line 335, in test_ListResources_geni_compressed
     143    self.subtest_ListResources()
     144  File "./am_api_accept.py", line 502, in subtest_ListResources
     145    self.assertTrue( self.checkAdRSpecVersion() )
     146  File "./am_api_accept.py", line 124, in checkAdRSpecVersion
     147    return self.checkRSpecVersion(type='ad')
     148  File "./am_api_accept.py", line 175, in checkRSpecVersion
     149    "Agg doesn't support requested version: %s %s" % (rtype, rver))
     150AssertionError: Agg doesn't support requested version: GENI 3
     151
     152======================================================================
     153FAIL: test_ListResources_untrustedCredential: Passes if 'ListResources' FAILS to return an advertisement RSpec when using a credential from an untrusted Clearinghouse.
     154----------------------------------------------------------------------
     155Traceback (most recent call last):
     156  File "./am_api_accept.py", line 496, in test_ListResources_untrustedCredential
     157    self.assertRaises(NotDictAssertionError, self.subtest_ListResources, usercredfile=self.options_copy.untrusted_usercredfile)
     158AssertionError: Agg doesn't support requested version: GENI 3
     159
     160----------------------------------------------------------------------
     161Ran 13 tests in 176.410s
     162
     163FAILED (failures=13)
     164}}}
     165
     166The acceptance test log is attached as xxxxx.
     167== Experiments with Omni Commands ==
     168
     169Ran several experiments using various combinations of aggregates and hosts, only one very minor issue was found relating to requesting resources at the wrong component manager, see ticket [http://groups.geni.net/exogeni/ticket/2 ticket 2] for details.  Following are the Experiements that were tested:
     170
     1711. Set up a 2 nodes (1@BBN, 1@RENCI) experiment using the ExoSM (!https://geni.renci.org:11443/orca/xmlrpc) only. Same RSpec as previous survey (04/11/2012).  This experiment worked as expected. Two nodes were allocated and the requested addresses were configured on the hosts with the requested link.  Verified connectivity between the two hosts by running ping concurrently on each host in each direction for 10 minutes.
     172
     1732. Set up a 2 nodes (1@BBN, 1@RENCI) experiment using the BBN SM (!https://bbn-hn.exogeni.gpolab.bbn.com:11443/orca/xmlrpc) for the local resources and the ExoSM (!https://geni.renci.org:11443/orca/xmlrpc) at RENCI. Requested addresses for nodes, but no link. Worked as expected.
     174
     1753. Set up a 2 nodes (1@BBN, 1@RENCI) experiment using RENCI ExoSM (!https://geni.renci.org:11443/orca/xmlrpc). Requested addresses for nodes, but no link. Worked as expected.
     176
     1774. Created a 2 node (2@BBN) experiment using BBN SM (!https://bbn-hn.exogeni.gpolab.bbn.com:11443/orca/xmlrpc). See RSpec [here]. This experiment worked as expected. Two nodes were allocated and the requested addresses were configured on the hosts with the requested link. Verified connectivity.
     178
     1795. Created a 2 node (2@RENCI) experiment using RENCI SM (!https://bbn-hn.exogeni.gpolab.bbn.com:11443/orca/xmlrpc). See RSpec [here].  This experiment worked as expected. Two nodes were allocated and the requested addresses were configured on the hosts with the requested link. Verified connectivity.
     180
     181
    9182
    10183