| 9 | |
| 10 | |
| 11 | = Status 04/25/2012 = |
| 12 | == GPO Dev Team Analysis == |
| 13 | == AM API Acceptance Tests == |
| 14 | |
| 15 | {{{ |
| 16 | lnevers@sendaria:~/gcf-1.6.1/acceptance_tests/AM_API$ ./am_api_accept.py -a am-undertest -V 2 --debug |
| 17 | FFFFFFFFFFFFF |
| 18 | ====================================================================== |
| 19 | FAIL: test_CreateSliver: Passes if the sliver creation workflow succeeds. Use --rspec-file to replace the default request RSpec. |
| 20 | ---------------------------------------------------------------------- |
| 21 | Traceback (most recent call last): |
| 22 | File "./am_api_accept.py", line 625, in test_CreateSliver |
| 23 | self.subtest_CreateSliverWorkflow() |
| 24 | File "./am_api_accept.py", line 652, in subtest_CreateSliverWorkflow |
| 25 | manifest = self.subtest_CreateSliver( slicename ) |
| 26 | File "./am_api_accept.py", line 1098, in subtest_CreateSliver |
| 27 | self.assertTrue( self.checkRequestRSpecVersion() ) |
| 28 | File "./am_api_accept.py", line 126, in checkRequestRSpecVersion |
| 29 | return self.checkRSpecVersion(type='request') |
| 30 | File "./am_api_accept.py", line 175, in checkRSpecVersion |
| 31 | "Agg doesn't support requested version: %s %s" % (rtype, rver)) |
| 32 | AssertionError: Agg doesn't support requested version: GENI 3 |
| 33 | |
| 34 | ====================================================================== |
| 35 | FAIL: test_CreateSliverWorkflow_fail_notexist: Passes if the sliver creation workflow fails when the sliver has never existed. |
| 36 | ---------------------------------------------------------------------- |
| 37 | Traceback (most recent call last): |
| 38 | File "./am_api_accept.py", line 835, in test_CreateSliverWorkflow_fail_notexist |
| 39 | self.subtest_CreateSliverWorkflow_failure( slicename ) |
| 40 | File "./am_api_accept.py", line 844, in subtest_CreateSliverWorkflow_failure |
| 41 | self.assertRaises(NotDictAssertionError, self.subtest_ListResources, slicename ) |
| 42 | AssertionError: Agg doesn't support requested version: GENI 3 |
| 43 | |
| 44 | ====================================================================== |
| 45 | FAIL: test_CreateSliverWorkflow_multiSlice: Do CreateSliver workflow with multiple slices and ensure can not do ListResources on slices with the wrong credential. |
| 46 | ---------------------------------------------------------------------- |
| 47 | Traceback (most recent call last): |
| 48 | File "./am_api_accept.py", line 931, in test_CreateSliverWorkflow_multiSlice |
| 49 | manifest[i] = "".join(self.subtest_CreateSliver( slicenames[i] )) |
| 50 | File "./am_api_accept.py", line 1098, in subtest_CreateSliver |
| 51 | self.assertTrue( self.checkRequestRSpecVersion() ) |
| 52 | File "./am_api_accept.py", line 126, in checkRequestRSpecVersion |
| 53 | return self.checkRSpecVersion(type='request') |
| 54 | File "./am_api_accept.py", line 175, in checkRSpecVersion |
| 55 | "Agg doesn't support requested version: %s %s" % (rtype, rver)) |
| 56 | AssertionError: Agg doesn't support requested version: GENI 3 |
| 57 | |
| 58 | ====================================================================== |
| 59 | FAIL: test_CreateSliver_badrspec_emptyfile: Passes if the sliver creation workflow fails when the request RSpec is an empty file. |
| 60 | ---------------------------------------------------------------------- |
| 61 | Traceback (most recent call last): |
| 62 | File "./am_api_accept.py", line 1214, in test_CreateSliver_badrspec_emptyfile |
| 63 | self.subtest_MinCreateSliverWorkflow, slice_name ) |
| 64 | AssertionError: Agg doesn't support requested version: GENI 3 |
| 65 | |
| 66 | ====================================================================== |
| 67 | FAIL: test_CreateSliver_badrspec_malformed: Passes if the sliver creation workflow fails when the request RSpec is not well-formed XML. |
| 68 | ---------------------------------------------------------------------- |
| 69 | Traceback (most recent call last): |
| 70 | File "./am_api_accept.py", line 1242, in test_CreateSliver_badrspec_malformed |
| 71 | self.subtest_MinCreateSliverWorkflow, slice_name ) |
| 72 | AssertionError: Agg doesn't support requested version: GENI 3 |
| 73 | |
| 74 | ====================================================================== |
| 75 | FAIL: test_CreateSliver_badrspec_manifest: Passes if the sliver creation workflow fails when the request RSpec is a manifest RSpec. --bad-rspec-file allows you to replace the RSpec with an alternative. |
| 76 | ---------------------------------------------------------------------- |
| 77 | Traceback (most recent call last): |
| 78 | File "./am_api_accept.py", line 1258, in test_CreateSliver_badrspec_manifest |
| 79 | self.subtest_MinCreateSliverWorkflow, slice_name) |
| 80 | AssertionError: Agg doesn't support requested version: GENI 3 |
| 81 | |
| 82 | ====================================================================== |
| 83 | FAIL: test_GetVersion: Passes if a 'GetVersion' returns an XMLRPC struct containing 'geni_api' and other parameters defined in Change Set A. |
| 84 | ---------------------------------------------------------------------- |
| 85 | Traceback (most recent call last): |
| 86 | File "./am_api_accept.py", line 280, in test_GetVersion |
| 87 | % (agg, exp_type, exp_num) ) |
| 88 | AssertionError: Return from 'GetVersion' at https://bbn-hn.exogeni.net:11443/orca/xmlrpc expected to have entry 'geni_request_rspec_versions' of type='GENI' and value='3' but did not. |
| 89 | |
| 90 | ====================================================================== |
| 91 | FAIL: test_ListResources: Passes if 'ListResources' returns an advertisement RSpec. |
| 92 | ---------------------------------------------------------------------- |
| 93 | Traceback (most recent call last): |
| 94 | File "./am_api_accept.py", line 328, in test_ListResources |
| 95 | self.subtest_ListResources() |
| 96 | File "./am_api_accept.py", line 502, in subtest_ListResources |
| 97 | self.assertTrue( self.checkAdRSpecVersion() ) |
| 98 | File "./am_api_accept.py", line 124, in checkAdRSpecVersion |
| 99 | return self.checkRSpecVersion(type='ad') |
| 100 | File "./am_api_accept.py", line 175, in checkRSpecVersion |
| 101 | "Agg doesn't support requested version: %s %s" % (rtype, rver)) |
| 102 | AssertionError: Agg doesn't support requested version: GENI 3 |
| 103 | |
| 104 | ====================================================================== |
| 105 | FAIL: test_ListResources_badCredential_alteredObject: Run ListResources with a User Credential that has been altered (so the signature doesn't match). |
| 106 | ---------------------------------------------------------------------- |
| 107 | Traceback (most recent call last): |
| 108 | File "./am_api_accept.py", line 351, in test_ListResources_badCredential_alteredObject |
| 109 | self.subtest_ListResources_badCredential(self.alterSignedObject) |
| 110 | File "./am_api_accept.py", line 395, in subtest_ListResources_badCredential |
| 111 | self.assertRaises(NotDictAssertionError, self.subtest_ListResources, usercred=broken_usercred) |
| 112 | AssertionError: Agg doesn't support requested version: GENI 3 |
| 113 | |
| 114 | ====================================================================== |
| 115 | FAIL: test_ListResources_badCredential_malformedXML: Run ListResources with a User Credential that is missing it's first character (so that it is invalid XML). |
| 116 | ---------------------------------------------------------------------- |
| 117 | Traceback (most recent call last): |
| 118 | File "./am_api_accept.py", line 347, in test_ListResources_badCredential_malformedXML |
| 119 | self.subtest_ListResources_badCredential(self.removeFirstChar) |
| 120 | File "./am_api_accept.py", line 395, in subtest_ListResources_badCredential |
| 121 | self.assertRaises(NotDictAssertionError, self.subtest_ListResources, usercred=broken_usercred) |
| 122 | AssertionError: Agg doesn't support requested version: GENI 3 |
| 123 | |
| 124 | ====================================================================== |
| 125 | FAIL: test_ListResources_geni_available: Passes if 'ListResources' returns an advertisement RSpec. |
| 126 | ---------------------------------------------------------------------- |
| 127 | Traceback (most recent call last): |
| 128 | File "./am_api_accept.py", line 342, in test_ListResources_geni_available |
| 129 | self.subtest_ListResources() |
| 130 | File "./am_api_accept.py", line 502, in subtest_ListResources |
| 131 | self.assertTrue( self.checkAdRSpecVersion() ) |
| 132 | File "./am_api_accept.py", line 124, in checkAdRSpecVersion |
| 133 | return self.checkRSpecVersion(type='ad') |
| 134 | File "./am_api_accept.py", line 175, in checkRSpecVersion |
| 135 | "Agg doesn't support requested version: %s %s" % (rtype, rver)) |
| 136 | AssertionError: Agg doesn't support requested version: GENI 3 |
| 137 | |
| 138 | ====================================================================== |
| 139 | FAIL: test_ListResources_geni_compressed: Passes if 'ListResources' returns an advertisement RSpec. |
| 140 | ---------------------------------------------------------------------- |
| 141 | Traceback (most recent call last): |
| 142 | File "./am_api_accept.py", line 335, in test_ListResources_geni_compressed |
| 143 | self.subtest_ListResources() |
| 144 | File "./am_api_accept.py", line 502, in subtest_ListResources |
| 145 | self.assertTrue( self.checkAdRSpecVersion() ) |
| 146 | File "./am_api_accept.py", line 124, in checkAdRSpecVersion |
| 147 | return self.checkRSpecVersion(type='ad') |
| 148 | File "./am_api_accept.py", line 175, in checkRSpecVersion |
| 149 | "Agg doesn't support requested version: %s %s" % (rtype, rver)) |
| 150 | AssertionError: Agg doesn't support requested version: GENI 3 |
| 151 | |
| 152 | ====================================================================== |
| 153 | FAIL: test_ListResources_untrustedCredential: Passes if 'ListResources' FAILS to return an advertisement RSpec when using a credential from an untrusted Clearinghouse. |
| 154 | ---------------------------------------------------------------------- |
| 155 | Traceback (most recent call last): |
| 156 | File "./am_api_accept.py", line 496, in test_ListResources_untrustedCredential |
| 157 | self.assertRaises(NotDictAssertionError, self.subtest_ListResources, usercredfile=self.options_copy.untrusted_usercredfile) |
| 158 | AssertionError: Agg doesn't support requested version: GENI 3 |
| 159 | |
| 160 | ---------------------------------------------------------------------- |
| 161 | Ran 13 tests in 176.410s |
| 162 | |
| 163 | FAILED (failures=13) |
| 164 | }}} |
| 165 | |
| 166 | The acceptance test log is attached as xxxxx. |
| 167 | == Experiments with Omni Commands == |
| 168 | |
| 169 | Ran several experiments using various combinations of aggregates and hosts, only one very minor issue was found relating to requesting resources at the wrong component manager, see ticket [http://groups.geni.net/exogeni/ticket/2 ticket 2] for details. Following are the Experiements that were tested: |
| 170 | |
| 171 | 1. Set up a 2 nodes (1@BBN, 1@RENCI) experiment using the ExoSM (!https://geni.renci.org:11443/orca/xmlrpc) only. Same RSpec as previous survey (04/11/2012). This experiment worked as expected. Two nodes were allocated and the requested addresses were configured on the hosts with the requested link. Verified connectivity between the two hosts by running ping concurrently on each host in each direction for 10 minutes. |
| 172 | |
| 173 | 2. Set up a 2 nodes (1@BBN, 1@RENCI) experiment using the BBN SM (!https://bbn-hn.exogeni.gpolab.bbn.com:11443/orca/xmlrpc) for the local resources and the ExoSM (!https://geni.renci.org:11443/orca/xmlrpc) at RENCI. Requested addresses for nodes, but no link. Worked as expected. |
| 174 | |
| 175 | 3. Set up a 2 nodes (1@BBN, 1@RENCI) experiment using RENCI ExoSM (!https://geni.renci.org:11443/orca/xmlrpc). Requested addresses for nodes, but no link. Worked as expected. |
| 176 | |
| 177 | 4. Created a 2 node (2@BBN) experiment using BBN SM (!https://bbn-hn.exogeni.gpolab.bbn.com:11443/orca/xmlrpc). See RSpec [here]. This experiment worked as expected. Two nodes were allocated and the requested addresses were configured on the hosts with the requested link. Verified connectivity. |
| 178 | |
| 179 | 5. Created a 2 node (2@RENCI) experiment using RENCI SM (!https://bbn-hn.exogeni.gpolab.bbn.com:11443/orca/xmlrpc). See RSpec [here]. This experiment worked as expected. Two nodes were allocated and the requested addresses were configured on the hosts with the requested link. Verified connectivity. |
| 180 | |
| 181 | |