Changes between Version 12 and Version 13 of GENIRacksHome/ExogeniRacks/AggregateSurvey

Timestamp:

04/11/12 13:43:26 (12 years ago)

Author:

lnevers@bbn.com

Comment:

--

GENIRacksHome/ExogeniRacks/AggregateSurvey

@@ -8 +8 @@
  * ORCA RENCI aggregate with GCF 1.5.2 as captured on 01/19/2012.
 
-This survey mostly focuses on Aggregate Manager features by using Omni to setup a simple experiment. The AM API Acceptance test is also run to check for AM API compliance.  
-A GPO Development team analysis is part of the 03/20/2012 survey.  Note that the output for the Omni commands is shown on the page unless too large to show, in this case
-output is attached to this page.
+Each survey has the following layout: [[BR]]
+ 1. GPO Development team analysis of survey results.
+ 2. Results from the GENI AM API Acceptance Tests 
+ 3. Omni commands survey.
+
+Note that the output for the Omni commands is shown on the page unless too large to show, in this case output is attached to this page.
 
 = Status 03/20/2012 =
 
-Attempt to access the ExoGENI AM at https://bbn-hn.exogeni.gpolab.bbn.com:11443/orca/xmlrpc resulted in connection refused.  Using ExoSM as suggested by Ilia.
+Attempt to access the ExoGENI AM at https://bbn-hn.exogeni.gpolab.bbn.com:11443/orca/xmlrpc resulted in connection refused.  Using ExoSM as suggested by Ilia.  
+
+
+
+== GPO Dev Team Analysis == 
+
+The GPO Software development team analyzed the results from this test run and came up with the following list of Known issues with ExoGENI's AM API implementation.
+
+Priorities (from Trac): blocker, critical, major, minor, trivial [[BR]]
+Status: where things stand - open, closed, etc. [[BR]]
+Categories: AM API, RSpec, Acceptance Test, Stitching, Question [[BR]]
+Issues are ordered by priority, and by relative importance within priority. 
+
+==== Critical Issues ====
+|| ID || Priority || Status || Category || Description ||
+|| 1 || critical ||  || AM API || !ListResources at ExoSM returns multiple advertisement RSpecs. This is neither valid XML nor valid RSpec. ||
+|| 2 || critical ||  || RSpec || ExoGENI advertises RSpec GENI v3 support in !GetVersion, but the RSpecs (ad & manifest) are ProtoGENI v2. Make the RSpecs use the GENI v3 schema. (As a fallback, change the !GetVersion return).||
+|| 3 || critical ||  || RSpec || missing schemaLocation declarations for all used schemas ||
+|| 4|| critical || || RSpec || All Ad & manifest RSpecs must pass rspeclint, but currently do not ||
+
+==== Major Issues ====
+|| ID || Priority || Status || Category || Description ||
+|| 5 || major  ||  || AM API || !GetVersion: The top-level (parallel to code and value) is missing a `geni_api` entry.  Without this entry AM API v1 clients can't discover why they can't talk to this aggregate. ||
+|| 6 || major ||  || AM API || !SliverStatus: Return at least a `geni_resources` entry that is empty, if not including all contained slivers. ||
+|| 7 || major ||  || Acceptance Test || There is no 'extensions' field listed in `geni_request_rspec_versions` and `geni_ad_rspec_version` in the return from !GetVersion. Add it, including all used extensions. ||
+|| 8 || major ||  || Acceptance Test || !ListResources does not handle the `geni_compressed` flag properly. The return value is always compressed, even if `geni_compressed` is set to False.||
+
+==== Minor Issues ====
+|| ID || Priority || Status || Category || Description ||
+|| 9 || minor || || RSpec || Does ExoGENI honor the sliver_type or ignore it? It seems to give a VM for a `sliver_type` of "raw_pc". ||
+|| 10 || minor ||  || AM API || !CreateSliver results in a !NullPointerException if a link references a non-existent node. {{{<link client_id="center"> <interface_ref client_id="geni1:0"/> <interface_ref client_id="geni2:0"/> </link>}}} when node {{{geni1}}} is not in the request. ||
+|| 11 || minor || || Stitching || Test stitching schema validity by using Omni's libstitch. Multiple undocumented conventions about IDs may need to be followed. ||
+|| 12 || minor || || RSpec || You list 1 node with a hardware_type 'vm-cloud'. What about at least listing multiple sliver_types for the different EC2 style VM types, with the appropriate type_slots value for each sliver type? ||
+|| 13 || minor || || RSpec || You list 1 node for each of 2 or 3 different hardware types, all for the same site. Is information duplicated? Could these reasonably be combined in any way? ||
+|| 14 || minor || || RSpec || The dataplane IP address is missing from the manifest RSpec ||
+|| 15 || minor ||  || RSpec || Add more info to the <interface> tag in manifest: PG includes the <ip> sub-element with IP, netmask, type ||
+|| 16 || minor || || RSpec || Change structure of component_manager_id. AM URNs should be of the form <prefix>+name+authority+am. So use prefix+<SM site name+domain name>+authority+am ||
+|| 17 || minor || || RSpec || Ad component_manager_id values are unlike those in sample request RSpec. Shouldn't this break something? Make these match. ||
+|| 18 || minor || || RSpec || client_id values are changed in the manifest from the request (add a UUID), making it hard for experimenters/tools to reconcile. Can these be kept the same? ||
+|| 19 || minor || || RSpec || Add more information to the RSpec if possible: `<component_manager>` sub-element on links, indicating the 2 AMs that control the endpoints of this link. ||
+|| 20 || minor || || RSpec || Add more information to the RSpec if possible: `<property>` sub-element on links specifying dest_id and source_id ||
+|| 21 || minor || || RSpec || Add more info / check form of interface `component_id`. Compare to PG form: prefix+site+interface+node/switch name:port #:name of remote, e.g. emulab.net+interface+procurve=pgeni-wash:10:ion ||
+|| 22 || minor || || RSpec || Simplify sliver ID. How about prefix+<site>+sliver+AM name + slice name+client_id? ||
+|| 23 || minor || || RSpec || Node component_id is the site name, making all reservations part of this same node. Maybe change exclusive to False? ||
+|| 24 || minor ||  || Question || Are the assigned `client_id` values from the RSpec available within the running Node/vm? ||
+|| 25 || minor ||  || Stitching RSpec || Stitching extension says scheduled=true. Probably should be false. ||
+|| 26 || minor ||  || Stitching RSpec || stitching extension has same component_id for both port and link. Seems wrong. Maybe OK? PG has the link ID being the ID of the interface of the corresponding node. So this part of the Orca ad seems like a mistake.||
+|| 27 || minor ||  || RSpec || The starlight Ad RSpec lists hardware_type name=orca-transit-net twice. Not a real problem, just not what he intended probably. ||
+
+
+
+
+== AM API Acceptance Tests ==
+
+This section captures the GENI AM API Acceptance Test results using the ORCA ExoSM and GPO ExoGENI rack compute resources.
+
+ * XML files used are attached: [http://groups.geni.net/geni/attachment/wiki/GENIRacksHome/ExogeniRacks/AggregateSurvey/request.xml request.xml], [http://groups.geni.net/geni/attachment/wiki/GENIRacksHome/ExogeniRacks/AggregateSurvey/request1.xml request1.xml], [http://groups.geni.net/geni/attachment/wiki/GENIRacksHome/ExogeniRacks/AggregateSurvey/request2.xml request2.xml], [http://groups.geni.net/geni/attachment/wiki/GENIRacksHome/ExogeniRacks/AggregateSurvey/request3.xml request3.xml],and [http://groups.geni.net/geni/attachment/wiki/GENIRacksHome/ExogeniRacks/AggregateSurvey/bad.xml bad.xml].
+ * Omni_config used is [http://groups.geni.net/geni/attachment/wiki/GENIRacksHome/ExogeniRacks/AggregateSurvey/orca-acceptance-log.txt attached]
+ * Acceptance test logs are [http://groups.geni.net/geni/attachment/wiki/GENIRacksHome/ExogeniRacks/AggregateSurvey/orca-acceptance-log.txt attached].
+
+Acceptance tests output:
+{{{
+$ ./am_api_accept.py -a am-undertest -V 2 --debug
+F.F...FNot wellformed XML:  junk after document element: line 42, column 0
+F..Not wellformed XML:  junk after document element: line 42, column 0
+FNot wellformed XML:  not well-formed (invalid token): line 1, column 12
+F.
+======================================================================
+FAIL: test_CreateSliver: Passes if the sliver creation workflow succeeds.  Use --rspec-file to replace the default request RSpec.
+----------------------------------------------------------------------
+Traceback (most recent call last):
+  File "./am_api_accept.py", line 625, in test_CreateSliver
+    self.subtest_CreateSliverWorkflow()
+  File "./am_api_accept.py", line 659, in subtest_CreateSliverWorkflow
+    self.assertRspecType( request, 'request')
+  File "/home/lnevers/gcf-1.6.1/src/omni_unittest.py", line 165, in assertRspecType
+    raise WrongRspecType, msg
+WrongRspecType: RSpec expected to have type 'request' but schema was not correct.
+
+======================================================================
+FAIL: test_CreateSliverWorkflow_multiSlice: Do CreateSliver workflow with multiple slices and ensure can not do ListResources on slices with the wrong credential.
+----------------------------------------------------------------------
+Traceback (most recent call last):
+  File "./am_api_accept.py", line 931, in test_CreateSliverWorkflow_multiSlice
+    manifest[i] = "".join(self.subtest_CreateSliver( slicenames[i] ))
+  File "./am_api_accept.py", line 1116, in subtest_CreateSliver
+    "but instead nothing returned. AM returned:\n %s"%text)
+  File "/home/lnevers/gcf-1.6.1/src/omni_unittest.py", line 112, in assertIsNotNone
+    raise NotNoneAssertionError, msg
+NotNoneAssertionError: Return from 'CreateSliver'expected to be XML file but instead nothing returned. AM returned:
+ Slice urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+acclne-1500470 expires within 1 day(s) on 2012-03-21 21:00:48 UTC
+Asked https://geni.renci.org:11443/orca/xmlrpc to reserve resources. No manifest Rspec returned. ERROR: Exception encountered: java.lang.NullPointerException
+
+======================================================================
+FAIL: test_GetVersion: Passes if a 'GetVersion' returns an XMLRPC struct containing 'geni_api' and other parameters defined in Change Set A.
+----------------------------------------------------------------------
+Traceback (most recent call last):
+  File "./am_api_accept.py", line 271, in test_GetVersion
+    self.assertKeyValueType( 'GetVersion', agg, vers, 'extensions', type([]) )
+  File "/home/lnevers/gcf-1.6.1/src/omni_unittest.py", line 208, in assertKeyValueType
+    % (method, aggName, key, str(dictionary)))
+AssertionError: Return from 'GetVersion' at https://geni.renci.org:11443/orca/xmlrpc expected to have entry 'extensions' but instead returned: 
+{'namespace': 'http://www.protogeni.net/resources/rspec/2', 'version': '3', 'type': 'GENI', 'schema': 'http://www.protogeni.net/resources/rspec/2/request.xsd'}
+... edited for length ...
+
+======================================================================
+FAIL: test_ListResources: Passes if 'ListResources' returns an advertisement RSpec.
+----------------------------------------------------------------------
+Traceback (most recent call last):
+  File "./am_api_accept.py", line 328, in test_ListResources
+    self.subtest_ListResources()
+  File "./am_api_accept.py", line 602, in subtest_ListResources
+    % (agg_name, rspec[:100]))
+AssertionError: Return from 'ListResources' at aggregate 'unspecified_AM_URN' expected to be XML but instead returned: 
+<?xml version="1.0" encoding="UTF-8" standalone="yes"?>
+<rspec xmlns:ns2="http://hpn.east.isi.edu/rs
+... edited for length ...
+
+======================================================================
+FAIL: test_ListResources_geni_available: Passes if 'ListResources' returns an advertisement RSpec.
+----------------------------------------------------------------------
+Traceback (most recent call last):
+  File "./am_api_accept.py", line 342, in test_ListResources_geni_available
+    self.subtest_ListResources()
+  File "./am_api_accept.py", line 602, in subtest_ListResources
+    % (agg_name, rspec[:100]))
+AssertionError: Return from 'ListResources' at aggregate 'unspecified_AM_URN' expected to be XML but instead returned: 
+<?xml version="1.0" encoding="UTF-8" standalone="yes"?>
+<rspec xmlns:ns2="http://hpn.east.isi.edu/rs
+... edited for length ...
+
+======================================================================
+FAIL: test_ListResources_geni_compressed: Passes if 'ListResources' returns an advertisement RSpec.
+----------------------------------------------------------------------
+Traceback (most recent call last):
+  File "./am_api_accept.py", line 335, in test_ListResources_geni_compressed
+    self.subtest_ListResources()
+  File "./am_api_accept.py", line 602, in subtest_ListResources
+    % (agg_name, rspec[:100]))
+AssertionError: Return from 'ListResources' at aggregate 'unspecified_AM_URN' expected to be XML but instead returned: 
+eAHtXetv2zi2/z5/hZH77fo68qPNtEbTwbbNdmfRKRZ93PthsSgUR3WEceRAktP2v798iIeHEiVTJOXYUwZoY8UieXh4+ON5kXzx
+... edited for length ...
+
+----------------------------------------------------------------------
+Ran 13 tests in 240.826s
+
+FAILED (failures=6)
+
+}}}
+
+
+Two tests were run for individual AM API Compliance test based on GPO Dev request, their results are captured in this page.
+
+''' test_ListResources_geni_compressed only '''
+
+Test output:
+
+{{{
+$ ./am_api_accept.py -a am-undertest -V 2 --debug Test.test_ListResources_geni_compressed
+Not wellformed XML:  syntax error: line 1, column 0
+F
+======================================================================
+FAIL: test_ListResources_geni_compressed: Passes if 'ListResources' returns an advertisement RSpec.
+----------------------------------------------------------------------
+Traceback (most recent call last):
+  File "./am_api_accept.py", line 335, in test_ListResources_geni_compressed
+    self.subtest_ListResources()
+  File "./am_api_accept.py", line 602, in subtest_ListResources
+    % (agg_name, rspec[:100]))
+AssertionError: Return from 'ListResources' at aggregate 'unspecified_AM_URN' expected to be XML but instead returned: 
+eAHtXVtv2zq2ft+/wsh5Oz6OfGkzrdF0MG0znT3oLgZt9zkPg0GhOKojbFsOJLmXf394ERcXJUqmSMqxdxmgjRWL5OLi4sd1I/ni
+... edited for length ...
+
+----------------------------------------------------------------------
+Ran 1 test in 5.628s
+
+FAILED (failures=1)
+}}}
+
+Files attached are: [http://groups.geni.net/geni/attachment/wiki/GENIRacksHome/ExogeniRacks/AggregateSurvey/acceptance-listresources.log acceptance-listresource.log] and a the tee output for the same test [http://groups.geni.net/geni/attachment/wiki/GENIRacksHome/ExogeniRacks/AggregateSurvey/test_ListResources_geni_compressed-log.txt test_ListResources_geni_compressed-log.txt].
+
+
+
 
 == Configuration == 
@@ -658 +843 @@
 }}}
 
-== AM API Acceptance Tests ==
-
-This section captures the GENI AM API Acceptance Test results using the ORCA ExoSM and GPO ExoGENI rack compute resources.
-
- * XML files used are attached: [http://groups.geni.net/geni/attachment/wiki/GENIRacksHome/ExogeniRacks/AggregateSurvey/request.xml request.xml], [http://groups.geni.net/geni/attachment/wiki/GENIRacksHome/ExogeniRacks/AggregateSurvey/request1.xml request1.xml], [http://groups.geni.net/geni/attachment/wiki/GENIRacksHome/ExogeniRacks/AggregateSurvey/request2.xml request2.xml], [http://groups.geni.net/geni/attachment/wiki/GENIRacksHome/ExogeniRacks/AggregateSurvey/request3.xml request3.xml],and [http://groups.geni.net/geni/attachment/wiki/GENIRacksHome/ExogeniRacks/AggregateSurvey/bad.xml bad.xml].
- * Omni_config used is [http://groups.geni.net/geni/attachment/wiki/GENIRacksHome/ExogeniRacks/AggregateSurvey/orca-acceptance-log.txt attached]
- * Acceptance test logs are [http://groups.geni.net/geni/attachment/wiki/GENIRacksHome/ExogeniRacks/AggregateSurvey/orca-acceptance-log.txt attached].
-
-Acceptance tests output:
-{{{
-$ ./am_api_accept.py -a am-undertest -V 2 --debug
-F.F...FNot wellformed XML:  junk after document element: line 42, column 0
-F..Not wellformed XML:  junk after document element: line 42, column 0
-FNot wellformed XML:  not well-formed (invalid token): line 1, column 12
-F.
-======================================================================
-FAIL: test_CreateSliver: Passes if the sliver creation workflow succeeds.  Use --rspec-file to replace the default request RSpec.
-----------------------------------------------------------------------
-Traceback (most recent call last):
-  File "./am_api_accept.py", line 625, in test_CreateSliver
-    self.subtest_CreateSliverWorkflow()
-  File "./am_api_accept.py", line 659, in subtest_CreateSliverWorkflow
-    self.assertRspecType( request, 'request')
-  File "/home/lnevers/gcf-1.6.1/src/omni_unittest.py", line 165, in assertRspecType
-    raise WrongRspecType, msg
-WrongRspecType: RSpec expected to have type 'request' but schema was not correct.
-
-======================================================================
-FAIL: test_CreateSliverWorkflow_multiSlice: Do CreateSliver workflow with multiple slices and ensure can not do ListResources on slices with the wrong credential.
-----------------------------------------------------------------------
-Traceback (most recent call last):
-  File "./am_api_accept.py", line 931, in test_CreateSliverWorkflow_multiSlice
-    manifest[i] = "".join(self.subtest_CreateSliver( slicenames[i] ))
-  File "./am_api_accept.py", line 1116, in subtest_CreateSliver
-    "but instead nothing returned. AM returned:\n %s"%text)
-  File "/home/lnevers/gcf-1.6.1/src/omni_unittest.py", line 112, in assertIsNotNone
-    raise NotNoneAssertionError, msg
-NotNoneAssertionError: Return from 'CreateSliver'expected to be XML file but instead nothing returned. AM returned:
- Slice urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+acclne-1500470 expires within 1 day(s) on 2012-03-21 21:00:48 UTC
-Asked https://geni.renci.org:11443/orca/xmlrpc to reserve resources. No manifest Rspec returned. ERROR: Exception encountered: java.lang.NullPointerException
-
-======================================================================
-FAIL: test_GetVersion: Passes if a 'GetVersion' returns an XMLRPC struct containing 'geni_api' and other parameters defined in Change Set A.
-----------------------------------------------------------------------
-Traceback (most recent call last):
-  File "./am_api_accept.py", line 271, in test_GetVersion
-    self.assertKeyValueType( 'GetVersion', agg, vers, 'extensions', type([]) )
-  File "/home/lnevers/gcf-1.6.1/src/omni_unittest.py", line 208, in assertKeyValueType
-    % (method, aggName, key, str(dictionary)))
-AssertionError: Return from 'GetVersion' at https://geni.renci.org:11443/orca/xmlrpc expected to have entry 'extensions' but instead returned: 
-{'namespace': 'http://www.protogeni.net/resources/rspec/2', 'version': '3', 'type': 'GENI', 'schema': 'http://www.protogeni.net/resources/rspec/2/request.xsd'}
-... edited for length ...
-
-======================================================================
-FAIL: test_ListResources: Passes if 'ListResources' returns an advertisement RSpec.
-----------------------------------------------------------------------
-Traceback (most recent call last):
-  File "./am_api_accept.py", line 328, in test_ListResources
-    self.subtest_ListResources()
-  File "./am_api_accept.py", line 602, in subtest_ListResources
-    % (agg_name, rspec[:100]))
-AssertionError: Return from 'ListResources' at aggregate 'unspecified_AM_URN' expected to be XML but instead returned: 
-<?xml version="1.0" encoding="UTF-8" standalone="yes"?>
-<rspec xmlns:ns2="http://hpn.east.isi.edu/rs
-... edited for length ...
-
-======================================================================
-FAIL: test_ListResources_geni_available: Passes if 'ListResources' returns an advertisement RSpec.
-----------------------------------------------------------------------
-Traceback (most recent call last):
-  File "./am_api_accept.py", line 342, in test_ListResources_geni_available
-    self.subtest_ListResources()
-  File "./am_api_accept.py", line 602, in subtest_ListResources
-    % (agg_name, rspec[:100]))
-AssertionError: Return from 'ListResources' at aggregate 'unspecified_AM_URN' expected to be XML but instead returned: 
-<?xml version="1.0" encoding="UTF-8" standalone="yes"?>
-<rspec xmlns:ns2="http://hpn.east.isi.edu/rs
-... edited for length ...
-
-======================================================================
-FAIL: test_ListResources_geni_compressed: Passes if 'ListResources' returns an advertisement RSpec.
-----------------------------------------------------------------------
-Traceback (most recent call last):
-  File "./am_api_accept.py", line 335, in test_ListResources_geni_compressed
-    self.subtest_ListResources()
-  File "./am_api_accept.py", line 602, in subtest_ListResources
-    % (agg_name, rspec[:100]))
-AssertionError: Return from 'ListResources' at aggregate 'unspecified_AM_URN' expected to be XML but instead returned: 
-eAHtXetv2zi2/z5/hZH77fo68qPNtEbTwbbNdmfRKRZ93PthsSgUR3WEceRAktP2v798iIeHEiVTJOXYUwZoY8UieXh4+ON5kXzx
-... edited for length ...
-
-----------------------------------------------------------------------
-Ran 13 tests in 240.826s
-
-FAILED (failures=6)
-
-}}}
-
-
-Two tests were run for individual AM API Compliance test based on GPO Dev request, their results are captured in this page.
-
-''' test_ListResources_geni_compressed only '''
-
-Test output:
-
-{{{
-$ ./am_api_accept.py -a am-undertest -V 2 --debug Test.test_ListResources_geni_compressed
-Not wellformed XML:  syntax error: line 1, column 0
-F
-======================================================================
-FAIL: test_ListResources_geni_compressed: Passes if 'ListResources' returns an advertisement RSpec.
-----------------------------------------------------------------------
-Traceback (most recent call last):
-  File "./am_api_accept.py", line 335, in test_ListResources_geni_compressed
-    self.subtest_ListResources()
-  File "./am_api_accept.py", line 602, in subtest_ListResources
-    % (agg_name, rspec[:100]))
-AssertionError: Return from 'ListResources' at aggregate 'unspecified_AM_URN' expected to be XML but instead returned: 
-eAHtXVtv2zq2ft+/wsh5Oz6OfGkzrdF0MG0znT3oLgZt9zkPg0GhOKojbFsOJLmXf394ERcXJUqmSMqxdxmgjRWL5OLi4sd1I/ni
-... edited for length ...
-
-----------------------------------------------------------------------
-Ran 1 test in 5.628s
-
-FAILED (failures=1)
-}}}
-
-Files attached are: [http://groups.geni.net/geni/attachment/wiki/GENIRacksHome/ExogeniRacks/AggregateSurvey/acceptance-listresources.log acceptance-listresource.log] and a the tee output for the same test [http://groups.geni.net/geni/attachment/wiki/GENIRacksHome/ExogeniRacks/AggregateSurvey/test_ListResources_geni_compressed-log.txt test_ListResources_geni_compressed-log.txt].
-
-== GPO Dev Team Analysis == 
-
-The GPO Software development team analyzed the results from this test run and came up with the following list of Known issues with ExoGENI's AM API implementation.
-
-Priorities (from Trac): blocker, critical, major, minor, trivial [[BR]]
-Status: where things stand - open, closed, etc. [[BR]]
-Categories: AM API, RSpec, Acceptance Test, Stitching, Question [[BR]]
-Issues are ordered by priority, and by relative importance within priority. 
-
-==== Critical Issues ====
-|| ID || Priority || Status || Category || Description ||
-|| 1 || critical ||  || AM API || !ListResources at ExoSM returns multiple advertisement RSpecs. This is neither valid XML nor valid RSpec. ||
-|| 2 || critical ||  || RSpec || ExoGENI advertises RSpec GENI v3 support in !GetVersion, but the RSpecs (ad & manifest) are ProtoGENI v2. Make the RSpecs use the GENI v3 schema. (As a fallback, change the !GetVersion return).||
-|| 3 || critical ||  || RSpec || missing schemaLocation declarations for all used schemas ||
-|| 4|| critical || || RSpec || All Ad & manifest RSpecs must pass rspeclint, but currently do not ||
-
-==== Major Issues ====
-|| ID || Priority || Status || Category || Description ||
-|| 5 || major  ||  || AM API || !GetVersion: The top-level (parallel to code and value) is missing a `geni_api` entry.  Without this entry AM API v1 clients can't discover why they can't talk to this aggregate. ||
-|| 6 || major ||  || AM API || !SliverStatus: Return at least a `geni_resources` entry that is empty, if not including all contained slivers. ||
-|| 7 || major ||  || Acceptance Test || There is no 'extensions' field listed in `geni_request_rspec_versions` and `geni_ad_rspec_version` in the return from !GetVersion. Add it, including all used extensions. ||
-|| 8 || major ||  || Acceptance Test || !ListResources does not handle the `geni_compressed` flag properly. The return value is always compressed, even if `geni_compressed` is set to False.||
-
-==== Minor Issues ====
-|| ID || Priority || Status || Category || Description ||
-|| 9 || minor || || RSpec || Does ExoGENI honor the sliver_type or ignore it? It seems to give a VM for a `sliver_type` of "raw_pc". ||
-|| 10 || minor ||  || AM API || !CreateSliver results in a !NullPointerException if a link references a non-existent node. {{{<link client_id="center"> <interface_ref client_id="geni1:0"/> <interface_ref client_id="geni2:0"/> </link>}}} when node {{{geni1}}} is not in the request. ||
-|| 11 || minor || || Stitching || Test stitching schema validity by using Omni's libstitch. Multiple undocumented conventions about IDs may need to be followed. ||
-|| 12 || minor || || RSpec || You list 1 node with a hardware_type 'vm-cloud'. What about at least listing multiple sliver_types for the different EC2 style VM types, with the appropriate type_slots value for each sliver type? ||
-|| 13 || minor || || RSpec || You list 1 node for each of 2 or 3 different hardware types, all for the same site. Is information duplicated? Could these reasonably be combined in any way? ||
-|| 14 || minor || || RSpec || The dataplane IP address is missing from the manifest RSpec ||
-|| 15 || minor ||  || RSpec || Add more info to the <interface> tag in manifest: PG includes the <ip> sub-element with IP, netmask, type ||
-|| 16 || minor || || RSpec || Change structure of component_manager_id. AM URNs should be of the form <prefix>+name+authority+am. So use prefix+<SM site name+domain name>+authority+am ||
-|| 17 || minor || || RSpec || Ad component_manager_id values are unlike those in sample request RSpec. Shouldn't this break something? Make these match. ||
-|| 18 || minor || || RSpec || client_id values are changed in the manifest from the request (add a UUID), making it hard for experimenters/tools to reconcile. Can these be kept the same? ||
-|| 19 || minor || || RSpec || Add more information to the RSpec if possible: `<component_manager>` sub-element on links, indicating the 2 AMs that control the endpoints of this link. ||
-|| 20 || minor || || RSpec || Add more information to the RSpec if possible: `<property>` sub-element on links specifying dest_id and source_id ||
-|| 21 || minor || || RSpec || Add more info / check form of interface `component_id`. Compare to PG form: prefix+site+interface+node/switch name:port #:name of remote, e.g. emulab.net+interface+procurve=pgeni-wash:10:ion ||
-|| 22 || minor || || RSpec || Simplify sliver ID. How about prefix+<site>+sliver+AM name + slice name+client_id? ||
-|| 23 || minor || || RSpec || Node component_id is the site name, making all reservations part of this same node. Maybe change exclusive to False? ||
-|| 24 || minor ||  || Question || Are the assigned `client_id` values from the RSpec available within the running Node/vm? ||
-|| 25 || minor ||  || Stitching RSpec || Stitching extension says scheduled=true. Probably should be false. ||
-|| 26 || minor ||  || Stitching RSpec || stitching extension has same component_id for both port and link. Seems wrong. Maybe OK? PG has the link ID being the ID of the interface of the corresponding node. So this part of the Orca ad seems like a mistake.||
-|| 27 || minor ||  || RSpec || The starlight Ad RSpec lists hardware_type name=orca-transit-net twice. Not a real problem, just not what he intended probably. ||
-
-
-
-
-
 = Status 01/19/2012 =