Changes between Version 11 and Version 12 of OpenFlow/Slicer/TestPlan

Timestamp:

11/12/14 11:37:26 (9 years ago)

Author:

tupty@bbn.com

Comment:

--

OpenFlow/Slicer/TestPlan

@@ -2 +2 @@
 
 = GENI OpenFlow Slicer Test Plan =
+This test plan is for validating requirements that are defined in the [wiki:OpenFlow/Slicer/Requirements GENI Slicer Requirements].  The focus of this test plan is testing that the requirements are satisfied in an environment that is close to how the slicer will be used in production.  In other words, it is not focused on unit testing.  This is also not a full blown integration test.  A lot of the data plane traffic is simple ICMP ping traffic.  Also, any of the limitations of the substrate will not be held against the slicer as part of this test plan.
 
-Intro describing goals of testing (restate the goals from the requirements but as validation).  Make sure to provide a link to the [wiki:OpenFlow/Slicer/Requirements GENI Slicer Requirements] that the plan is based on. If specific types of traffic are verified for each test case (ex. UDP, TCP, ICMP..) then make sure it is stated as a validation goal. 
+== Expected test outcome ==
+ * All test steps verifying a MUST requirement will be satisfied.
+ * All test steps verifying a SHOULD requirement will be satisfied with special exceptions made only when they seem reasonable.
+ * Any test steps that verify a MAY will have the results documented as features that operators can consider, but they will not count against the test plan.
+ * Any test steps that verify an item from the wish list will have the results documented as features that operators can consider, but they will not count against the test plan.
 
-Describe the expected outcome:
- - validation of all requirement to determine which are met (must, may, and wishlist).
- - validation of interactions with currently supported substrate (vendors, versions)
- - validation of interactions with currently available Service abstraction layer.
- - description of how status will be made available (periodic emails or wiki pages updates?) (where?)
- - final test report (wiki pages?) (where?)
+== Tracking progress during testing ==
+ * Test plan progress and results will be tracked at '''FIXME'''
+ * Issues uncovered during testing must be tracked using a ticket system.  This ticket system can be provided by the slicer developers, or it can be the GENI wiki ticketing system.
+ * Validated slice software versions will be documented at '''FIXME'''
+ * If you would like for a specific piece of software to be tested, please contact '''FIXME'''
 
 ==  Assumptions and Dependencies ==
-
-Describe any assumptions, for example: 
- - slicer software must interact with OF v1.0
- - slicer software should interact with OF v1.3
- - Slicer must interact with specific OF switches: x, y, z...
- - Slicer must interact with service abstraction layer: x, y, z.... 
- - Documentation must is available describing configuration and usage.
-
-Describe dependencies, for example:
- - Tests will use the GENI AM API where possible.  Most tests cannot be completed without the AM API
+ * Slicer software must interact with OpenFlow v1.0
+ * Slicer must interact any hardware or software OpenFlow 1.0 switch that is not running in a VLAN-based hybrid mode.
+ * Documentation must is available describing configuration and usage
+ * Slice operations will be performed using the GENI AM API where possible.  Most tests cannot be completed without the AM API.
  
 = Slicer Test Cases =