[[PageOutline]] = OpenFlow Slicer Test Plan Results = This page tracks the results of a piece of software run through the [http://groups.geni.net/geni/wiki/OpenFlow/Slicer/TestPlan OpenFlow Slicer Test Plan]. ||'''Software'''||'''Version'''|| || Flowspace Firewall || 1.0.5-dev branch snapshot (2015-05-15) || = Results Legend = Individual test case status may be one of the following: * [[Color(green,Pass)]] - Test case completed and met all criteria * [[Color(#98FB98,Pass: most criteria)]] - Test case completed and met most criteria with exceptions documented * [[Color(red,Fail)]] - Test case completed and failed. * [[Color(orange,Blocked)]] - Remaining testing blocked by ticketed issues. * [[Color(#AAAAAA,N/A)]] - Tests which are not applicable (only used sparingly). = OF-OPR-SLCR-FN Testing = == Results == === Step 1: Setup === ||'''Test Case'''||'''Result'''||'''Note'''|| || 1.a.i. ||[[Color(green,Pass)]]|| || || 1.a.ii. ||[[Color(green,Pass)]]|| || || 1.a.iii. ||[[Color(green,Pass)]]|| || || 1.a.iv. ||[[Color(green,Pass)]]|| || || 1.a.v. ||[[Color(green,Pass)]]|| || || 1.b. ||[[Color(green,Pass)]]|| || || 1.c. ||[[Color(green,Pass)]]|| || === Step 2: Establish that basic connectivity works === ||'''Test Case'''||'''Result'''||'''Note'''|| || 2.a. ||[[Color(green,Pass)]]|| || || 2.b. ||[[Color(green,Pass)]]|| || || 2.c. ||[[Color(green,Pass)]]|| || || 2.d. ||[[Color(green,Pass)]]|| || || 2.e. ||[[Color(green,Pass)]]|| || || 2.f.i. ||[[Color(green,Pass)]]|| || || 2.f.ii. ||[[Color(green,Pass)]]|| || || 2.f.iii. ||[[Color(green,Pass)]]|| || || 2.f.iv. ||[[Color(green,Pass)]]|| || || 2.f.v. ||[[Color(green,Pass)]]|| || || 2.g. ||[[Color(green,Pass)]]|| || === Step 3: Test for VLAN enforcement and translation === ||'''Test Case'''||'''Result'''||'''Note'''|| || 3.a. ||[[Color(green,Pass)]]|| || || 3.b. ||[[Color(green,Pass)]]|| || || 3.c. ||[[Color(green,Pass)]]|| || || 3.d. ||[[Color(green,Pass)]]|| || || 3.e. ||[[Color(green,Pass)]]|| || === Step 4: Check data plane throughput === ||'''Test Case'''||'''Result'''||'''Note'''|| || 4.a. ||[[Color(green,Pass)]]|| || || 4.b. ||[[Color(green,Pass)]]|| || || 4.c. ||[[Color(green,Pass)]]|| || || 4.d. ||[[Color(green,Pass)]]|| || || 4.e. ||[[Color(green,Pass)]]|| || === Step 5: Test for OF functionality === ||'''Test Case'''||'''Result'''||'''Note'''|| || 5.a. ||[[Color(green,Pass)]]|| || || 5.b. ||[[Color(green,Pass)]]|| || || 5.c. ||[[Color(green,Pass)]]|| || || 5.d.i. ||[[Color(green,Pass)]]|| || || 5.d.ii. ||[[Color(red,Fail)]]|| [https://github.com/GlobalNOC/FlowSpaceFirewall/issues/121 Issue 121 filed] || || 5.d.iii. || || Was not run || || 5.e.i. || || Was not run || || 5.e.ii. ||[[Color(green,Pass)]]|| || === Test 6: Test for stacked slicer support === ||'''Test Case'''||'''Result'''||'''Note'''|| || 6.a. ||[[Color(green,Pass)]]|| || || 6.b. ||[[Color(green,Pass)]]|| || === Test 7: Test for any extra functionality === ||'''Test Case'''||'''Result'''||'''Note'''|| || 7.a. ||[[Color(green,Pass)]]|| Disregard test run in attached tarball. || || 7.b. || || Was not run || || 7.c. ||[[Color(green,Pass)]]|| Disregard test run in attached tarball. [attachment:fn_step7_controller.pcap See pcap] || === Test 8: Test management API === ||'''Test Case'''||'''Result'''||'''Note'''|| || 8.a. ||[[Color(orange,Blocked)]]|| Waiting on implementation || || 8.b. ||[[Color(orange,Blocked)]]|| Waiting on implementation || || 8.c. ||[[Color(orange,Blocked)]]|| Waiting on implementation || || 8.d. ||[[Color(orange,Blocked)]]|| Waiting on implementation || == Logs == ''Fill these in as needed'' = OF-OPR-SLCR-OP Testing = == Results == === Step 1: Setup === ||'''Test Case'''||'''Result'''||'''Note'''|| || 1.a. ||[[Color(green,Pass)]]|| || || 1.b. ||[[Color(green,Pass)]]|| || === Step 2: Collect monitoring data === ||'''Test Case'''||'''Result'''||'''Note'''|| || 2.a. ||[[Color(green,Pass)]]|| || === Step 3: Test slice operations === ||'''Test Case'''||'''Result'''||'''Note'''|| || 3.a. ||[[Color(green,Pass)]]|| || || 3.b. ||[[Color(green,Pass)]]|| || || 3.c. ||[[Color(green,Pass)]]|| || || 3.d. ||[[Color(green,Pass)]]|| || || 3.e. ||[[Color(red,Fail)]]|| I still see my flows. There is a known limitation where flows only get purged when flow stats are requested. I need to investigate if my setup or my test case has an issue as well. || === Step 4: Substrate-generated traffic === ||'''Test Case'''||'''Result'''||'''Note'''|| || 4.a. ||[[Color(green,Pass)]]|| || || 4.b. ||[[Color(green,Pass)]]|| || === Step 5: Test logging === ||'''Test Case'''||'''Result'''||'''Note'''|| || 5.a. ||[[Color(green,Pass)]]|| || || 5.b. ||[[Color(green,Pass)]]|| || || 5.c. ||[[Color(green,Pass)]]|| || || 5.d. ||[[Color(green,Pass)]]|| || || 5.e. ||[[Color(green,Pass)]]|| || == Logs == ''Fill these in as needed'' = OF-OPR-SLCR-SW Testing = == Results == === Step 1: Perform validation steps === ||'''Test Case'''||'''Result'''||'''Note'''|| || 1.a. ||[[Color(green,Pass)]]|| || || 1.b. ||[[Color(green,Pass)]]|| || || 1.c. ||[[Color(green,Pass)]]|| || || 1.d. ||[[Color(green,Pass)]]|| || || 1.e. ||[[Color(green,Pass)]]|| || == Logs == ''Fill these in as needed'' = Integration Testing = == Results == === Step 1: Setup === ||'''Test Case'''||'''Result'''||'''Note'''|| || 1.a. || || || || 1.b. || || || || 1.c. || || || || 1.d. || || || === Step 2: Collect monitoring data === ||'''Test Case'''||'''Result'''||'''Note'''|| || 2.a. || || || = Wishlist Testing = == Results == === Step 1: Check documentation === ||'''Test Case'''||'''Result'''||'''Note'''|| || 1.a. || || || || 1.b. || || || || 1.c. || || || === Step 2: Set up the environment === ||'''Test Case'''||'''Result'''||'''Note'''|| || 2.a. || || || || 2.b. || || || || 2.c. || || || === Step 3: Test that priority setting works === ||'''Test Case'''||'''Result'''||'''Note'''|| || 3.a. || || || || 3.b. || || || || 3.c. || || || || 3.d. || || || == Logs == ''Fill these in as needed''