[[PageOutline]] = OpenFlow Slicer Test Plan Results = This page tracks the results of a piece of software run through the [http://groups.geni.net/geni/wiki/OpenFlow/Slicer/TestPlan OpenFlow Slicer Test Plan]. ||'''Software'''||'''Version'''|| || Flowspace Firewall || 1.0.5 with pull requests [https://github.com/GlobalNOC/FlowSpaceFirewall/pull/143 143], [https://github.com/GlobalNOC/FlowSpaceFirewall/pull/144 144], and [https://github.com/GlobalNOC/FlowSpaceFirewall/pull/145 145] integrated || = Results Legend = Individual test case status may be one of the following: * [[Color(green,Pass)]] - Test case completed and met all criteria * [[Color(#98FB98,Pass: most criteria)]] - Test case completed and met most criteria with exceptions documented * [[Color(red,Fail)]] - Test case completed and failed. * [[Color(orange,Blocked)]] - Remaining testing blocked by ticketed issues. * [[Color(#AAAAAA,N/A)]] - Tests which are not applicable (only used sparingly). = OF-OPR-SLCR-FN Testing = == Results == === Step 1: Setup === ||'''Test Case'''||'''Result'''||'''Note'''|| || 1.a.i. ||[[Color(green,Pass)]]|| || || 1.a.ii. ||[[Color(green,Pass)]]|| || || 1.a.iii. ||[[Color(green,Pass)]]|| || || 1.a.iv. ||[[Color(green,Pass)]]|| || || 1.a.v. ||[[Color(green,Pass)]]|| || || 1.b. ||[[Color(green,Pass)]]|| || || 1.c. ||[[Color(green,Pass)]]|| || === Step 2: Establish that basic connectivity works === ||'''Test Case'''||'''Result'''||'''Note'''|| || 2.a. ||[[Color(green,Pass)]]|| || || 2.b. ||[[Color(green,Pass)]]|| || || 2.c. ||[[Color(green,Pass)]]|| || || 2.d. ||[[Color(green,Pass)]]|| || || 2.e. ||[[Color(green,Pass)]]|| || || 2.f.i. ||[[Color(#98FB98,Pass: most criteria)]]||This failed due to environment setup, not the software. Test case needs work. [attachment:slicer.pcap slicer.pcap]|| || 2.f.ii. ||[[Color(green,Pass)]]||[attachment:slicer.pcap slicer.pcap]|| || 2.f.iii. ||[[Color(green,Pass)]]||[attachment:slicer.pcap slicer.pcap]|| || 2.f.iv. ||[[Color(green,Pass)]]||[attachment:slicer.pcap slicer.pcap]|| || 2.f.v. ||[[Color(green,Pass)]]||[attachment:slicer.pcap slicer.pcap]|| || 2.g. ||[[Color(green,Pass)]]|| || === Step 3: Test for VLAN enforcement and translation === ||'''Test Case'''||'''Result'''||'''Note'''|| || 3.a. ||[[Color(green,Pass)]]|| || || 3.b. ||[[Color(green,Pass)]]||[attachment:controller.pcap controller.pcap]|| || 3.c. ||[[Color(green,Pass)]]||[attachment:controller.pcap controller.pcap]|| || 3.d. ||[[Color(green,Pass)]]|| || || 3.e. ||[[Color(green,Pass)]]|| || === Step 4: Check data plane throughput === ||'''Test Case'''||'''Result'''||'''Note'''|| || 4.a. ||[[Color(green,Pass)]]|| || || 4.b. ||[[Color(green,Pass)]]|| || || 4.c. ||[[Color(green,Pass)]]|| || || 4.d. ||[[Color(green,Pass)]]|| || || 4.e. ||[[Color(green,Pass)]]|| || === Step 5: Test for OF functionality === ||'''Test Case'''||'''Result'''||'''Note'''|| || 5.a. ||[[Color(green,Pass)]]|| || || 5.b. ||[[Color(green,Pass)]]||[attachment:slicer.2.pcap slicer.2.pcap]|| || 5.c. ||[[Color(green,Pass)]]||[attachment:slicer.2.pcap slicer.2.pcap]|| || 5.d.i. ||[[Color(green,Pass)]]|| || || 5.d.ii. ||[[Color(green,Pass)]]|| || || 5.d.iii. ||[[Color(green,Pass)]]|| || || 5.e.i. ||[[Color(green,Pass)]]|| || || 5.e.ii. ||[[Color(green,Pass)]]|| || === Test 6: Test for stacked slicer support === ||'''Test Case'''||'''Result'''||'''Note'''|| || 6.a. ||[[Color(green,Pass)]]|| || || 6.b. ||[[Color(green,Pass)]]|| || === Test 7: Test for any extra functionality === ||'''Test Case'''||'''Result'''||'''Note'''|| || 7.a. ||[[Color(green,Pass)]]||[attachment:controller.2.pcap controller.2.pcap]|| || 7.b. ||[[Color(#AAAAAA,N/A)]]|| || || 7.c. ||[[Color(green,Pass)]]||[attachment:controller.2.pcap controller.2.pcap]|| === Test 8: Test management API === ||'''Test Case'''||'''Result'''||'''Note'''|| || 8.a. ||[[Color(orange,Blocked)]]|| || || 8.b. ||[[Color(orange,Blocked)]]|| || || 8.c. ||[[Color(orange,Blocked)]]|| || || 8.d. ||[[Color(orange,Blocked)]]|| || == Logs == ''Fill these in as needed'' = OF-OPR-SLCR-OP Testing = == Results == === Step 1: Setup === ||'''Test Case'''||'''Result'''||'''Note'''|| || 1.a. ||[[Color(green,Pass)]]|| || || 1.b. ||[[Color(green,Pass)]]|| || === Step 2: Collect monitoring data === ||'''Test Case'''||'''Result'''||'''Note'''|| || 2.a. ||[[Color(green,Pass)]]||[attachment:slices.json slices.json], [attachment:slice1-status.json slice1-status.json], [attachment:slice1-flows.json slice1-flows.json]|| === Step 3: Test slice operations === ||'''Test Case'''||'''Result'''||'''Note'''|| || 3.a. ||[[Color(green,Pass)]]|| || || 3.b. ||[[Color(green,Pass)]]|| || || 3.c. ||[[Color(green,Pass)]]|| || || 3.d. ||[[Color(green,Pass)]]|| || || 3.e. ||[[Color(red,Fail)]]|| [attachment:flows.json flows.json], [https://github.com/GlobalNOC/FlowSpaceFirewall/issues/140 Issue 140]|| === Step 4: Substrate-generated traffic === ||'''Test Case'''||'''Result'''||'''Note'''|| || 4.a. ||[[Color(green,Pass)]]|| || || 4.b. ||[[Color(green,Pass)]]|| || === Step 5: Test logging === ||'''Test Case'''||'''Result'''||'''Note'''|| || 5.a. || || || || 5.b. || || || || 5.c. || || || || 5.d. || || || || 5.e. || || || == Logs == ''Fill these in as needed'' = OF-OPR-SLCR-SW Testing = == Results == === Step 1: Perform validation steps === ||'''Test Case'''||'''Result'''||'''Note'''|| || 1.a. || || || || 1.b. || || || || 1.c. || || || || 1.d. || || || || 1.e. || || || == Logs == ''Fill these in as needed'' = Integration Testing = == Results == === Step 1: Setup === ||'''Test Case'''||'''Result'''||'''Note'''|| || 1.a. || || || || 1.b. || || || || 1.c. || || || || 1.d. || || || === Step 2: Collect monitoring data === ||'''Test Case'''||'''Result'''||'''Note'''|| || 2.a. || || || = Wishlist Testing = == Results == === Step 1: Check documentation === ||'''Test Case'''||'''Result'''||'''Note'''|| || 1.a. || || || || 1.b. || || || || 1.c. || || || === Step 2: Set up the environment === ||'''Test Case'''||'''Result'''||'''Note'''|| || 2.a. || || || || 2.b. || || || || 2.c. || || || === Step 3: Test that priority setting works === ||'''Test Case'''||'''Result'''||'''Note'''|| || 3.a. || || || || 3.b. || || || || 3.c. || || || || 3.d. || || || == Logs == ''Fill these in as needed''