[[PageOutline]] = OpenFlow Slicer Test Plan Results = This page tracks the results of a piece of software run through the [http://groups.geni.net/geni/wiki/OpenFlow/Slicer/TestPlan OpenFlow Slicer Test Plan]. ||'''Software'''||'''Version'''|| || || || = Results Legend = Individual test case status may be one of the following: * [[Color(green,Pass)]] - Test case completed and met all criteria * [[Color(#98FB98,Pass: most criteria)]] - Test case completed and met most criteria with exceptions documented * [[Color(red,Fail)]] - Test case completed and failed. * [[Color(orange,Blocked)]] - Remaining testing blocked by ticketed issues. = OF-OPR-SLCR-FN Testing = == Results == === Step 1: Setup === ||'''Test Case'''||'''Result'''||'''Note'''|| || 1.a.i. ||[[Color(green,Pass)]]|| || || 1.a.ii. ||[[Color(green,Pass)]]|| || || 1.a.iii. ||[[Color(green,Pass)]]|| || || 1.a.iv. ||[[Color(green,Pass)]]|| || || 1.a.v. ||[[Color(green,Pass)]]|| || || 1.b. ||[[Color(green,Pass)]]|| || || 1.c. ||[[Color(green,Pass)]]|| || === Step 2: Establish that basic connectivity works === ||'''Test Case'''||'''Result'''||'''Note'''|| || 2.a. ||[[Color(green,Pass)]]|| || || 2.b. ||[[Color(green,Pass)]]|| || || 2.c. ||[[Color(green,Pass)]]|| || || 2.d. ||[[Color(green,Pass)]]|| || || 2.e. ||[[Color(green,Pass)]]|| || || 2.f.i. ||[[Color(red,Fail)]] ||[attachment:slicer.pcap Slicer capture]. This failure might be an issue with environment setup. Is slicer responsible for installing a "drop unmatched" rule?|| || 2.f.ii. ||[[Color(green,Pass)]]||[attachment:slicer.pcap Slicer capture] || || 2.f.iii. ||[[Color(green,Pass)]]||[attachment:slicer.pcap Slicer capture], [attachment:controller.pcap Controller capture]|| || 2.f.iv. ||[[Color(green,Pass)]]||[attachment:slicer.pcap Slicer capture], [attachment:controller.pcap Controller capture]|| || 2.f.v. ||[[Color(green,Pass)]]||[attachment:slicer.pcap Slicer capture], [attachment:controller.pcap Controller capture]|| || 2.g. ||[[Color(green,Pass)]]|| || === Step 3: Test for VLAN enforcement and translation === ||'''Test Case'''||'''Result'''||'''Note'''|| || 3.a. ||[[Color(green,Pass)]]|| || || 3.b. ||[[Color(green,Pass)]]||[attachment:controller.2.pcap Controller capture]|| || 3.c. ||[[Color(green,Pass)]]||[attachment:controller.2.pcap Controller capture]|| || 3.d. ||[[Color(green,Pass)]]|| || || 3.e. ||[[Color(green,Pass)]]|| || === Step 4: Check data plane throughput === ||'''Test Case'''||'''Result'''||'''Note'''|| || 4.a. ||[[Color(green,Pass)]]|| || || 4.b. ||[[Color(green,Pass)]]|| || || 4.c. ||[[Color(green,Pass)]]|| || || 4.d. ||[[Color(green,Pass)]]|| || || 4.e. ||[[Color(green,Pass)]]|| || === Step 5: Test for OF functionality === ||'''Test Case'''||'''Result'''||'''Note'''|| || 5.a. ||[[Color(green,Pass)]]|| || || 5.b. ||[[Color(green,Pass)]]|| || || 5.c. ||[[Color(green,Pass)]]|| || || 5.d.i. ||[[Color(red,Fail)]]||[https://github.com/GlobalNOC/FlowSpaceFirewall/issues/83 Known issue], will be fixed in next release|| || 5.d.ii. || || || || 5.d.iii. || || || || 5.e. || || || || 5.f.i. || || || || 5.f.ii. || || || === Test 6: Test for stacked slicer support === ||'''Test Case'''||'''Result'''||'''Note'''|| || 6.a. ||[[Color(green,Pass)]]|| || || 6.b. ||[[Color(green,Pass)]]|| || === Test 7: Test for any extra functionality === ||'''Test Case'''||'''Result'''||'''Note'''|| || 7.a. ||[[Color(#98FB98,Pass: most criteria)]]||[attachment:controller.2.pcap Controller capture], Limits seem to be enforced. Cases in which slice is disabled don't seem to be documented. Specific types of OF error messages sent in different cases don't seem to be documented. || || 7.b. || N/A || No data plane limiters. || || 7.c. ||[[Color(#98FB98,Pass: most criteria)]]||[attachment:controller.2.pcap Controller capture], Limits seem to be enforced. Cases in which slice is disabled don't seem to be documented. Specific types of OF error messages sent in different cases don't seem to be documented. || === Test 8: Test management API === ||'''Test Case'''||'''Result'''||'''Note'''|| || 8.a. ||[[Color(orange,Blocked)]]|| Management API software under development. || || 8.b. ||[[Color(orange,Blocked)]]|| Management API software under development. || || 8.c. ||[[Color(orange,Blocked)]]|| Management API software under development. || || 8.d. ||[[Color(orange,Blocked)]]|| Management API software under development. || == Logs == ''Fill these in as needed'' = OF-OPR-SLCR-OP Testing = == Results == === Step 1: Setup === ||'''Test Case'''||'''Result'''||'''Note'''|| || 1.a. || || || || 1.b. || || || === Step 2: Collect monitoring data === ||'''Test Case'''||'''Result'''||'''Note'''|| || 2.a. || || || === Step 3: Test slice operations === ||'''Test Case'''||'''Result'''||'''Note'''|| || 3.a. || || || || 3.b. || || || || 3.c. || || || || 3.d. || || || || 3.e. || || || === Step 4: Substrate-generated traffic === ||'''Test Case'''||'''Result'''||'''Note'''|| || 4.a. || || || || 4.b. || || || === Step 5: Test logging === ||'''Test Case'''||'''Result'''||'''Note'''|| || 5.a. || || || || 5.b. || || || || 5.c. || || || || 5.d. || || || || 5.e. || || || == Logs == ''Fill these in as needed'' = OF-OPR-SLCR-SW Testing = == Results == === Step 1: Perform validation steps === ||'''Test Case'''||'''Result'''||'''Note'''|| || 1.a. || || || || 1.b. || || || || 1.c. || || || || 1.d. || || || || 1.e. || || || == Logs == ''Fill these in as needed'' = Integration Testing = == Results == === Step 1: Setup === ||'''Test Case'''||'''Result'''||'''Note'''|| || 1.a. || || || || 1.b. || || || || 1.c. || || || || 1.d. || || || === Step 2: Collect monitoring data === ||'''Test Case'''||'''Result'''||'''Note'''|| || 2.a. || || || = Wishlist Testing = == Results == === Step 1: Check documentation === ||'''Test Case'''||'''Result'''||'''Note'''|| || 1.a. || || || || 1.b. || || || || 1.c. || || || === Step 2: Set up the environment === ||'''Test Case'''||'''Result'''||'''Note'''|| || 2.a. || || || || 2.b. || || || || 2.c. || || || === Step 3: Test that priority setting works === ||'''Test Case'''||'''Result'''||'''Note'''|| || 3.a. || || || || 3.b. || || || || 3.c. || || || || 3.d. || || || == Logs == ''Fill these in as needed''