Changes between Initial Version and Version 1 of GeniNetworkStitchingTestStatus/Measurements


Ignore:
Timestamp:
06/11/13 09:36:25 (11 years ago)
Author:
lnevers@bbn.com
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • GeniNetworkStitchingTestStatus/Measurements

    v1 v1  
     1
     2= Experiment Measurements =
     3
     4This page captures status and execution details for the Experiment Measurements.   For overall status see the [http://groups.geni.net/geni/wiki/GeniNetworkStitchingTestStatus GENI Network Stitching Test Status] page and for test details see  the [http://groups.geni.net/geni/wiki/GeniNetworkStitchingTestPlan GENI Network Stitching Test Plan] page.
     5
     6''Last update: 06/11/13''
     7
     8|| '''Measurements'''                                                || '''State'''              || ''' Ticket ''' || '''Comments''' ||
     9||GNS-T1 - Topology 1 - Utah InstaGENI to GPO InstaGENI              ||
     10||GNS-T2 - Topology 2 - InstaGENI Utah to GPO ExoGENI                ||
     11||GNS-T3 - Topology 3 - InstaGENI Utah to GPO ExoGENI to LONI and MAX||
     12||GNS-T4 - Topology 4 - InstaGENI Utah to GPO ExoGENI to CENIC       ||
     13||GNS-T5 - Topology 5 - InstaGENI Utah to GPO ExoGENI to NYSERNet    ||
     14||GNS-T6 - Topology 6 - Utah PG to GPO InstaGENI                     ||
     15
     16
     17[[BR]]
     18|| '''State Legend'''                     || '''Description'''                                                    ||
     19|| [[Color(green,Pass)]]                  || Test completed and met all criteria                                  ||
     20|| [[Color(#98FB98,Pass: most criteria)]] || Test completed and met most criteria. Exceptions documented          ||
     21|| [[Color(red,Fail)]]                    || Test completed and failed to meet criteria.                          ||
     22|| [[Color(yellow,Complete)]]             || Test completed but will require re-execution due to expected changes ||
     23|| [[Color(orange,Blocked)]]              || Blocked by ticketed issue(s).                                        ||
     24|| [[Color(#63B8FF,In Progress)]]         || Currently under test.                                                ||
     25[[BR]]
     26
     27
     28= Test Execution =
     29
     30'''Assumptions:'''
     31 - pgeni.gpolab.bbn.com or GENI Portal credential are used for tests in this page.
     32 - Some end-points exist in multiple test cases, so their measurements will be not be duplicated.
     33
     34'''Notes:'''
     35 - Stitcher currently does not support AM API v3, is delivered to run AM API V2.
     36 - Capacity '''must''' be specified for scenarios where Utah IG is end-point.
     37
     38== Measurements Goals ==
     39
     40The set of GENI Network Stitching (GNS) test topologies selected to validate stitching experiment scenarios are also used to benchmark measurements to characterize various areas including setup timing, tear down timing, timing for an experiment to change data paths from one stitched VLAN to another, end-host to end-host data flow set up timing and delay. Throughput will also be measured with iperf between endpoint hosts using the following methodology:
     41
     42 - All results are captured for default bandwidth allocation, unless otherwise stated.
     43 - All results are for a 60 second test runs.
     44 - TCP iperf measurements are collected for:
     45    * '1 client' scenario using command: 'iperf -c dest_host -t 60'
     46    * '5 clients' scenario using command: 'iperf -c dest_host -t 60 -P 5'
     47    * '10 clients' scenario command: 'iperf -c dest_host -t 60 -P 10'
     48 - UDP iperf measurements are run for 10 seconds increments to determine bandwidth supported
     49
     50== Measurements Collected ==
     51
     52This sections captures all measurements collected for the Network Stitching test effort.
     53
     54
     55=== GNS-T1 - Topology 1 - Utah InstaGENI to GPO InstaGENI ===
     56
     57||''' Description'''                              || '''Results Collected ''' ||
     58|| VLAN stitching setup timing                    ||                          ||
     59|| VLAN stitching tear down timing                ||                          ||
     60|| Data path change from stitched VLAN to another ||                          ||
     61|| End-host to end-host data flow set up timing   ||                          ||
     62|| End-host to end-host delay                     ||                          ||
     63|| Throughput between end-hosts                   ||                          ||
     64
     65
     66=== GNS-T2 - Topology 2 - InstaGENI Utah to GPO ExoGENI  ===
     67
     68||''' Description'''                              || '''Results Collected ''' ||
     69|| VLAN stitching setup timing                    ||                          ||
     70|| VLAN stitching tear down timing                ||                          ||
     71|| Data path change from stitched VLAN to another ||                          ||
     72|| End-host to end-host data flow set up timing   ||                          ||
     73|| End-host to end-host delay                     ||                          ||
     74|| Throughput between end-hosts                   ||                          ||
     75
     76
     77=== GNS-T3 - Topology 3 - InstaGENI Utah to GPO ExoGENI to LONI and MAX ===
     78
     79||''' Description'''                              || '''Results Collected ''' ||
     80|| VLAN stitching setup timing                    ||                          ||
     81|| VLAN stitching tear down timing                ||                          ||
     82|| Data path change from stitched VLAN to another ||                          ||
     83|| End-host to end-host data flow set up timing   ||                          ||
     84|| End-host to end-host delay                     ||                          ||
     85|| Throughput between end-hosts                   ||                          ||
     86
     87
     88=== GNS-T4 - Topology 4 - InstaGENI Utah to GPO ExoGENI to CENIC ===
     89
     90||''' Description'''                              || '''Results Collected ''' ||
     91|| VLAN stitching setup timing                    ||                          ||
     92|| VLAN stitching tear down timing                ||                          ||
     93|| Data path change from stitched VLAN to another ||                          ||
     94|| End-host to end-host data flow set up timing   ||                          ||
     95|| End-host to end-host delay                     ||                          ||
     96|| Throughput between end-hosts                   ||                          ||
     97
     98
     99=== GNS-T5 - Topology 5 - InstaGENI Utah to GPO ExoGENI to NYSERNet ===
     100
     101||''' Description'''                              || '''Results Collected ''' ||
     102|| VLAN stitching setup timing                    ||                          ||
     103|| VLAN stitching tear down timing                ||                          ||
     104|| Data path change from stitched VLAN to another ||                          ||
     105|| End-host to end-host data flow set up timing   ||                          ||
     106|| End-host to end-host delay                     ||                          ||
     107|| Throughput between end-hosts                   ||                          ||
     108
     109
     110=== GNS-T6 - Topology 6 - Utah PG to GPO InstaGENI  ===
     111
     112
     113||''' Description'''                              || '''Results Collected ''' ||
     114|| VLAN stitching setup timing                    ||                          ||
     115|| VLAN stitching tear down timing                ||                          ||
     116|| Data path change from stitched VLAN to another ||                          ||
     117|| End-host to end-host data flow set up timing   ||                          ||
     118|| End-host to end-host delay                     ||                          ||
     119|| Throughput between end-hosts                   ||                          ||