Changes between Version 64 and Version 65 of GeniNetworkStitchingTestStatus/Functional


Ignore:
Timestamp:
06/11/13 11:35:00 (6 years ago)
Author:
lnevers@bbn.com
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • GeniNetworkStitchingTestStatus/Functional

    v64 v65  
    27092709== 3.0 Negative and Boundary tests ==
    27102710
    2711 This is a starting list of scenarios that will validate negative and boundary conditions:
    2712 
    2713  - At ION, InstaGENI and ExoGENI, allocate resources that are not advertised, verify failure.
    2714  - At ION, InstaGENI and ExoGENI, allocate VLAN tags that are already in use, verify failure.
    2715  - Kill an ION circuit manually, verify recovery and logging of event.
    2716  - Request a VLAN that is already in use, verify handling.
    2717  - Create a request race condition where two slices (Slice1 and Slice2) request the same resources (AM1 <->VLAN1<->AM2), but Slice1 gets VLAN1 at AM1 and Slice2 gets VLAN1 at AM2. Verify results tools handle the results and properly handle resources.
    2718  - Pseudo Loop Scenario:  Request PG Utah to ION to IG GPO. Then request a 2nd interface at PG Utah node to ION to same interface on same node at IG GPO.  If that fails, then request a 2nd interface on that node at IG GPO - that should work.
    2719 
     2711This is a starting list of scenarios that will validate negative and boundary conditions, this list will be expanded as more scenarios are determined as of interest.
     2712
     2713=== 3.1 Allocate not advertised ===
     2714At ION, InstaGENI and ExoGENI, allocate resources that are not advertised, verify failure.
     2715
     2716=== 3.2 Request VLAN already in use ===
     2717At ION, InstaGENI and ExoGENI, allocate VLAN tags that are already in use, verify failure.
     2718
     2719At ION, create a sliver that uses VLAN 850 and verify that it is ready:
     2720{{{
     2721$ omni.py createsliver -a i2 lnstitch ./stitch-ion.rspec         
     272211:20:01 INFO     omni: Loading config file /home/lnevers/.gcf/omni_config
     272311:20:01 INFO     omni: Using control framework pg
     272411:20:01 INFO     omni: Substituting AM nickname i2 with URL http://geni-am.net.internet2.edu:12346, URN urn:publicid:IDN+ion.internet2.edu+authority+cm
     272511:20:02 INFO     omni: Slice urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+lnstitch expires on 2013-06-12 16:15:48 UTC
     272611:20:02 INFO     omni: Substituting AM nickname i2 with URL http://geni-am.net.internet2.edu:12346, URN urn:publicid:IDN+ion.internet2.edu+authority+cm
     272711:20:02 INFO     omni: Substituting AM nickname i2 with URL http://geni-am.net.internet2.edu:12346, URN urn:publicid:IDN+ion.internet2.edu+authority+cm
     272811:20:02 INFO     omni: Creating sliver(s) from rspec file ./stitch-ion.rspec for slice urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+lnstitch
     272911:20:46 INFO     omni: Got return from CreateSliver for slice lnstitch at http://geni-am.net.internet2.edu:12346:
     273011:20:46 INFO     omni: <!-- Reserved resources for:
     2731        Slice: lnstitch
     2732        at AM:
     2733        URN: urn:publicid:IDN+ion.internet2.edu+authority+cm
     2734        URL: http://geni-am.net.internet2.edu:12346
     2735 -->
     273611:20:46 INFO     omni: <rspec  xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.geni.net/resources/rspec/3 http://www.geni.net/resources/rspec/3/manifest.xsd" xmlns="http://www.geni.net/resources/rspec/3" expires="2013-06-11T15:20:40.849Z" generated="2013-06-11T15:20:40.849Z" type="manifest">
     2737
     2738<node client_id="pg-utah" component_manager_id="urn:publicid:IDN+emulab.net+authority+cm" exclusive="false">
     2739<sliver_type name="emulab-openvz"/>
     2740<interface client_id="pg-utah:if0"><ip address="192.168.4.1" netmask="255.255.255.0" type="ipv4"/></interface></node>
     2741
     2742<node client_id="pg-uky" component_manager_id="urn:publicid:IDN+uky.emulab.net+authority+cm" exclusive="false">
     2743<sliver_type name="emulab-openvz"/><interface client_id="pg-uky:if0">
     2744<ip address="192.168.4.2" netmask="255.255.255.0" type="ipv4"/></interface></node>
     2745<link client_id="link" sliver_id="urn:publicid:IDN+ion.internet2.edu+sliver+ion.internet2.edu-19991" vlantag="850">
     2746<component_manager name="urn:publicid:IDN+emulab.net+authority+cm"/>
     2747<component_manager name="urn:publicid:IDN+ion.internet2.edu+authority+cm"/>
     2748<component_manager name="urn:publicid:IDN+uky.emulab.net+authority+cm"/>
     2749<interface_ref client_id="pg-utah:if0"/>
     2750<interface_ref client_id="pg-uky:if0"/><property dest_id="pg-uky:if0" source_id="pg-utah:if0"/>
     2751<property dest_id="pg-utah:if0" source_id="pg-uky:if0"/></link>
     2752<stitching  xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://hpn.east.isi.edu/rspec/ext/stitch/0.1/ http://hpn.east.isi.edu/rspec/ext/stitch/0.1/stitch-schema.xsd" xmlns="http://hpn.east.isi.edu/rspec/ext/stitch/0.1/" lastUpdateTime="2013-06-11T15:20:40.849Z">
     2753
     2754<path id="link"><globalId>ion.internet2.edu-19991</globalId><lifetime id="ion.internet2.edu-19991"><start type="xgc">2013-06-12T15:20:06.000Z</start><end type="xgc">2013-06-11T15:20:40.849Z</end></lifetime>
     2755
     2756<hop id="1"><link id="urn:publicid:IDN+emulab.net+interface+procurve-pgeni-atla:3.21"><trafficEngineeringMetric>10</trafficEngineeringMetric><capacity>100000</capacity><switchingCapabilityDescriptor><switchingcapType>l2sc</switchingcapType><encodingType>ethernet</encodingType><switchingCapabilitySpecificInfo><switchingCapabilitySpecificInfo_L2sc><interfaceMTU>9000</interfaceMTU>
     2757<vlanRangeAvailability>750-1000</vlanRangeAvailability><suggestedVLANRange>850</suggestedVLANRange><vlanTranslation>false</vlanTranslation>
     2758</switchingCapabilitySpecificInfo_L2sc></switchingCapabilitySpecificInfo></switchingCapabilityDescriptor></link><nextHop>2</nextHop></hop>
     2759
     2760<hop id="2"><link id="urn:publicid:IDN+ion.internet2.edu+interface+rtr.atla:ge-10/3/2:protogeni"><trafficEngineeringMetric>10</trafficEngineeringMetric><capacity>100000.0</capacity><switchingCapabilityDescriptor>
     2761<switchingcapType>l2sc</switchingcapType><encodingType>ethernet</encodingType><switchingCapabilitySpecificInfo>
     2762<switchingCapabilitySpecificInfo_L2sc><interfaceMTU>9000</interfaceMTU><vlanRangeAvailability>850</vlanRangeAvailability>
     2763<suggestedVLANRange>850</suggestedVLANRange><vlanTranslation>true</vlanTranslation></switchingCapabilitySpecificInfo_L2sc>
     2764</switchingCapabilitySpecificInfo></switchingCapabilityDescriptor></link><nextHop>3</nextHop></hop>
     2765
     2766<hop id="3"><link id="urn:publicid:IDN+ion.internet2.edu+interface+rtr.atla:xe-0/1/3:*"><trafficEngineeringMetric>10</trafficEngineeringMetric>
     2767<capacity>100000.0</capacity><switchingCapabilityDescriptor><switchingcapType>l2sc</switchingcapType><encodingType>ethernet</encodingType>
     2768<switchingCapabilitySpecificInfo><switchingCapabilitySpecificInfo_L2sc><interfaceMTU>9000</interfaceMTU>
     2769<vlanRangeAvailability>850</vlanRangeAvailability><suggestedVLANRange>850</suggestedVLANRange><vlanTranslation>true</vlanTranslation>
     2770</switchingCapabilitySpecificInfo_L2sc></switchingCapabilitySpecificInfo></switchingCapabilityDescriptor>
     2771
     2772</link><nextHop>4</nextHop></hop><hop id="4"><link id="urn:publicid:IDN+uky.emulab.net+interface+cisco1:1.2">
     2773<trafficEngineeringMetric>10</trafficEngineeringMetric><capacity>100000</capacity><switchingCapabilityDescriptor>
     2774<switchingcapType>l2sc</switchingcapType><encodingType>ethernet</encodingType><switchingCapabilitySpecificInfo><switchingCapabilitySpecificInfo_L2sc><interfaceMTU>9000</interfaceMTU><vlanRangeAvailability>850-859</vlanRangeAvailability><suggestedVLANRange>850</suggestedVLANRange><vlanTranslation>false</vlanTranslation></switchingCapabilitySpecificInfo_L2sc></switchingCapabilitySpecificInfo></switchingCapabilityDescriptor></link><nextHop>null</nextHop>
     2775</hop></path></stitching></rspec>
     277611:20:46 INFO     omni:  ------------------------------------------------------------
     277711:20:46 INFO     omni:  Completed createsliver:
     2778
     2779  Options as run:
     2780                aggregate: ['i2']
     2781                framework: pg
     2782
     2783  Args: createsliver lnstitch ./stitch-ion.rspec
     2784
     2785  Result Summary: Got Reserved resources RSpec from ion-internet2-edu
     278611:20:46 INFO     omni:  ============================================================
     2787lnevers@arendia:~/gcf-2.4-preview2$ omni.py sliverstatus -a i2 lnstitch                             
     278811:23:47 INFO     omni: Loading config file /home/lnevers/.gcf/omni_config
     278911:23:47 INFO     omni: Using control framework pg
     279011:23:47 INFO     omni: Substituting AM nickname i2 with URL http://geni-am.net.internet2.edu:12346, URN urn:publicid:IDN+ion.internet2.edu+authority+cm
     279111:23:48 INFO     omni: Slice urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+lnstitch expires on 2013-06-12 16:15:48 UTC
     279211:23:48 INFO     omni: Substituting AM nickname i2 with URL http://geni-am.net.internet2.edu:12346, URN urn:publicid:IDN+ion.internet2.edu+authority+cm
     279311:23:48 INFO     omni: Status of Slice urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+lnstitch:
     279411:23:55 INFO     omni: Slice urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+lnstitch at AM http://geni-am.net.internet2.edu:12346 has overall SliverStatus: ready
     279511:23:55 INFO     omni: Sliver status for Slice urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+lnstitch at AM URL http://geni-am.net.internet2.edu:12346
     279611:23:55 INFO     omni: {
     2797  "geni_resources": [
     2798    {
     2799      "geni_urn": "urn:publicid:IDN+pgeni.gpolab.bbn.com+sliver+lnstitch_vlan_ion.internet2.edu-19991",
     2800      "geni_error": "",
     2801      "geni_status": "ready"
     2802    }
     2803  ],
     2804  "geni_expires": "2013-06-12T15:20:06.000Z",
     2805  "geni_urn": "urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+lnstitch",
     2806  "geni_status": "ready"
     2807}
     280811:23:55 INFO     omni:  ------------------------------------------------------------
     280911:23:55 INFO     omni:  Completed sliverstatus:
     2810
     2811  Options as run:
     2812                aggregate: ['i2']
     2813                framework: pg
     2814
     2815  Args: sliverstatus lnstitch
     2816
     2817  Result Summary: Slice urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+lnstitch expires on 2013-06-12 16:15:48 UTC
     2818Slice urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+lnstitch at AM http://geni-am.net.internet2.edu:12346 has overall SliverStatus: ready.
     2819 Returned status of slivers on 1 of 1 possible aggregates.
     282011:23:55 INFO     omni:  ============================================================
     2821}}}
     2822Also verify the VLAN requested has been allocated:
     2823{{{
     2824$ omni.py listresources -a i2 lnstitch1
     282511:33:33 INFO     omni: Loading config file /home/lnevers/.gcf/omni_config
     282611:33:33 INFO     omni: Using control framework pg
     282711:33:33 INFO     omni: Substituting AM nickname i2 with URL http://geni-am.net.internet2.edu:12346, URN urn:publicid:IDN+ion.internet2.edu+authority+cm
     282811:33:34 ERROR    omni.protogeni: Call for Get Slice Cred for slice urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+lnstitch1 failed.: Exception: PG Slice urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+lnstitch1 does not exist.
     282911:33:34 ERROR    omni.protogeni:     ..... Run with --debug for more information
     283011:33:34 ERROR    omni: Cannot do listresources for urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+lnstitch1: Could not get slice credential: Exception: PG Slice urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+lnstitch1 does not exist.
     2831Cannot do listresources for urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+lnstitch1: Could not get slice credential: Exception: PG Slice urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+lnstitch1 does not exist.
     2832lnevers@arendia:~/gcf-2.4-preview2$ omni.py listresources -a i2 lnstitch
     283311:33:51 INFO     omni: Loading config file /home/lnevers/.gcf/omni_config
     283411:33:51 INFO     omni: Using control framework pg
     283511:33:51 INFO     omni: Substituting AM nickname i2 with URL http://geni-am.net.internet2.edu:12346, URN urn:publicid:IDN+ion.internet2.edu+authority+cm
     283611:33:53 INFO     omni: Slice urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+lnstitch expires on 2013-06-12 16:15:48 UTC
     283711:33:53 INFO     omni: Gathering resources reserved for slice lnstitch.
     283811:33:53 INFO     omni: Substituting AM nickname i2 with URL http://geni-am.net.internet2.edu:12346, URN urn:publicid:IDN+ion.internet2.edu+authority+cm
     283911:33:59 INFO     omni: Listed reserved resources on 1 out of 1 possible aggregates.
     284011:33:59 INFO     omni: Substituting AM nickname i2 with URL http://geni-am.net.internet2.edu:12346, URN urn:publicid:IDN+ion.internet2.edu+authority+cm
     284111:33:59 INFO     omni: <?xml version="1.0" ?>
     284211:33:59 INFO     omni:   <!-- Reserved resources for:
     2843        Slice: lnstitch
     2844        at AM:
     2845        URN: urn:publicid:IDN+ion.internet2.edu+authority+cm
     2846        URL: http://geni-am.net.internet2.edu:12346
     2847 -->
     284811:33:59 INFO     omni:   
     2849<rspec expires="2013-06-11T15:21:16.630Z" generated="2013-06-11T15:21:16.630Z" type="manifest" xmlns="http://www.geni.net/resources/rspec/3" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.geni.net/resources/rspec/3 http://www.geni.net/resources/rspec/3/manifest.xsd">
     2850  <node client_id="pg-utah" component_manager_id="urn:publicid:IDN+emulab.net+authority+cm" exclusive="false">
     2851    <sliver_type name="emulab-openvz"/>
     2852    <interface client_id="pg-utah:if0">
     2853      <ip address="192.168.4.1" netmask="255.255.255.0" type="ipv4"/>
     2854    </interface>
     2855  </node>
     2856  <node client_id="pg-uky" component_manager_id="urn:publicid:IDN+uky.emulab.net+authority+cm" exclusive="false">
     2857    <sliver_type name="emulab-openvz"/>
     2858    <interface client_id="pg-uky:if0">
     2859      <ip address="192.168.4.2" netmask="255.255.255.0" type="ipv4"/>
     2860    </interface>
     2861  </node>
     2862  <link client_id="link" sliver_id="urn:publicid:IDN+ion.internet2.edu+sliver+ion.internet2.edu-19991" vlantag="850">
     2863    <component_manager name="urn:publicid:IDN+emulab.net+authority+cm"/>
     2864    <component_manager name="urn:publicid:IDN+ion.internet2.edu+authority+cm"/>
     2865    <component_manager name="urn:publicid:IDN+uky.emulab.net+authority+cm"/>
     2866    <interface_ref client_id="pg-utah:if0"/>
     2867    <interface_ref client_id="pg-uky:if0"/>
     2868    <property dest_id="pg-uky:if0" source_id="pg-utah:if0"/>
     2869    <property dest_id="pg-utah:if0" source_id="pg-uky:if0"/>
     2870  </link>
     2871  <stitching lastUpdateTime="2013-06-11T15:21:16.630Z" xmlns="http://hpn.east.isi.edu/rspec/ext/stitch/0.1/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://hpn.east.isi.edu/rspec/ext/stitch/0.1/ http://hpn.east.isi.edu/rspec/ext/stitch/0.1/stitch-schema.xsd">
     2872    <path id="link">
     2873      <globalId>
     2874        ion.internet2.edu-19991
     2875      </globalId>
     2876      <lifetime id="ion.internet2.edu-19991">
     2877        <start type="xgc">
     2878          2013-06-12T15:20:06.000Z
     2879        </start>
     2880        <end type="xgc">
     2881          2013-06-11T15:21:16.630Z
     2882        </end>
     2883      </lifetime>
     2884      <hop id="1">
     2885        <link id="urn:publicid:IDN+emulab.net+interface+procurve-pgeni-atla:3.21">
     2886          <trafficEngineeringMetric>
     2887            10
     2888          </trafficEngineeringMetric>
     2889          <capacity>
     2890            100000
     2891          </capacity>
     2892          <switchingCapabilityDescriptor>
     2893            <switchingcapType>
     2894              l2sc
     2895            </switchingcapType>
     2896            <encodingType>
     2897              ethernet
     2898            </encodingType>
     2899            <switchingCapabilitySpecificInfo>
     2900              <switchingCapabilitySpecificInfo_L2sc>
     2901                <interfaceMTU>
     2902                  9000
     2903                </interfaceMTU>
     2904                <vlanRangeAvailability>
     2905                  750-1000
     2906                </vlanRangeAvailability>
     2907                <suggestedVLANRange>
     2908                  850
     2909                </suggestedVLANRange>
     2910                <vlanTranslation>
     2911                  false
     2912                </vlanTranslation>
     2913              </switchingCapabilitySpecificInfo_L2sc>
     2914            </switchingCapabilitySpecificInfo>
     2915          </switchingCapabilityDescriptor>
     2916        </link>
     2917        <nextHop>
     2918          2
     2919        </nextHop>
     2920      </hop>
     2921      <hop id="2">
     2922        <link id="urn:publicid:IDN+ion.internet2.edu+interface+rtr.atla:ge-10/3/2:protogeni">
     2923          <trafficEngineeringMetric>
     2924            10
     2925          </trafficEngineeringMetric>
     2926          <capacity>
     2927            100000.0
     2928          </capacity>
     2929          <switchingCapabilityDescriptor>
     2930            <switchingcapType>
     2931              l2sc
     2932            </switchingcapType>
     2933            <encodingType>
     2934              ethernet
     2935            </encodingType>
     2936            <switchingCapabilitySpecificInfo>
     2937              <switchingCapabilitySpecificInfo_L2sc>
     2938                <interfaceMTU>
     2939                  9000
     2940                </interfaceMTU>
     2941                <vlanRangeAvailability>
     2942                  850
     2943                </vlanRangeAvailability>
     2944                <suggestedVLANRange>
     2945                  850
     2946                </suggestedVLANRange>
     2947                <vlanTranslation>
     2948                  true
     2949                </vlanTranslation>
     2950              </switchingCapabilitySpecificInfo_L2sc>
     2951            </switchingCapabilitySpecificInfo>
     2952          </switchingCapabilityDescriptor>
     2953        </link>
     2954        <nextHop>
     2955          3
     2956        </nextHop>
     2957      </hop>
     2958      <hop id="3">
     2959        <link id="urn:publicid:IDN+ion.internet2.edu+interface+rtr.atla:xe-0/1/3:*">
     2960          <trafficEngineeringMetric>
     2961            10
     2962          </trafficEngineeringMetric>
     2963          <capacity>
     2964            100000.0
     2965          </capacity>
     2966          <switchingCapabilityDescriptor>
     2967            <switchingcapType>
     2968              l2sc
     2969            </switchingcapType>
     2970            <encodingType>
     2971              ethernet
     2972            </encodingType>
     2973            <switchingCapabilitySpecificInfo>
     2974              <switchingCapabilitySpecificInfo_L2sc>
     2975                <interfaceMTU>
     2976                  9000
     2977                </interfaceMTU>
     2978                <vlanRangeAvailability>
     2979                  850
     2980                </vlanRangeAvailability>
     2981                <suggestedVLANRange>
     2982                  850
     2983                </suggestedVLANRange>
     2984                <vlanTranslation>
     2985                  true
     2986                </vlanTranslation>
     2987              </switchingCapabilitySpecificInfo_L2sc>
     2988            </switchingCapabilitySpecificInfo>
     2989          </switchingCapabilityDescriptor>
     2990        </link>
     2991        <nextHop>
     2992          4
     2993        </nextHop>
     2994      </hop>
     2995      <hop id="4">
     2996        <link id="urn:publicid:IDN+uky.emulab.net+interface+cisco1:1.2">
     2997          <trafficEngineeringMetric>
     2998            10
     2999          </trafficEngineeringMetric>
     3000          <capacity>
     3001            100000
     3002          </capacity>
     3003          <switchingCapabilityDescriptor>
     3004            <switchingcapType>
     3005              l2sc
     3006            </switchingcapType>
     3007            <encodingType>
     3008              ethernet
     3009            </encodingType>
     3010            <switchingCapabilitySpecificInfo>
     3011              <switchingCapabilitySpecificInfo_L2sc>
     3012                <interfaceMTU>
     3013                  9000
     3014                </interfaceMTU>
     3015                <vlanRangeAvailability>
     3016                  850-859
     3017                </vlanRangeAvailability>
     3018                <suggestedVLANRange>
     3019                  850
     3020                </suggestedVLANRange>
     3021                <vlanTranslation>
     3022                  false
     3023                </vlanTranslation>
     3024              </switchingCapabilitySpecificInfo_L2sc>
     3025            </switchingCapabilitySpecificInfo>
     3026          </switchingCapabilityDescriptor>
     3027        </link>
     3028        <nextHop>
     3029          null
     3030        </nextHop>
     3031      </hop>
     3032    </path>
     3033  </stitching>
     3034</rspec>
     3035
     303611:33:59 INFO     omni:  ------------------------------------------------------------
     303711:33:59 INFO     omni:  Completed listresources:
     3038
     3039  Options as run:
     3040                aggregate: ['i2']
     3041                framework: pg
     3042
     3043  Args: listresources lnstitch
     3044
     3045  Result Summary: Queried resources for slice lnstitch from 1 of 1 aggregate(s).
     3046 
     304711:33:59 INFO     omni:  ============================================================
     3048}}}
     3049
     3050
     3051Now create a second sliver requesting the same VLAN 850 and verify status:
     3052{{{
     3053$ omni.py createsliver -a i2 lnstitch2 ./stitch-ion.rspec
     305411:29:36 INFO     omni: Loading config file /home/lnevers/.gcf/omni_config
     305511:29:36 INFO     omni: Using control framework pg
     305611:29:36 INFO     omni: Substituting AM nickname i2 with URL http://geni-am.net.internet2.edu:12346, URN urn:publicid:IDN+ion.internet2.edu+authority+cm
     305711:29:37 INFO     omni.protogeni: Detected busy result for Get PG slice credential for urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+lnstitch2 from SA https://www.pgeni.gpolab.bbn.com:443/protogeni/xmlrpc/sa. Retrying in 10 seconds.
     305811:29:48 INFO     omni: Slice urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+lnstitch2 expires on 2013-06-12 16:29:01 UTC
     305911:29:48 INFO     omni: Substituting AM nickname i2 with URL http://geni-am.net.internet2.edu:12346, URN urn:publicid:IDN+ion.internet2.edu+authority+cm
     306011:29:48 INFO     omni: Substituting AM nickname i2 with URL http://geni-am.net.internet2.edu:12346, URN urn:publicid:IDN+ion.internet2.edu+authority+cm
     306111:29:48 INFO     omni: Creating sliver(s) from rspec file ./stitch-ion.rspec for slice urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+lnstitch2
     306211:30:32 INFO     omni: Got return from CreateSliver for slice lnstitch2 at http://geni-am.net.internet2.edu:12346:
     306311:30:32 INFO     omni: <!-- Reserved resources for:
     3064        Slice: lnstitch2
     3065        at AM:
     3066        URN: urn:publicid:IDN+ion.internet2.edu+authority+cm
     3067        URL: http://geni-am.net.internet2.edu:12346
     3068 -->
     306911:30:32 INFO     omni: <rspec  xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.geni.net/resources/rspec/3 http://www.geni.net/resources/rspec/3/manifest.xsd" xmlns="http://www.geni.net/resources/rspec/3" expires="2013-06-11T15:30:26.874Z" generated="2013-06-11T15:30:26.874Z" type="manifest"><node client_id="pg-utah" component_manager_id="urn:publicid:IDN+emulab.net+authority+cm" exclusive="false"><sliver_type name="emulab-openvz"/><interface client_id="pg-utah:if0"><ip address="192.168.4.1" netmask="255.255.255.0" type="ipv4"/></interface></node><node client_id="pg-uky" component_manager_id="urn:publicid:IDN+uky.emulab.net+authority+cm" exclusive="false"><sliver_type name="emulab-openvz"/><interface client_id="pg-uky:if0"><ip address="192.168.4.2" netmask="255.255.255.0" type="ipv4"/></interface></node><link client_id="link" sliver_id="urn:publicid:IDN+ion.internet2.edu+sliver+ion.internet2.edu-20011" vlantag="850"><component_manager name="urn:publicid:IDN+emulab.net+authority+cm"/><component_manager name="urn:publicid:IDN+ion.internet2.edu+authority+cm"/><component_manager name="urn:publicid:IDN+uky.emulab.net+authority+cm"/><interface_ref client_id="pg-utah:if0"/><interface_ref client_id="pg-uky:if0"/><property dest_id="pg-uky:if0" source_id="pg-utah:if0"/><property dest_id="pg-utah:if0" source_id="pg-uky:if0"/></link><stitching  xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://hpn.east.isi.edu/rspec/ext/stitch/0.1/ http://hpn.east.isi.edu/rspec/ext/stitch/0.1/stitch-schema.xsd" xmlns="http://hpn.east.isi.edu/rspec/ext/stitch/0.1/" lastUpdateTime="2013-06-11T15:30:26.874Z"><path id="link"><globalId>ion.internet2.edu-20011</globalId><lifetime id="ion.internet2.edu-20011"><start type="xgc">2013-06-12T15:29:52.000Z</start><end type="xgc">2013-06-11T15:30:26.874Z</end></lifetime><hop id="1"><link id="urn:publicid:IDN+emulab.net+interface+procurve-pgeni-atla:3.21"><trafficEngineeringMetric>10</trafficEngineeringMetric><capacity>100000</capacity><switchingCapabilityDescriptor><switchingcapType>l2sc</switchingcapType><encodingType>ethernet</encodingType><switchingCapabilitySpecificInfo><switchingCapabilitySpecificInfo_L2sc><interfaceMTU>9000</interfaceMTU><vlanRangeAvailability>750-1000</vlanRangeAvailability><suggestedVLANRange>850</suggestedVLANRange><vlanTranslation>false</vlanTranslation></switchingCapabilitySpecificInfo_L2sc></switchingCapabilitySpecificInfo></switchingCapabilityDescriptor></link><nextHop>2</nextHop></hop><hop id="2"><link id="urn:publicid:IDN+ion.internet2.edu+interface+rtr.atla:ge-10/3/2:protogeni"><trafficEngineeringMetric>10</trafficEngineeringMetric><capacity>100000.0</capacity><switchingCapabilityDescriptor><switchingcapType>l2sc</switchingcapType><encodingType>ethernet</encodingType><switchingCapabilitySpecificInfo><switchingCapabilitySpecificInfo_L2sc><interfaceMTU>9000</interfaceMTU><vlanRangeAvailability>850</vlanRangeAvailability><suggestedVLANRange>850</suggestedVLANRange><vlanTranslation>true</vlanTranslation></switchingCapabilitySpecificInfo_L2sc></switchingCapabilitySpecificInfo></switchingCapabilityDescriptor></link><nextHop>3</nextHop></hop><hop id="3"><link id="urn:publicid:IDN+ion.internet2.edu+interface+rtr.atla:xe-0/1/3:*"><trafficEngineeringMetric>10</trafficEngineeringMetric><capacity>100000.0</capacity><switchingCapabilityDescriptor><switchingcapType>l2sc</switchingcapType><encodingType>ethernet</encodingType><switchingCapabilitySpecificInfo><switchingCapabilitySpecificInfo_L2sc><interfaceMTU>9000</interfaceMTU><vlanRangeAvailability>850</vlanRangeAvailability><suggestedVLANRange>850</suggestedVLANRange><vlanTranslation>true</vlanTranslation></switchingCapabilitySpecificInfo_L2sc></switchingCapabilitySpecificInfo></switchingCapabilityDescriptor></link><nextHop>4</nextHop></hop><hop id="4"><link id="urn:publicid:IDN+uky.emulab.net+interface+cisco1:1.2"><trafficEngineeringMetric>10</trafficEngineeringMetric><capacity>100000</capacity><switchingCapabilityDescriptor><switchingcapType>l2sc</switchingcapType><encodingType>ethernet</encodingType><switchingCapabilitySpecificInfo><switchingCapabilitySpecificInfo_L2sc><interfaceMTU>9000</interfaceMTU><vlanRangeAvailability>850-859</vlanRangeAvailability><suggestedVLANRange>850</suggestedVLANRange><vlanTranslation>false</vlanTranslation></switchingCapabilitySpecificInfo_L2sc></switchingCapabilitySpecificInfo></switchingCapabilityDescriptor></link><nextHop>null</nextHop></hop></path></stitching></rspec>
     307011:30:32 INFO     omni:  ------------------------------------------------------------
     307111:30:32 INFO     omni:  Completed createsliver:
     3072
     3073  Options as run:
     3074                aggregate: ['i2']
     3075                framework: pg
     3076
     3077  Args: createsliver lnstitch2 ./stitch-ion.rspec
     3078
     3079  Result Summary: Got Reserved resources RSpec from ion-internet2-edu
     308011:30:32 INFO     omni:  ============================================================
     3081
     3082$ omni.py sliverstatus -a i2 lnstitch2                   
     308311:31:51 INFO     omni: Loading config file /home/lnevers/.gcf/omni_config
     308411:31:51 INFO     omni: Using control framework pg
     308511:31:51 INFO     omni: Substituting AM nickname i2 with URL http://geni-am.net.internet2.edu:12346, URN urn:publicid:IDN+ion.internet2.edu+authority+cm
     308611:31:53 INFO     omni: Slice urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+lnstitch2 expires on 2013-06-12 16:29:01 UTC
     308711:31:53 INFO     omni: Substituting AM nickname i2 with URL http://geni-am.net.internet2.edu:12346, URN urn:publicid:IDN+ion.internet2.edu+authority+cm
     308811:31:53 INFO     omni: Status of Slice urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+lnstitch2:
     308911:32:00 INFO     omni: Slice urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+lnstitch2 at AM http://geni-am.net.internet2.edu:12346 has overall SliverStatus: failed
     309011:32:00 INFO     omni: Sliver status for Slice urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+lnstitch2 at AM URL http://geni-am.net.internet2.edu:12346
     309111:32:00 INFO     omni: {
     3092  "geni_resources": [
     3093    {
     3094      "geni_urn": "urn:publicid:IDN+pgeni.gpolab.bbn.com+sliver+lnstitch2_vlan_ion.internet2.edu-20011",
     3095      "geni_error": "VLAN PCE(PCE_CREATE_FAILED): 'There are no VLANs available on link ion.internet2.edu:rtr.atla:xe-0/1/3:*  on reservation ion.internet2.edu-20011 in VLAN PCE'",
     3096      "geni_status": "failed"
     3097    }
     3098  ],
     3099  "geni_expires": "2013-06-12T15:29:52.000Z",
     3100  "geni_urn": "urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+lnstitch2",
     3101  "geni_status": "failed"
     3102}
     310311:32:00 INFO     omni:  ------------------------------------------------------------
     310411:32:00 INFO     omni:  Completed sliverstatus:
     3105
     3106  Options as run:
     3107                aggregate: ['i2']
     3108                framework: pg
     3109
     3110  Args: sliverstatus lnstitch2
     3111
     3112  Result Summary: Slice urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+lnstitch2 expires on 2013-06-12 16:29:01 UTC
     3113Slice urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+lnstitch2 at AM http://geni-am.net.internet2.edu:12346 has overall SliverStatus: failed.
     3114 Returned status of slivers on 1 of 1 possible aggregates.
     311511:32:00 INFO     omni:  ============================================================
     3116}}}
     3117
     3118Failed as expected.
     3119
     3120=== 3.2 Recovery and logging for killed circuit ===
     3121Kill an ION circuit manually, verify recovery and logging of event.
     3122
     3123=== 3.3 Race condition ===
     3124Create a request race condition where two slices (Slice1 and Slice2) request the same resources (AM1 <->VLAN1<->AM2), but Slice1 gets VLAN1 at AM1 and Slice2 gets VLAN1 at AM2. Verify results tools handle the results and properly handle resources.
     3125
     3126=== 3.4 Pseudo loop scenario ===
     3127Request PG Utah to ION to IG GPO. Then request a 2nd interface at PG Utah node to ION to same interface on same node at IG GPO.  If that fails, then request a 2nd interface on that node at IG GPO - that should work.
     3128