[[PageOutline]]

= Utah Stitching Aggregate Confirmation Tests =

This pages capture the detailed test logs for each test defined in the [wiki:GeniNetworkStitchingConfirmationTests New Site Stitching Confirmation Tests] page. For the sites status see the [wiki:GeniNetworkStitchingConfirmationTestStatus New Site Stitching Confirmation Tests Status] page.

''*** Note that the Utah Stitching Aggregate (aka utah-stitch) is part of the network path for all experiments on this page ***''


== IG-ST-1 New Site to GPO IG topology ==

The Utah Stitch aggregate site advertises the following stitching details:
{{{
<stitching xmlns="http://hpn.east.isi.edu/rspec/ext/stitch/0.1/" lastUpdateTime="2015-06-03T18:48:37Z" >
<aggregate id="urn:publicid:IDN+stitch.geniracks.net+authority+cm" url="https://www.stitch.geniracks.net:12369/protogeni/xmlrpc/am">
<aggregatetype>protogeni</aggregatetype>
<stitchingmode>chainANDTree</stitchingmode>
<scheduledservices>false</scheduledservices>
<negotiatedservices>false</negotiatedservices>
<lifetime id="life">
    <start type="time">2015-06-03T18:48:37Z</start>
    <end type="time">2015-06-03T18:48:37Z</end>
</lifetime>
<node id="urn:publicid:IDN+stitch.geniracks.net+node+procurveA">
  <port id="urn:publicid:IDN+stitch.geniracks.net+stitchport+procurveA:3.19">
    <capacity>1000000</capacity>
    <maximumReservableCapacity>1000000</maximumReservableCapacity>
    <minimumReservableCapacity>1000</minimumReservableCapacity>
    <granularity>1</granularity>
    <link id="urn:publicid:IDN+stitch.geniracks.net+interface+procurveA:3.19">
      <remoteLinkId>urn:publicid:IDN+utah.geniracks.net+interface+procurve2:1.19</remoteLinkId>
      <trafficEngineeringMetric>10</trafficEngineeringMetric>
      <capacity>1000000</capacity>
      <maximumReservableCapacity>1000000</maximumReservableCapacity>
      <minimumReservableCapacity>1000</minimumReservableCapacity>
      <granularity>1</granularity>
      <switchingCapabilityDescriptor>
        <switchingcapType>l2sc</switchingcapType>
        <encodingType>ethernet</encodingType>
        <switchingCapabilitySpecificInfo>
         <switchingCapabilitySpecificInfo_L2sc>
          <interfaceMTU>1500</interfaceMTU>
          <vlanRangeAvailability>2100-3499</vlanRangeAvailability>
          <vlanTranslation>false</vlanTranslation>
         </switchingCapabilitySpecificInfo_L2sc>
        </switchingCapabilitySpecificInfo>
      </switchingCapabilityDescriptor>
    </link>
  </port>
  <port id="urn:publicid:IDN+stitch.geniracks.net+stitchport+procurveA:1.5">
    <capacity>1000000</capacity>
    <maximumReservableCapacity>1000000</maximumReservableCapacity>
    <minimumReservableCapacity>1000</minimumReservableCapacity>
    <granularity>1</granularity>
    <link id="urn:publicid:IDN+stitch.geniracks.net+interface+procurveA:1.5">
      <remoteLinkId>urn:publicid:IDN+emulab.net+interface+procurve1:7.2</remoteLinkId>
      <trafficEngineeringMetric>10</trafficEngineeringMetric>
      <capacity>1000000</capacity>
      <maximumReservableCapacity>1000000</maximumReservableCapacity>
      <minimumReservableCapacity>1000</minimumReservableCapacity>
      <granularity>1</granularity>
      <switchingCapabilityDescriptor>
        <switchingcapType>l2sc</switchingcapType>
        <encodingType>ethernet</encodingType>
        <switchingCapabilitySpecificInfo>
         <switchingCapabilitySpecificInfo_L2sc>
          <interfaceMTU>1500</interfaceMTU>
          <vlanRangeAvailability>2100-3499</vlanRangeAvailability>
          <vlanTranslation>false</vlanTranslation>
         </switchingCapabilitySpecificInfo_L2sc>
        </switchingCapabilitySpecificInfo>
      </switchingCapabilityDescriptor>
    </link>
  </port>
</node>
<node id="urn:publicid:IDN+stitch.geniracks.net+node+scidmz">
  <port id="urn:publicid:IDN+stitch.geniracks.net+stitchport+scidmz:3.3">
    <capacity>1000000</capacity>
    <maximumReservableCapacity>1000000</maximumReservableCapacity>
    <minimumReservableCapacity>1000</minimumReservableCapacity>
    <granularity>1</granularity>
    <link id="urn:publicid:IDN+stitch.geniracks.net+interface+scidmz:3.3">
      <remoteLinkId>urn:publicid:IDN+utahddc.geniracks.net+interface+procurve2:2.22</remoteLinkId>
      <trafficEngineeringMetric>10</trafficEngineeringMetric>
      <capacity>1000000</capacity>
      <maximumReservableCapacity>1000000</maximumReservableCapacity>
      <minimumReservableCapacity>1000</minimumReservableCapacity>
      <granularity>1</granularity>
      <switchingCapabilityDescriptor>
        <switchingcapType>l2sc</switchingcapType>
        <encodingType>ethernet</encodingType>
        <switchingCapabilitySpecificInfo>
         <switchingCapabilitySpecificInfo_L2sc>
          <interfaceMTU>1500</interfaceMTU>
          <vlanRangeAvailability>2100-3499</vlanRangeAvailability>
          <vlanTranslation>false</vlanTranslation>
         </switchingCapabilitySpecificInfo_L2sc>
        </switchingCapabilitySpecificInfo>
      </switchingCapabilityDescriptor>
    </link>
  </port>
  <port id="urn:publicid:IDN+stitch.geniracks.net+stitchport+scidmz:2.4">
    <capacity>1000000</capacity>
    <maximumReservableCapacity>1000000</maximumReservableCapacity>
    <minimumReservableCapacity>1000</minimumReservableCapacity>
    <granularity>1</granularity>
    <link id="urn:publicid:IDN+stitch.geniracks.net+interface+scidmz:2.4">
      <remoteLinkId>urn:publicid:IDN+utah.cloudlab.us+interface+bighp1:4.21</remoteLinkId>
      <trafficEngineeringMetric>10</trafficEngineeringMetric>
      <capacity>1000000</capacity>
      <maximumReservableCapacity>1000000</maximumReservableCapacity>
      <minimumReservableCapacity>1000</minimumReservableCapacity>
      <granularity>1</granularity>
      <switchingCapabilityDescriptor>
        <switchingcapType>l2sc</switchingcapType>
        <encodingType>ethernet</encodingType>
        <switchingCapabilitySpecificInfo>
         <switchingCapabilitySpecificInfo_L2sc>
          <interfaceMTU>1500</interfaceMTU>
          <vlanRangeAvailability>2100-3499</vlanRangeAvailability>
          <vlanTranslation>false</vlanTranslation>
         </switchingCapabilitySpecificInfo_L2sc>
        </switchingCapabilitySpecificInfo>
      </switchingCapabilityDescriptor>
    </link>
  </port>
  <port id="urn:publicid:IDN+stitch.geniracks.net+stitchport+scidmz:1.2.al2s">
    <capacity>1000000</capacity>
    <maximumReservableCapacity>1000000</maximumReservableCapacity>
    <minimumReservableCapacity>1000</minimumReservableCapacity>
    <granularity>1</granularity>
    <link id="urn:publicid:IDN+stitch.geniracks.net+interface+scidmz:1.2.al2s">
      <remoteLinkId>urn:publicid:IDN+al2s.internet2.edu+interface+sdn-sw.salt.net.internet2.edu:eth7/1:utah-stitch</remoteLinkId>
      <trafficEngineeringMetric>10</trafficEngineeringMetric>
      <capacity>1000000</capacity>
      <maximumReservableCapacity>1000000</maximumReservableCapacity>
      <minimumReservableCapacity>1000</minimumReservableCapacity>
      <granularity>1</granularity>
      <switchingCapabilityDescriptor>
        <switchingcapType>l2sc</switchingcapType>
        <encodingType>ethernet</encodingType>
        <switchingCapabilitySpecificInfo>
         <switchingCapabilitySpecificInfo_L2sc>
          <interfaceMTU>1500</interfaceMTU>
          <vlanRangeAvailability>2100-3499</vlanRangeAvailability>
          <vlanTranslation>false</vlanTranslation>
         </switchingCapabilitySpecificInfo_L2sc>
        </switchingCapabilitySpecificInfo>
      </switchingCapabilityDescriptor>
    </link>
  </port>
</node>
</aggregate>
</stitching>
}}}

Verified that Utah IG, Utah DDC IG, PG Utah and !CloudLab advertise the same VLAN range:
{{{
rspec-emulab-net.xml:                    <vlanRangeAvailability>2100-3499</vlanRangeAvailability>
rspec-stitch-geniracks-net.xml:          <vlanRangeAvailability>2100-3499</vlanRangeAvailability>
rspec-stitch-geniracks-net.xml:          <vlanRangeAvailability>2100-3499</vlanRangeAvailability>
rspec-stitch-geniracks-net.xml:          <vlanRangeAvailability>2100-3499</vlanRangeAvailability>
rspec-stitch-geniracks-net.xml:          <vlanRangeAvailability>2100-3499</vlanRangeAvailability>
rspec-stitch-geniracks-net.xml:          <vlanRangeAvailability>2100-3499</vlanRangeAvailability>
rspec-utah-cloudlab-us.xml:              <vlanRangeAvailability>2100-3499</vlanRangeAvailability>
rspec-utah-geniracks-net.xml:            <vlanRangeAvailability>2100-3499</vlanRangeAvailability>
rspec-utahddc-geniracks-net.xml:          <vlanRangeAvailability>2100-3499</vlanRangeAvailability>
}}}

Created a slice and a sliver that connected '''Utah DDC IG to UTC IG''':
{{{
$ stitcher.py createsliver IG-ST-1 IG-ST-1-al2s.rspec -o
16:12:31 INFO    : Configured logging from file /home/lnevers/gcf-2.9/src/gcf/stitcher_logging.conf
16:12:31 INFO    : Reading slice IG-ST-1 credential...
16:12:32 INFO    : Slice urn:publicid:IDN+ch.geni.net:ln-test+slice+IG-ST-1 expires on 2015-06-10 18:52:04 UTC
16:12:32 INFO    : Calling SCS...
16:12:32 INFO    : Multi-AM reservation will include resources from these aggregates:
16:12:32 INFO    : 	<Aggregate utc-ig>
16:12:32 INFO    : 	<Aggregate utah-stitch>
16:12:32 INFO    : 	<Aggregate al2s>
16:12:32 INFO    : 	<Aggregate utahddc-ig>
16:12:32 INFO    : Gathering currently available VLAN tags at <Aggregate utahddc-ig>...
16:12:36 INFO    : Stitcher doing createsliver at <Aggregate utc-ig>...
16:12:53 INFO    : ... Allocation at <Aggregate utc-ig> complete.
16:12:53 INFO    : Stitcher doing createsliver at <Aggregate utah-stitch>...
16:13:11 INFO    : ... Allocation at <Aggregate utah-stitch> complete.
16:13:11 INFO    : Stitcher doing createsliver at <Aggregate al2s>...
16:13:16 INFO    : ... Allocation at <Aggregate al2s> complete.
16:13:16 INFO    : Stitcher doing createsliver at <Aggregate utahddc-ig>...
16:13:35 INFO    : ... Allocation at <Aggregate utahddc-ig> complete.
16:13:35 INFO    : All aggregates are complete.
16:13:35 INFO    : Your resources expire at 2015-06-08T20:02:36 (UTC). 
16:13:35 INFO    : Saved combined reservation RSpec at 4 AM(s) to file '/home/lnevers/gcf-test/stitch-test/Utah-stitch/IG-ST-1-manifest-rspec-multiam-combined.xml'
Success: Reserved resources in slice IG-ST-1 at 4 Aggregates (including 2 intermediate aggregate(s) not in the original request), creating 1 stitched link(s).
}}}
Determine login for endpoints:
{{{
$ readyToLogin --useSliceAggregates IG-ST-1
...
ig-utc's geni_status is: ready 
User lnevers logs in to ig-utc using:
	ssh -p 30010  -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@pc1.instageni.utc.edu
...
ddc's geni_status is: ready 
User lnevers logs in to ddc using:
	ssh -p 33594  -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@pc7.utahddc.geniracks.net
}}}
Verified ICMP, UDP and TCP connectivity from the Utah DDC IG to UTC IG:
{{{
lnevers@ddc:~$ ping -c 5 -q 192.168.1.1
PING 192.168.1.1 (192.168.1.1) 56(84) bytes of data.

--- 192.168.1.1 ping statistics ---
5 packets transmitted, 5 received, 0% packet loss, time 4007ms
rtt min/avg/max/mdev = 54.467/65.530/108.765/21.618 ms
lnevers@ddc:~$ iperf -c 192.168.1.1 -t 20
------------------------------------------------------------
Client connecting to 192.168.1.1, TCP port 5001
TCP window size: 23.5 KByte (default)
------------------------------------------------------------
[  3] local 192.168.1.2 port 58644 connected with 192.168.1.1 port 5001
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-20.1 sec  47.2 MBytes  19.7 Mbits/sec
lnevers@ddc:~$ iperf -c 192.168.1.1 -t 20 -u -b 1M
------------------------------------------------------------
Client connecting to 192.168.1.1, UDP port 5001
Sending 1470 byte datagrams
UDP buffer size:  224 KByte (default)
------------------------------------------------------------
[  3] local 192.168.1.2 port 46988 connected with 192.168.1.1 port 5001
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-20.0 sec  2.39 MBytes  1000 Kbits/sec
[  3] Sent 1702 datagrams
[  3] Server Report:
[  3]  0.0-20.0 sec  2.39 MBytes  1.00 Mbits/sec   0.138 ms    0/ 1702 (0%)
lnevers@ddc:~$ 
}}}

== IG-ST-2 New Site to GPO IG Loop topology ==

Create a slice and then create the a sliver that connects two links between '''NPS IG and Utah IG''':
{{{
$ stitcher.py createsliver IG-ST-2 IG-ST-2.rspec -o
16:12:35 INFO    : Configured logging from file /home/lnevers/gcf-2.9/src/gcf/stitcher_logging.conf
16:12:36 INFO    : Reading slice IG-ST-2 credential...
16:12:36 INFO    : Slice urn:publicid:IDN+ch.geni.net:ln-test+slice+IG-ST-2 expires on 2015-06-10 19:05:18 UTC
16:12:36 INFO    : Calling SCS...
16:12:37 INFO    : Multi-AM reservation will include resources from these aggregates:
16:12:37 INFO    : 	<Aggregate utah-stitch>
16:12:37 INFO    : 	<Aggregate al2s>
16:12:37 INFO    : 	<Aggregate nps-ig>
16:12:37 INFO    : 	<Aggregate utah-ig>
16:12:37 INFO    : Gathering currently available VLAN tags at <Aggregate utah-ig>...
16:12:40 INFO    : Stitcher doing createsliver at <Aggregate utah-stitch>...
16:13:00 INFO    : ... Allocation at <Aggregate utah-stitch> complete.
16:13:00 INFO    : Stitcher doing createsliver at <Aggregate nps-ig>...
16:13:20 INFO    : ... Allocation at <Aggregate nps-ig> complete.
16:13:20 INFO    : Stitcher doing createsliver at <Aggregate al2s>...
16:13:22 ERROR   :  {'output': 'Exception: requested VLAN unavailable: sdn-sw.salt.net.internet2.edu,eth7/1 VLAN=3497', 'code': {'geni_code': 24}}
16:13:22 INFO    : Deleting some reservations to retry, avoiding failed VLAN...
16:13:22 INFO    : Doing deletesliver at <Aggregate utah-stitch>...
16:13:47 INFO    : Will put <Aggregate al2s> back in the pool to allocate. Got: Retrying reservations at earlier AMs to avoid unavailable VLAN tag at <Aggregate al2s>....
16:13:47 INFO    : Pausing for 30 seconds for Aggregates to free up resources...


16:14:17 INFO    : Checking that prior reservation at <Aggregate utah-stitch> has been cleared up....
16:14:19 ERROR   :  {'output': 'No slice or aggregate here', 'code': {'protogeni_error_log': 'urn:publicid:IDN+stitch.geniracks.net+log+7ffe2c0afc29a12114a26e281fbcb059', 'am_type': 'protogeni', 'geni_code': 12, 'am_code': 12, 'protogeni_error_url': 'https://www.stitch.geniracks.net/spewlogfile.php3?logfile=7ffe2c0afc29a12114a26e281fbcb059'}, 'value': 0}
16:14:19 INFO    : ... it is, so can try a new reservation.
16:14:19 INFO    : Stitcher doing createsliver at <Aggregate utah-stitch>...
16:14:39 INFO    : ... Allocation at <Aggregate utah-stitch> complete.
16:14:39 INFO    : Stitcher doing createsliver at <Aggregate al2s>...
16:14:53 INFO    : ... Allocation at <Aggregate al2s> complete.
16:14:53 INFO    : Stitcher doing createsliver at <Aggregate utah-ig>...
16:15:08 INFO    : ... Allocation at <Aggregate utah-ig> complete.
16:15:08 INFO    : All aggregates are complete.
16:15:08 INFO    : Your resources expire at 2015-06-08T20:02:40 (UTC). 
16:15:08 INFO    : Saved combined reservation RSpec at 4 AM(s) to file '/home/lnevers/gcf-test/stitch-test/Utah-stitch/IG-ST-2-manifest-rspec-multiam-combined.xml'
Success: Reserved resources in slice IG-ST-2 at 4 Aggregates (including 2 intermediate aggregate(s) not in the original request), creating 2 stitched link(s).
}}}

Determined login information at each aggregate:
{{{
$ readyToLogin.py IG-ST-2 --useSliceAggregates
  ....
ig-nps's geni_status is: ready 
User lnevers logs in to ig-nps using:
	ssh -p 31802  -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@pc3.instageni.nps.edu


ig-utah's geni_status is: ready 
User lnevers logs in to ig-utah using:
	ssh -p 30010  -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@pc3.utah.geniracks.net

}}}

From NPS host ping the remote on each of the two interfaces.  Below is the ping output for the GPO site:
{{{
$ remote-execute.py IG-ST-2 -a nps-ig -m "ping 10.10.4.2 -c 60 -q ;ping 192.168.4.2 -c 60 -q"
1. Find login Info for hosts in slice IG-ST-2
Key file [/home/lnevers/.ssh/lnevers-id_rsa] does NOT exist.
2. Send command 'ping 10.10.4.2 -c 60 -q ;ping 192.168.4.2 -c 60 -q' to ig-nps

PING 10.10.4.2 (10.10.4.2) 56(84) bytes of data.

--- 10.10.4.2 ping statistics ---
60 packets transmitted, 60 received, 0% packet loss, time 59099ms
rtt min/avg/max/mdev = 21.530/22.291/44.761/3.030 ms
PING 192.168.4.2 (192.168.4.2) 56(84) bytes of data.

--- 192.168.4.2 ping statistics ---
60 packets transmitted, 60 received, 0% packet loss, time 59103ms
rtt min/avg/max/mdev = 21.435/22.187/45.988/3.109 ms
... Done with command 'ping 10.10.4.2 -c 60 -q ;ping 192.168.4.2 -c 60 -q' at ig-nps
$
}}}

== IG-ST-3 IG-ST-3 New Site 3 node linear topology ==

Create a slice and then create slivers for the topology ''' Utah PG<->Utah DDC IG<-> Utah IG''':
{{{
$ stitcher.py createsliver IG-ST-3 IG-ST-3.rspec -o
16:15:04 INFO    : Configured logging from file /home/lnevers/gcf-2.9/src/gcf/stitcher_logging.conf
16:15:05 INFO    : Reading slice IG-ST-3 credential...
16:15:05 INFO    : Slice urn:publicid:IDN+ch.geni.net:ln-test+slice+IG-ST-3 expires on 2015-06-10 19:23:31 UTC
16:15:05 INFO    : Calling SCS...
16:15:06 INFO    : Multi-AM reservation will include resources from these aggregates:
16:15:06 INFO    : 	<Aggregate utah-stitch>
16:15:06 INFO    : 	<Aggregate utah-pg>
16:15:06 INFO    : 	<Aggregate utahddc-ig>
16:15:06 INFO    : 	<Aggregate utah-ig>
16:15:06 INFO    : Gathering currently available VLAN tags at <Aggregate utah-pg>...
16:15:27 INFO    : Gathering currently available VLAN tags at <Aggregate utahddc-ig>...
16:15:32 INFO    : Gathering currently available VLAN tags at <Aggregate utah-ig>...
16:15:34 INFO    : Stitcher doing createsliver at <Aggregate utah-stitch>...
16:15:56 INFO    : ... Allocation at <Aggregate utah-stitch> complete.
16:15:56 INFO    : Stitcher doing createsliver at <Aggregate utah-pg>...
16:16:31 INFO    : ... Allocation at <Aggregate utah-pg> complete.
16:16:31 INFO    : Stitcher doing createsliver at <Aggregate utahddc-ig>...
16:16:54 INFO    : ... Allocation at <Aggregate utahddc-ig> complete.
16:16:54 INFO    : Stitcher doing createsliver at <Aggregate utah-ig>...
16:17:09 INFO    : ... Allocation at <Aggregate utah-ig> complete.
16:17:09 INFO    : All aggregates are complete.
16:17:09 INFO    : Your resources expire at 2015-06-08T20:05:34 (UTC). 
16:17:09 INFO    : Saved combined reservation RSpec at 4 AM(s) to file '/home/lnevers/gcf-test/stitch-test/Utah-stitch/IG-ST-3-manifest-rspec-multiam-combined.xml'
Success: Reserved resources in slice IG-ST-3 at 4 Aggregates (including 1 intermediate aggregate(s) not in the original request), creating 2 stitched link(s).
}}}

Determined login information the each aggregate:
{{{
$ readyToLogin.py IG-ST-3 --useSliceAggregates 
  ....
ddc's geni_status is: ready 
User lnevers logs in to ddc using:
	ssh -p 33850  -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@pc4.utahddc.geniracks.net
...
ig-utah's geni_status is: ready 
User lnevers logs in to ig-utah using:
	ssh -p 30522  -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@pc3.utah.geniracks.net
...
pg-utah's geni_status is: ready 
User lnevers logs in to pg-utah using:
	ssh -p 30778  -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@pc430.emulab.net

}}}
Login to the Utah DDC IG host and pinged each remote:
{{{
#ping Utah PG
lnevers@ddc:~$ ping 192.168.2.1 -c 20 -q
PING 192.168.2.1 (192.168.2.1) 56(84) bytes of data.

--- 192.168.2.1 ping statistics ---
20 packets transmitted, 20 received, 0% packet loss, time 19023ms
rtt min/avg/max/mdev = 0.899/1.191/2.267/0.259 ms

# Utah IG

lnevers@ddc:~$ ping 192.168.4.1 -c 20 -q
PING 192.168.4.1 (192.168.4.1) 56(84) bytes of data.

--- 192.168.4.1 ping statistics ---
20 packets transmitted, 20 received, 0% packet loss, time 19025ms
rtt min/avg/max/mdev = 0.982/1.108/1.847/0.175 ms
lnevers@ddc:~$ 
}}}

== IG-ST-4 New Site to GPO EG interoperability ==
Create a slice and then sliver to connect '''EG GPO to Utah IG'''
{{{
$ stitcher.py createsliver IG-ST-4 IG-ST-4.rspec -o
15:34:07 INFO    : Configured logging from file /home/lnevers/gcf-2.9/src/gcf/stitcher_logging.conf
15:34:08 INFO    : Reading slice IG-ST-4 credential...
15:34:08 INFO    : Slice urn:publicid:IDN+ch.geni.net:ln-test+slice+IG-ST-4 expires on 2015-06-10 19:34:03 UTC
15:34:08 INFO    : Calling SCS...
15:34:09 INFO    : Multi-AM reservation will include resources from these aggregates:
15:34:09 INFO    : 	<Aggregate utah-stitch>
15:34:09 INFO    : 	<Aggregate al2s>
15:34:09 INFO    : 	<Aggregate gpo-eg>
15:34:09 INFO    : 	<Aggregate utah-ig>
15:34:09 INFO    : Gathering currently available VLAN tags at <Aggregate utah-ig>...
15:34:12 INFO    : Stitcher doing createsliver at <Aggregate utah-stitch>...
15:34:32 INFO    : ... Allocation at <Aggregate utah-stitch> complete.
15:34:32 INFO    : Stitcher doing createsliver at <Aggregate gpo-eg>...
15:34:42 INFO    : ... Allocation at <Aggregate gpo-eg> complete.
15:34:42 INFO    : Stitcher doing createsliver at <Aggregate al2s>...
15:34:44 ERROR   :  {'output': 'Exception: requested VLAN unavailable: sdn-sw.salt.net.internet2.edu,eth7/1 VLAN=2754', 'code': {'geni_code': 24}}
15:34:44 INFO    : Deleting some reservations to retry, avoiding failed VLAN...
15:34:44 INFO    : Doing deletesliver at <Aggregate utah-stitch>...
15:35:09 INFO    : Will put <Aggregate al2s> back in the pool to allocate. Got: Retrying reservations at earlier AMs to avoid unavailable VLAN tag at <Aggregate al2s>....
15:35:09 INFO    : Pausing for 30 seconds for Aggregates to free up resources...


15:35:39 INFO    : Checking that prior reservation at <Aggregate utah-stitch> has been cleared up....
15:35:41 ERROR   :  {'output': 'No slice or aggregate here', 'code': {'protogeni_error_log': 'urn:publicid:IDN+stitch.geniracks.net+log+9877b4a4ae8e49358df28c56b8ec89ef', 'am_type': 'protogeni', 'geni_code': 12, 'am_code': 12, 'protogeni_error_url': 'https://www.stitch.geniracks.net/spewlogfile.php3?logfile=9877b4a4ae8e49358df28c56b8ec89ef'}, 'value': 0}
15:35:41 INFO    : ... it is, so can try a new reservation.
15:35:41 INFO    : Stitcher doing createsliver at <Aggregate utah-stitch>...
15:36:01 INFO    : ... Allocation at <Aggregate utah-stitch> complete.
15:36:01 INFO    : Stitcher doing createsliver at <Aggregate al2s>...
15:36:05 INFO    : ... Allocation at <Aggregate al2s> complete.
15:36:05 INFO    : Stitcher doing createsliver at <Aggregate utah-ig>...
15:36:20 INFO    : ... Allocation at <Aggregate utah-ig> complete.
15:36:20 INFO    : All aggregates are complete.
15:36:20 INFO    : Your resources expire at 2015-06-08T19:24:12 (UTC). 
15:36:20 INFO    : Saved combined reservation RSpec at 4 AM(s) to file '/home/lnevers/gcf-test/stitch-test/Utah-stitch/IG-ST-4-manifest-rspec-multiam-combined.xml'
Success: Reserved resources in slice IG-ST-4 at 4 Aggregates (including 2 intermediate aggregate(s) not in the original request), creating 1 stitched link(s).
}}}
Determined login information at each VirginiaTech and GPO aggregate:
{{{
$ readyToLogin.py IG-ST-4 --useSliceAggregates
  ....
eg-gpo's geni_status is: ready 
User lnevers logs in to eg-gpo using:
	ssh -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@192.1.242.31
...
ig-utah's geni_status is: ready 
User lnevers logs in to ig-utah using:
	ssh -p 31290  -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@pc3.utah.geniracks.net
}}}

Verify the sites can exchange ICMP, TCP and UDP traffic:
{{{
lnevers@eg-gpo:~$ ping 192.168.1.2 -c 5 -q
PING 192.168.1.2 (192.168.1.2) 56(84) bytes of data.

--- 192.168.1.2 ping statistics ---
5 packets transmitted, 5 received, 0% packet loss, time 4007ms
rtt min/avg/max/mdev = 59.579/59.779/59.891/0.194 ms
lnevers@eg-gpo:~$ 
lnevers@eg-gpo:~$ iperf -c 192.168.1.2 -t 20
------------------------------------------------------------
Client connecting to 192.168.1.2, TCP port 5001
TCP window size: 85.0 KByte (default)
------------------------------------------------------------
[  3] local 192.168.1.1 port 36274 connected with 192.168.1.2 port 5001
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-20.0 sec  46.9 MBytes  19.7 Mbits/sec
lnevers@eg-gpo:~$ iperf -c 192.168.1.2 -t 20 -u -b 1M
------------------------------------------------------------
Client connecting to 192.168.1.2, UDP port 5001
Sending 1470 byte datagrams
UDP buffer size:  208 KByte (default)
------------------------------------------------------------
[  3] local 192.168.1.1 port 59077 connected with 192.168.1.2 port 5001
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-20.0 sec  2.39 MBytes  1000 Kbits/sec
[  3] Sent 1702 datagrams
[  3] Server Report:
[  3]  0.0-20.0 sec  2.39 MBytes  1.00 Mbits/sec   0.132 ms    0/ 1702 (0%)
lnevers@eg-gpo:~$ 
}}}


== IG-ST-5 Site Information ==

Various pages include stitching information for a site.  Each of the following were verified for this site:

 1. Verified that stitching VLANs and Device URN information exists in the [http://groups.geni.net/geni/wiki/GeniAggregate/UtahStitch#GENINetworkStitching Utah Stitching Aggregate] page.

 2. Verified that Delegated GENI Stitching VLANs for site are documented at the [https://wiki.maxgigapop.net/twiki/bin/view/GENI/StaticNetworksView Delegated GENI Stitching VLANs].


== IG-ST-6 New Site !OpenFlow topology ==

Create a slice and then create the stitched slivers using !OpenFlow between the '''Utah DDC IG site and the GPO IG''' site:
{{{
$ stitcher.py createsliver IG-ST-6 IG-ST-6.rspec -o
16:33:43 INFO    : Configured logging from file /home/lnevers/gcf-2.9/src/gcf/stitcher_logging.conf
16:33:43 INFO    : Reading slice IG-ST-6 credential...
16:33:44 INFO    : Slice urn:publicid:IDN+ch.geni.net:ln-test+slice+IG-ST-6 expires on 2015-06-10 20:33:37 UTC
16:33:44 INFO    : Calling SCS...
16:33:45 INFO    : Multi-AM reservation will include resources from these aggregates:
16:33:45 INFO    : 	<Aggregate utah-stitch>
16:33:45 INFO    : 	<Aggregate gpo-ig>
16:33:45 INFO    : 	<Aggregate al2s>
16:33:45 INFO    : 	<Aggregate utahddc-ig>
16:33:45 INFO    : Gathering currently available VLAN tags at <Aggregate utahddc-ig>...
16:33:49 INFO    : Stitcher doing createsliver at <Aggregate utah-stitch>...
16:34:08 INFO    : ... Allocation at <Aggregate utah-stitch> complete.
16:34:08 INFO    : Stitcher doing createsliver at <Aggregate gpo-ig>...
16:34:22 INFO    : ... Allocation at <Aggregate gpo-ig> complete.
16:34:22 INFO    : Stitcher doing createsliver at <Aggregate al2s>...
16:34:27 INFO    : ... Allocation at <Aggregate al2s> complete.
16:34:27 INFO    : Stitcher doing createsliver at <Aggregate utahddc-ig>...
16:34:47 INFO    : ... Allocation at <Aggregate utahddc-ig> complete.
16:34:47 INFO    : All aggregates are complete.
16:34:47 INFO    : Your resources expire at 2015-06-08T20:23:49 (UTC). 
16:34:47 INFO    : Saved combined reservation RSpec at 4 AM(s) to file '/home/lnevers/gcf-test/stitch-test/Utah-stitch/IG-ST-6-manifest-rspec-multiam-combined.xml'
Success: Reserved resources in slice IG-ST-6 at 4 Aggregates (including 2 intermediate aggregate(s) not in the original request), creating 1 stitched link(s).
}}}

Determined login information at each VirginiaTech and GPO aggregate:
{{{
$ readyToLogin.py IG-ST-6 --useSliceAggregates
  ....
ig-gpo's geni_status is: changing 
User lnevers logs in to ig-gpo using:
	ssh -p 34874  -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@pc5.instageni.gpolab.bbn.com

...
ddc's geni_status is: ready 
User lnevers logs in to ddc using:
	ssh -p 34362  -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@pc4.utahddc.geniracks.net

}}}
Could not verify connectivity between Endpoint over !OpenFlow over GENI Stitched Connection:
{{{

}}}
== IG-CT-5 Site Monitoring ==

Checked for [http://genimon.uky.edu/ GENI Monitoring System] 

[[Image(UtahStitch-genimon-aggregates.jpg)]]

Aggregate availability:

[[Image(UtahStitch-genimon-avail.jpg, 80%)]]

External Checks for site aggregates: No external checks exist for this network aggregate.