Changes between Version 4 and Version 5 of GeniNetworkStitchingConfirmationTestStatus/Utah-stitch


Ignore:
Timestamp:
06/03/15 16:25:00 (9 years ago)
Author:
lnevers@bbn.com
Comment:

--

Legend:

Unmodified
Added
Removed
Modified

  • GeniNetworkStitchingConfirmationTestStatus/Utah-stitch

    v4 v5  
    168168}}}
    169169
    170 Created a slice and a sliver that connected '''Utah DDC IG to GPO IG''':
     170Created a slice and a sliver that connected '''Utah DDC IG to UTC IG''':
    171171{{{
    172172$ stitcher.py createsliver IG-ST-1 IG-ST-1-al2s.rspec -o
    173 14:52:49 INFO    : Configured logging from file /home/lnevers/gcf-2.9/src/gcf/stitcher_logging.conf
    174 14:52:49 INFO    : Reading slice IG-ST-1 credential...
    175 14:52:50 INFO    : Slice urn:publicid:IDN+ch.geni.net:ln-test+slice+IG-ST-1 expires on 2015-06-10 18:52:04 UTC
    176 14:52:50 INFO    : Calling SCS...
    177 14:52:53 INFO    : Multi-AM reservation will include resources from these aggregates:
    178 14:52:53 INFO    :      <Aggregate utah-stitch>
    179 14:52:53 INFO    :      <Aggregate gpo-ig>
    180 14:52:53 INFO    :      <Aggregate al2s>
    181 14:52:53 INFO    :      <Aggregate utahddc-ig>
    182 14:52:53 INFO    : Gathering currently available VLAN tags at <Aggregate utahddc-ig>...
    183 14:52:57 INFO    : Stitcher doing createsliver at <Aggregate utah-stitch>...
    184 14:53:16 INFO    : ... Allocation at <Aggregate utah-stitch> complete.
    185 14:53:16 INFO    : Stitcher doing createsliver at <Aggregate gpo-ig>...
    186 14:53:33 INFO    : ... Allocation at <Aggregate gpo-ig> complete.
    187 14:53:33 INFO    : Stitcher doing createsliver at <Aggregate al2s>...
    188 14:53:38 INFO    : ... Allocation at <Aggregate al2s> complete.
    189 14:53:38 INFO    : Stitcher doing createsliver at <Aggregate utahddc-ig>...
    190 14:53:58 INFO    : ... Allocation at <Aggregate utahddc-ig> complete.
    191 14:53:58 INFO    : All aggregates are complete.
    192 14:53:58 INFO    : Your resources expire at 2015-06-08T18:42:57 (UTC).
    193 14:53:58 INFO    : Saved combined reservation RSpec at 4 AM(s) to file '/home/lnevers/gcf-test/stitch-test/Utah-stitch/IG-ST-1-manifest-rspec-multiam-combined.xml'
     17316:12:31 INFO    : Configured logging from file /home/lnevers/gcf-2.9/src/gcf/stitcher_logging.conf
     17416:12:31 INFO    : Reading slice IG-ST-1 credential...
     17516:12:32 INFO    : Slice urn:publicid:IDN+ch.geni.net:ln-test+slice+IG-ST-1 expires on 2015-06-10 18:52:04 UTC
     17616:12:32 INFO    : Calling SCS...
     17716:12:32 INFO    : Multi-AM reservation will include resources from these aggregates:
     17816:12:32 INFO    :      <Aggregate utc-ig>
     17916:12:32 INFO    :      <Aggregate utah-stitch>
     18016:12:32 INFO    :      <Aggregate al2s>
     18116:12:32 INFO    :      <Aggregate utahddc-ig>
     18216:12:32 INFO    : Gathering currently available VLAN tags at <Aggregate utahddc-ig>...
     18316:12:36 INFO    : Stitcher doing createsliver at <Aggregate utc-ig>...
     18416:12:53 INFO    : ... Allocation at <Aggregate utc-ig> complete.
     18516:12:53 INFO    : Stitcher doing createsliver at <Aggregate utah-stitch>...
     18616:13:11 INFO    : ... Allocation at <Aggregate utah-stitch> complete.
     18716:13:11 INFO    : Stitcher doing createsliver at <Aggregate al2s>...
     18816:13:16 INFO    : ... Allocation at <Aggregate al2s> complete.
     18916:13:16 INFO    : Stitcher doing createsliver at <Aggregate utahddc-ig>...
     19016:13:35 INFO    : ... Allocation at <Aggregate utahddc-ig> complete.
     19116:13:35 INFO    : All aggregates are complete.
     19216:13:35 INFO    : Your resources expire at 2015-06-08T20:02:36 (UTC).
     19316:13:35 INFO    : Saved combined reservation RSpec at 4 AM(s) to file '/home/lnevers/gcf-test/stitch-test/Utah-stitch/IG-ST-1-manifest-rspec-multiam-combined.xml'
    194194Success: Reserved resources in slice IG-ST-1 at 4 Aggregates (including 2 intermediate aggregate(s) not in the original request), creating 1 stitched link(s).
    195195}}}
    … …  
    198198$ readyToLogin --useSliceAggregates IG-ST-1
    199199...
    200 ig-gpo's geni_status is: ready
    201 User lnevers logs in to ig-gpo using:
    202         ssh -p 34874  -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@pc4.instageni.gpolab.bbn.com
     200ig-utc's geni_status is: ready
     201User lnevers logs in to ig-utc using:
     202        ssh -p 30010  -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@pc1.instageni.utc.edu
    203203...
    204204ddc's geni_status is: ready
    205205User lnevers logs in to ddc using:
    206         ssh -p 33594  -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@pc11.utahddc.geniracks.net
    207 }}}
    208 Verified ICMP connectivity by pinging the GPO IG host from the Utha DDC IG host:
    209 {{{
    210 $ remote-execute -a utahddc-ig IG-ST-1 -m "ping -c 5 192.168.1.1"
    211 }}}
    212 
    213 Also verified UDP and TCP connectivity with iperf:
    214 {{{
    215 
    216 XXX
    217 
     206        ssh -p 33594  -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@pc7.utahddc.geniracks.net
     207}}}
     208Verified ICMP, UDP and TCP connectivity from the Utah DDC IG to UTC IG:
     209{{{
     210lnevers@ddc:~$ ping -c 5 -q 192.168.1.1
     211PING 192.168.1.1 (192.168.1.1) 56(84) bytes of data.
     212
     213--- 192.168.1.1 ping statistics ---
     2145 packets transmitted, 5 received, 0% packet loss, time 4007ms
     215rtt min/avg/max/mdev = 54.467/65.530/108.765/21.618 ms
     216lnevers@ddc:~$ iperf -c 192.168.1.1 -t 20
     217------------------------------------------------------------
     218Client connecting to 192.168.1.1, TCP port 5001
     219TCP window size: 23.5 KByte (default)
     220------------------------------------------------------------
     221[  3] local 192.168.1.2 port 58644 connected with 192.168.1.1 port 5001
     222[ ID] Interval       Transfer     Bandwidth
     223[  3]  0.0-20.1 sec  47.2 MBytes  19.7 Mbits/sec
     224lnevers@ddc:~$ iperf -c 192.168.1.1 -t 20 -u -b 1M
     225------------------------------------------------------------
     226Client connecting to 192.168.1.1, UDP port 5001
     227Sending 1470 byte datagrams
     228UDP buffer size:  224 KByte (default)
     229------------------------------------------------------------
     230[  3] local 192.168.1.2 port 46988 connected with 192.168.1.1 port 5001
     231[ ID] Interval       Transfer     Bandwidth
     232[  3]  0.0-20.0 sec  2.39 MBytes  1000 Kbits/sec
     233[  3] Sent 1702 datagrams
     234[  3] Server Report:
     235[  3]  0.0-20.0 sec  2.39 MBytes  1.00 Mbits/sec   0.138 ms    0/ 1702 (0%)
     236lnevers@ddc:~$
    218237}}}
    219238
    220239== IG-ST-2 New Site to GPO IG Loop topology ==
    221240
    222 Create a slice and then create the a sliver that connects two links between '''GPO IG and Utah IG''':
     241Create a slice and then create the a sliver that connects two links between '''NPS IG and Utah IG''':
    223242{{{
    224243$ stitcher.py createsliver IG-ST-2 IG-ST-2.rspec -o
    225 15:06:05 INFO    : Configured logging from file /home/lnevers/gcf-2.9/src/gcf/stitcher_logging.conf
    226 15:06:06 INFO    : Reading slice IG-ST-2 credential...
    227 15:06:06 INFO    : Slice urn:publicid:IDN+ch.geni.net:ln-test+slice+IG-ST-2 expires on 2015-06-10 19:05:18 UTC
    228 15:06:06 INFO    : Calling SCS...
    229 15:06:09 INFO    : Multi-AM reservation will include resources from these aggregates:
    230 15:06:09 INFO    :      <Aggregate utah-stitch>
    231 15:06:09 INFO    :      <Aggregate gpo-ig>
    232 15:06:09 INFO    :      <Aggregate al2s>
    233 15:06:09 INFO    :      <Aggregate utah-ig>
    234 15:06:09 INFO    : Gathering currently available VLAN tags at <Aggregate utah-ig>...
    235 15:06:12 INFO    : Stitcher doing createsliver at <Aggregate utah-stitch>...
    236 15:06:33 INFO    : ... Allocation at <Aggregate utah-stitch> complete.
    237 15:06:33 INFO    : Stitcher doing createsliver at <Aggregate gpo-ig>...
    238 15:06:48 INFO    : ... Allocation at <Aggregate gpo-ig> complete.
    239 15:06:48 INFO    : Stitcher doing createsliver at <Aggregate al2s>...
    240 15:06:55 INFO    : ... Allocation at <Aggregate al2s> complete.
    241 15:06:55 INFO    : Stitcher doing createsliver at <Aggregate utah-ig>...
    242 15:07:11 INFO    : ... Allocation at <Aggregate utah-ig> complete.
    243 15:07:11 INFO    : All aggregates are complete.
    244 15:07:11 INFO    : Your resources expire at 2015-06-08T18:56:12 (UTC).
    245 15:07:11 INFO    : Saved combined reservation RSpec at 4 AM(s) to file '/home/lnevers/gcf-test/stitch-test/Utah-stitch/IG-ST-2-manifest-rspec-multiam-combined.xml'
     24416:12:35 INFO    : Configured logging from file /home/lnevers/gcf-2.9/src/gcf/stitcher_logging.conf
     24516:12:36 INFO    : Reading slice IG-ST-2 credential...
     24616:12:36 INFO    : Slice urn:publicid:IDN+ch.geni.net:ln-test+slice+IG-ST-2 expires on 2015-06-10 19:05:18 UTC
     24716:12:36 INFO    : Calling SCS...
     24816:12:37 INFO    : Multi-AM reservation will include resources from these aggregates:
     24916:12:37 INFO    :      <Aggregate utah-stitch>
     25016:12:37 INFO    :      <Aggregate al2s>
     25116:12:37 INFO    :      <Aggregate nps-ig>
     25216:12:37 INFO    :      <Aggregate utah-ig>
     25316:12:37 INFO    : Gathering currently available VLAN tags at <Aggregate utah-ig>...
     25416:12:40 INFO    : Stitcher doing createsliver at <Aggregate utah-stitch>...
     25516:13:00 INFO    : ... Allocation at <Aggregate utah-stitch> complete.
     25616:13:00 INFO    : Stitcher doing createsliver at <Aggregate nps-ig>...
     25716:13:20 INFO    : ... Allocation at <Aggregate nps-ig> complete.
     25816:13:20 INFO    : Stitcher doing createsliver at <Aggregate al2s>...
     25916:13:22 ERROR   :  {'output': 'Exception: requested VLAN unavailable: sdn-sw.salt.net.internet2.edu,eth7/1 VLAN=3497', 'code': {'geni_code': 24}}
     26016:13:22 INFO    : Deleting some reservations to retry, avoiding failed VLAN...
     26116:13:22 INFO    : Doing deletesliver at <Aggregate utah-stitch>...
     26216:13:47 INFO    : Will put <Aggregate al2s> back in the pool to allocate. Got: Retrying reservations at earlier AMs to avoid unavailable VLAN tag at <Aggregate al2s>....
     26316:13:47 INFO    : Pausing for 30 seconds for Aggregates to free up resources...
     264
     265
     26616:14:17 INFO    : Checking that prior reservation at <Aggregate utah-stitch> has been cleared up....
     26716:14:19 ERROR   :  {'output': 'No slice or aggregate here', 'code': {'protogeni_error_log': 'urn:publicid:IDN+stitch.geniracks.net+log+7ffe2c0afc29a12114a26e281fbcb059', 'am_type': 'protogeni', 'geni_code': 12, 'am_code': 12, 'protogeni_error_url': 'https://www.stitch.geniracks.net/spewlogfile.php3?logfile=7ffe2c0afc29a12114a26e281fbcb059'}, 'value': 0}
     26816:14:19 INFO    : ... it is, so can try a new reservation.
     26916:14:19 INFO    : Stitcher doing createsliver at <Aggregate utah-stitch>...
     27016:14:39 INFO    : ... Allocation at <Aggregate utah-stitch> complete.
     27116:14:39 INFO    : Stitcher doing createsliver at <Aggregate al2s>...
     27216:14:53 INFO    : ... Allocation at <Aggregate al2s> complete.
     27316:14:53 INFO    : Stitcher doing createsliver at <Aggregate utah-ig>...
     27416:15:08 INFO    : ... Allocation at <Aggregate utah-ig> complete.
     27516:15:08 INFO    : All aggregates are complete.
     27616:15:08 INFO    : Your resources expire at 2015-06-08T20:02:40 (UTC).
     27716:15:08 INFO    : Saved combined reservation RSpec at 4 AM(s) to file '/home/lnevers/gcf-test/stitch-test/Utah-stitch/IG-ST-2-manifest-rspec-multiam-combined.xml'
    246278Success: Reserved resources in slice IG-ST-2 at 4 Aggregates (including 2 intermediate aggregate(s) not in the original request), creating 2 stitched link(s).
    247279}}}
    … …  
    251283$ readyToLogin.py IG-ST-2 --useSliceAggregates
    252284  ....
    253 ig-gpo's geni_status is: ready
    254 User lnevers logs in to ig-gpo using:
    255         ssh -p 36154  -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@pc4.instageni.gpolab.bbn.com
    256  ....
     285ig-nps's geni_status is: ready
     286User lnevers logs in to ig-nps using:
     287        ssh -p 31802  -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@pc3.instageni.nps.edu
     288
     289
    257290ig-utah's geni_status is: ready
    258291User lnevers logs in to ig-utah using:
    259292        ssh -p 30010  -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@pc3.utah.geniracks.net
    260 }}}
    261 
    262 Login to GPO host and ping the remote on each of the two interfaces.  Below is the ping output for the GPO site:
    263 {{{
    264 remote-execute.py IG-ST-2 -a gpo-ig -m "ping 10.10.4.2 -c 60 -q ;ping 192.168.4.2 -c 60 -q"
     293
     294}}}
     295
     296From NPS host ping the remote on each of the two interfaces.  Below is the ping output for the GPO site:
     297{{{
     298remote-execute.py IG-ST-2 -a nps-ig -m "ping 10.10.4.2 -c 60 -q ;ping 192.168.4.2 -c 60 -q"
    265299}}}
    266300
    267301== IG-ST-3 IG-ST-3 New Site 3 node linear topology ==
    268302
    269 Create a slice and then create slivers for the topology ''' UTC IG<->PG Utah<-> Utah IG''':
     303Create a slice and then create slivers for the topology ''' Utah PC<->Utah DDC IG<-> Utah IG''':
    270304{{{
    271305$ stitcher.py createsliver IG-ST-3 IG-ST-3.rspec -o
     30616:15:04 INFO    : Configured logging from file /home/lnevers/gcf-2.9/src/gcf/stitcher_logging.conf
     30716:15:05 INFO    : Reading slice IG-ST-3 credential...
     30816:15:05 INFO    : Slice urn:publicid:IDN+ch.geni.net:ln-test+slice+IG-ST-3 expires on 2015-06-10 19:23:31 UTC
     30916:15:05 INFO    : Calling SCS...
     31016:15:06 INFO    : Multi-AM reservation will include resources from these aggregates:
     31116:15:06 INFO    :      <Aggregate utah-stitch>
     31216:15:06 INFO    :      <Aggregate utah-pg>
     31316:15:06 INFO    :      <Aggregate utahddc-ig>
     31416:15:06 INFO    :      <Aggregate utah-ig>
     31516:15:06 INFO    : Gathering currently available VLAN tags at <Aggregate utah-pg>...
     31616:15:27 INFO    : Gathering currently available VLAN tags at <Aggregate utahddc-ig>...
     31716:15:32 INFO    : Gathering currently available VLAN tags at <Aggregate utah-ig>...
     31816:15:34 INFO    : Stitcher doing createsliver at <Aggregate utah-stitch>...
     31916:15:56 INFO    : ... Allocation at <Aggregate utah-stitch> complete.
     32016:15:56 INFO    : Stitcher doing createsliver at <Aggregate utah-pg>...
     32116:16:31 INFO    : ... Allocation at <Aggregate utah-pg> complete.
     32216:16:31 INFO    : Stitcher doing createsliver at <Aggregate utahddc-ig>...
     32316:16:54 INFO    : ... Allocation at <Aggregate utahddc-ig> complete.
     32416:16:54 INFO    : Stitcher doing createsliver at <Aggregate utah-ig>...
     32516:17:09 INFO    : ... Allocation at <Aggregate utah-ig> complete.
     32616:17:09 INFO    : All aggregates are complete.
     32716:17:09 INFO    : Your resources expire at 2015-06-08T20:05:34 (UTC).
     32816:17:09 INFO    : Saved combined reservation RSpec at 4 AM(s) to file '/home/lnevers/gcf-test/stitch-test/Utah-stitch/IG-ST-3-manifest-rspec-multiam-combined.xml'
     329Success: Reserved resources in slice IG-ST-3 at 4 Aggregates (including 1 intermediate aggregate(s) not in the original request), creating 2 stitched link(s).
    272330}}}
    273331
    … …  
    276334$ readyToLogin.py IG-ST-3 --useSliceAggregates
    277335  ....
    278 ig-gpo's geni_status is: ready
    279 User lnevers logs in to ig-gpo using:
    280         ssh -p 36410  -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@pc5.instageni.gpolab.bbn.com
    281  ....
    282 ig-utah's geni_status is: ready
    283 User lnevers logs in to ig-utah using:
    284         ssh -p 30522  -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@pc3.utah.geniracks.net
    285  ....
    286 pg-utah's geni_status is: failed
    287 User lnevers logs in to pg-utah using:
    288         ssh -p 30778  -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@pc534.emulab.net
    289 
    290 }}}
    291 Login to the Emulab host and ping each remote:
     336
     337}}}
     338Login to the Utah DDC IG host and pinged each remote:
    292339{{{
    293340#ping GPO IG