Changes between Initial Version and Version 1 of GENIExperimenter/Tutorials/SystematicExprCaseStudy/ScalingUp/DesignSetup


Ignore:
Timestamp:
08/13/14 11:29:41 (10 years ago)
Author:
xliu@bbn.com
Comment:

--

Legend:

Unmodified
Added
Removed
Modified

  • GENIExperimenter/Tutorials/SystematicExprCaseStudy/ScalingUp/DesignSetup

    v1 v1  
     1[[PageOutline]]
     2
     3'''[http://groups.geni.net/syseng/wiki/XuanSandbox#ATutorialonSystematicExperimentalDesign A Tutorial on Systematic Experimental Design]'''
     4
     5'''[http://groups.geni.net/syseng/wiki/XuanSandbox/InstallSoftware Step I: Single Node]'''
     6
     7'''[http://groups.geni.net/syseng/wiki/XuanSandbox/SmallTopo Step II: Small Topology]'''
     8
     9'''[http://groups.geni.net/syseng/wiki/XuanSandbox/ScalingUp Step III: Scaling Up]'''
     10
     11
     12
     13{{{
     14#!html
     15
     16<div style="text-align:center; width:495px; margin-left:auto; margin-right:auto;">
     17<img id="Image-Maps_5201305222028436" src="http://groups.geni.net/geni/attachment/wiki/GENIExperimenter/Tutorials/Graphics/Setup.jpg?format=raw" usemap="#Image-Maps_5201305222028436" border="0" width="495" height="138" alt="" />
     18<map id="_Image-Maps_5201305222028436" name="Image-Maps_5201305222028436">
     19<area shape="rect" coords="18,18,135,110" href="http://groups.geni.net/syseng/wiki/XuanSandbox/ScalingUp/DesignSetup" alt="" title=""    />
     20<area shape="rect" coords="180,18,297,111" href="http://groups.geni.net/syseng/wiki/XuanSandbox/ScalingUp/Execute" alt="" title=""    />
     21<area shape="rect" coords="344,17,460,110" href="http://groups.geni.net/syseng/wiki/XuanSandbox/ScalingUp/Finish" alt="" title=""    />
     22<area shape="rect" coords="493,136,495,138" href="http://www.image-maps.com/index.php?aff=mapped_users_5201305222028436" alt="Image Map" title="Image Map" />
     23</map>
     24<!-- Image map text links - End - -->
     25
     26</div>
     27}}}
     28
     29
     30= 1. Modify RSpec =
     31
     32Recall in Step II, we have saved a final version of request RSpec (''4node-final.rspec'') for the topology with four routers and two end hosts. In this section, we start with this RSpec.
     33
     34== a. Add Aggregates ==
     35
     36Launch the Flack for your slice that has been cleaned up, import the pre-saved ''4node-final.rspec''. You can also download the RSpec from [http://groups.geni.net/syseng/attachment/wiki/XuanSandbox/ScalingUp/DesignSetup/4node-final.rspec here] to your local machine, and import it to your slice.
     37Now you should be able to see the topology on your canvas in Flack.
     38
     39[[Image(XuanSandbox/ScalingUp/DesignSetup:4node-nonstitching.png)]]
     40
     41We will select three InstaGENI aggregates that support stitching links from the [http://groups.geni.net/geni/wiki/GeniNetworkStitchingSites GENIStitchingSites], so that the ''client'' and ''router-1'' are from ''wisconsin-ig'', ''router-2'' and ''router-4'' are from ''nysernet-ig'', and ''router-3'' and the ''server'' are from ''illinois-ig''. Here we show how to change aggregate for ''router-1'' using Flack. Click [[Image(XuanSandbox/ScalingUp/DesignSetup:info.jpg)]] to open node property information, in the '''Manager''' field, select ''instageni.wisc.edu'' from the pull-down list, and apply the updates. Similarly, change the aggregates for the rest of the nodes. Note that, the '''Manager''' refers to the aggregate.
     42
     43 [[Image(XuanSandbox/ScalingUp/DesignSetup:change-aggregate.png)]]
     44
     45''Note that, if you use ''Name'' instead of ''URL'' to the regular "Ubuntu 12.04" disk image for the client and server before, you need to re-select the "Ubuntu 12.04" for the client and server after changing the aggregates. You do not need to do this for the routers, because use the URL of the custom image. For example, we change the aggregate for the client node from stanford-ig to wisconsin-ig, so we also need to reselect the advertise image again, so that the disk image name shown in the field is "instageni.wisc.edu", which is consistent with wisconsin aggregate. ''
     46
     47 [[Image(XuanSandbox/ScalingUp/DesignSetup:disk-name.png)]]
     48
     49== b. Change Link Types ==
     50
     51Now we have three aggregates selected, the link types between nodes are changed to '''gre-tunnel'''.
     52
     53[[Image(XuanSandbox/ScalingUp/DesignSetup:4node-3aggregates-gre.png)]]
     54
     55So we need to update the type of links between different aggregates to be '''stitched''' links, which are ''gre-tunnel0'', ''gre-tunnel1'', ''gre-tunnel2'', ''gre-tunnel3'' in the original topology, and the rest of ''gre-tunnel#'' need to be changed back to ''lan#'' type. We show how to change link type for ''gre-tunnel1'' here. Click [[Image(XuanSandbox/ScalingUp/DesignSetup:info.jpg)]] to open link ''gre-tunnel0'' property information. Select '''stitched''' from the pull-down list at the '''Type''' field, apply the update. Similarly, update the link type for the other '''gre-tunnel''' links.
     56
     57[[Image(XuanSandbox/ScalingUp/DesignSetup:change-link-type.png)]]
     58
     59
     60Similarly, update the link type for the other '''gre-tunnel''' links, and you will see the topology now looks like:
     61
     62[[Image(XuanSandbox/ScalingUp/DesignSetup:4node-stitching.png)]]
     63
     64Export the request RSpec to your local machine, save it as ''4node-stitching.rspec''.
     65
     66== c. Edit New RSpec ==
     67
     68Now open the RSpec file ''4node-stitching.rspec', and we need to do some small editing locally first.
     69
     70Recall that we have changed the link type and aggregate type, the RSpec still keeps the information about ''stanford-ig'', which we are not using it any more, so we need to manually delete this information from the RSpec, otherwise,  we will see errors when requesting resources.
     71
     72For example, the ''stitched0'' link has three ''component_manager'' tags, and the one has name "urn:publicid:IDN+instageni.stanford.edu+authority+cm" is not needed. Also, we need to reduce the capacity down to less than 20000, it is 100000 by default.
     73{{{
     74<link client_id="stitched0">
     75    <flack:link_info x="-1" y="-1" unboundVlantag="true" xmlns="http://www.protogeni.net/resources/rspec/ext/flack/1"/>
     76    <flack:link_info x="-1" y="-1" unboundVlantag="true" xmlns="http://www.protogeni.net/resources/rspec/ext/flack/1"/>
     77    <component_manager name="urn:publicid:IDN+instageni.wisc.edu+authority+cm"/>
     78    <component_manager name="urn:publicid:IDN+instageni.nysernet.org+authority+cm"/>
     79    <component_manager name="urn:publicid:IDN+instageni.stanford.edu+authority+cm"/>
     80    <interface_ref client_id="xen-0:if0"/>
     81    <interface_ref client_id="xen:if0"/>
     82    <property source_id="xen-0:if0" dest_id="xen:if0" capacity="100000"/>
     83    <property source_id="xen:if0" dest_id="xen-0:if0" capacity="100000"/>
     84    <flack:link_info x="526" y="405" unboundVlantag="true"/>
     85  </link>
     86}}}
     87
     88So, for each link block in the ''4node-stitching.rspec'' file, delete the following line, and update the capacity from 100000 to 10000, then save the file.
     89
     90{{{
     91<component_manager name="urn:publicid:IDN+instageni.stanford.edu+authority+cm"/>
     92}}}
     93
     94Now the link block for stitched0 should look like:
     95{{{
     96  <link client_id="stitched0">
     97    <flack:link_info x="-1" y="-1" unboundVlantag="true" xmlns="http://www.protogeni.net/resources/rspec/ext/flack/1"/>
     98    <flack:link_info x="-1" y="-1" unboundVlantag="true" xmlns="http://www.protogeni.net/resources/rspec/ext/flack/1"/>
     99    <component_manager name="urn:publicid:IDN+instageni.wisc.edu+authority+cm"/>
     100    <component_manager name="urn:publicid:IDN+instageni.nysernet.org+authority+cm"/>
     101    <interface_ref client_id="xen-0:if0"/>
     102    <interface_ref client_id="xen:if0"/>
     103    <property source_id="xen-0:if0" dest_id="xen:if0" capacity="10000"/>
     104    <property source_id="xen:if0" dest_id="xen-0:if0" capacity="10000"/>
     105    <flack:link_info x="526" y="405" unboundVlantag="true"/>
     106  </link>
     107}}}
     108
     109It is very important to note that '''DO NOT SUBMIT''' VM reservation request in Flack.  We will use a command line tool called '''stitcher''' to request resources in the next step.
     110
     111= 2. Get Resource Using Stitcher =
     112
     113Stitcher is a command line tool to get resources, including create VM slivers and stitched links. We run stitcher from command line to get resources by providing the RSpec file ''4node-stitching.rspec'' just created. To run stitcher, you need to install omni tool.
     114
     115The command is:
     116{{{
     117$stitcher --logconfig <path to stitcher_logging.conf> createsliver <slicename> <path to your rspec>
     118}}}
     119
     120The option "--logconfig" is not necessary, but if you see message like "WARNING:root:Failed to find log config file /Applications/omniTools-2.6/stitcher.app/Contents/Resources/lib/python27.zip/gcf/stitcher_logging.conf", you may need to manually download [http://groups.geni.net/syseng/attachment/wiki/XuanSandbox/ScalingUp/DesignSetup/stitcher_logging.conf stitcher_logging.conf] to your local system.
     121
     122If you successfully run stitcher, you will see similar output as below:
     123
     124{{{
     125dhcp89-69-127:tools xliu$ stitcher --logconfig stitcher_logging.conf createsliver xuan-wiki-prep1 ~/Documents/docs/wiki-fig/4node-stitching.rspec
     12617:47:31 INFO    : Configured logging from file stitcher_logging.conf
     12717:47:31 INFO    : Reading slice xuan-wiki-prep1 credential...
     12817:47:31 INFO    : Slice urn:publicid:IDN+ch.geni.net:GPOInterns2014+slice+xuan-wiki-prep1 expires on 2014-07-09 21:46:52 UTC
     12917:47:31 INFO    : Calling SCS...
     13017:47:32 INFO    : Multi-AM reservation will include resources from these aggregates:
     13117:47:32 INFO    :      <Aggregate nysernet-ig>
     13217:47:32 INFO    :      <Aggregate illinois-ig>
     13317:47:32 INFO    :      <Aggregate wisconsin-ig>
     13417:47:32 INFO    :      <Aggregate ion>
     13517:47:32 INFO    : Stitcher doing createsliver at <Aggregate nysernet-ig>...
     13617:47:54 INFO    : ... Allocation at <Aggregate nysernet-ig> complete.
     13717:47:54 INFO    : Stitcher doing createsliver at <Aggregate illinois-ig>...
     13817:48:19 INFO    : ... Allocation at <Aggregate illinois-ig> complete.
     13917:48:19 INFO    : Stitcher doing createsliver at <Aggregate wisconsin-ig>...
     14017:48:41 INFO    : ... Allocation at <Aggregate wisconsin-ig> complete.
     14117:48:42 INFO    : Stitcher doing createsliver at <Aggregate ion>...
     14217:49:26 INFO    : DCN AM <Aggregate ion>: must wait for status ready....
     14317:49:26 INFO    : Pausing 30 seconds to let circuit become ready...
     14417:50:04 INFO    : Pausing 30 seconds to let circuit become ready...
     14517:50:41 INFO    : DCN circuit 103131 is ready at <Aggregate ion>
     14617:50:41 INFO    : DCN circuit 103151 is ready at <Aggregate ion>
     14717:50:41 INFO    : DCN circuit 103141 is ready at <Aggregate ion>
     14817:50:48 INFO    : ... Allocation at <Aggregate ion> complete.
     14917:50:48 INFO    : All aggregates are complete.
     15017:50:48 INFO    : Your resources expire at 2 different times at different AMs. The first expiration is 2014-07-03 21:48:39 UTC at <Aggregate ion>. Second expiration is 2014-07-09T21:46:52 UTC.
     15117:50:48 INFO    : Saved combined reservation RSpec at 4 AMs to file '/Users/xliu/Documents/tools/xuan-wiki-prep1-manifest-rspec-stitching-combined.xml'
     152Success: Reserved resources in slice xuan-wiki-prep1 at 4 Aggregates (including 1 intermediate aggregate(s) not in the original request), creating 4 stitched link(s).
     153
     154}}}
     155
     156
     157Now we are ready to run the experiments!
     158
     159
     160
     161[http://groups.geni.net/syseng/wiki/XuanSandbox/ScalingUp Scaling Up: Introduction]
     162
     163[http://groups.geni.net/syseng/wiki/XuanSandbox/ScalingUp/Execute Scaling Up: Execute]