Changes between Initial Version and Version 1 of GENIExperimenter/Tutorials/jacks/HadoopInASlice/ObtainResources


Ignore:
Timestamp:
10/29/14 14:12:47 (10 years ago)
Author:
pruth@renci.org
Comment:

--

Legend:

Unmodified
Added
Removed
Modified

  • GENIExperimenter/Tutorials/jacks/HadoopInASlice/ObtainResources

    v1 v1  
     1= [wiki:GENIExperimenter/Tutorials/HadoopInASlice Hadoop in a Slice] =
     2== Part I: Obtain Resources: create a slice and reserve resources ==
     3
     4{{{
     5#!html
     6
     7<div style="text-align:center; width:495px; margin-left:auto; margin-right:auto;">
     8<img id="Image-Maps_5201305222028436" src="http://groups.geni.net/geni/attachment/wiki/GENIExperimenter/Tutorials/Graphics/Setup.jpg?format=raw" usemap="#Image-Maps_5201305222028436" border="0" width="495" height="138" alt="" />
     9<map id="_Image-Maps_5201305222028436" name="Image-Maps_5201305222028436">
     10<area shape="rect" coords="18,18,135,110" href="http://groups.geni.net/geni/wiki/GENIExperimenter/Tutorials/HadoopInASlice/ObtainResources" alt="" title=""    />
     11<area shape="rect" coords="180,18,297,111" href="http://groups.geni.net/geni/wiki/GENIExperimenter/Tutorials/HadoopInASlice/ExecuteExperiment" alt="" title=""    />
     12<area shape="rect" coords="344,17,460,110" href="http://groups.geni.net/geni/wiki/GENIExperimenter/Tutorials/HadoopInASlice/TeardownExperiment" alt="" title=""    />
     13<area shape="rect" coords="493,136,495,138" href="http://www.image-maps.com/index.php?aff=mapped_users_5201305222028436" alt="Image Map" title="Image Map" />
     14</map>
     15<!-- Image map text links - End - -->
     16
     17</div>
     18}}}
     19
     20= Instructions =
     21
     22
     23== 1. Create a slice ==
     24
     25{{{
     26#!html
     27<table border="0">
     28<tr>
     29       <td >
     30         <ol type="A">
     31        <li> Login to <a href="https://portal.geni.net"  target="_blank"> https://portal.geni.net </a> </li>
     32        <li> Create a new slice in one of your projects </li>
     33        <li> Launch flack </li>
     34</td>
     35</tr>
     36</table>
     37}}}
     38
     39
     40
     41
     42
     43== 2. Create the Hadoop Master ==
     44
     45{{{
     46#!html
     47<table border="0">
     48<tr>
     49       <td >
     50         <ol type="A">
     51
     52
     53        <li> Add a VM to your slice. (If you are participating in an organized tutorial, please place the VM the rack assigned to you)</li>
     54        </ol>   
     55       </td>
     56</tr>
     57
     58<tr>  <td>
     59  <img border="0" src="http://groups.geni.net/geni/attachment/wiki/GENIExperimenter/Tutorials/HadoopInASlice/ObtainResources/add-master.png?format=raw" alt="Add the Hadoop Master"  height="600" title="Add the Hadoop Master" />
     60<br /> 
     61</td> </tr>
     62
     63      <td >
     64             
     65             <ol type="A" start="2">
     66             <li> Click the i button on the VM to set its properties: </li>
     67<ol type="i">
     68
     69 <li>                   Name: hadoop-master </li>
     70 <li>                     Sliver Type: XOLarge </li>
     71  <li>                   Disk Image Name: http://geni-images.renci.org/images/GENIWinterCamp/images/gwc-hadoop.v0.4a.xml </li>
     72   <li>                  Disk Image Version: 16ff128df4cf10f2472a8d20796146bcd5a5ddc3  </li>
     73  <li>                  Add an install service to install following script in /tmp:  <br><code> http://geni-images.renci.org/images/GENIWinterCamp/master.sh  <code></li>
     74  <li>                 Add an execute service to execute the script at boot time:  <br> <code> chmod +x /tmp/master.sh; /tmp/master.sh </code></li>
     75</ol>
     76
     77             </pl>
     78           
     79       </td>
     80</tr>
     81<tr>
     82
     83       <td>
     84
     85        <img border="0" src="http://groups.geni.net/geni/attachment/wiki/GENIExperimenter/Tutorials/HadoopInASlice/ObtainResources/edit-master.png?format=raw" alt="Add the Hadoop Master"  height="600" title="Add the Hadoop Master" />
     86<br />
     87         
     88       </td>
     89    </tr>
     90
     91</table>
     92}}}
     93
     94== 3. Create the Hadoop Workers ==
     95{{{
     96#!html
     97<table border="0">
     98
     99 <tr>
     100      <td >
     101             
     102             <ol type="A">
     103             <li> Add a 2 more VMs to the same rack as the first VM. </li>
     104                 
     105             </pl>
     106           
     107       </td>
     108</tr>
     109<tr>
     110
     111       <td>
     112
     113        <img border="0" src="http://groups.geni.net/geni/attachment/wiki/GENIExperimenter/Tutorials/HadoopInASlice/ObtainResources/add-workers.png?format=raw" alt="Add the Hadoop Master"  height="600" title="Add the Hadoop Master" />
     114<br />
     115         
     116       </td>
     117  </tr>
     118
     119
     120<tr>
     121      <td >
     122             
     123             <ol type="A" start="2">
     124             <li> Edit each worker’s attributes</li>
     125                    <ol type="i">
     126
     127<li>  Names: hadoop-worker-0 and hadoop-worker-1 </li>
     128<li>  Sliver Type: XOMedium </li>
     129<li>  Disk Image Name:
     130http://geni-images.renci.org/images/GENIWinterCamp/images/gwc-hadoop.v0.4a.xml  </li>
     131<li>  Disk Image Version: 16ff128df4cf10f2472a8d20796146bcd5a5ddc3  </li>
     132<li>  Add an install service to install following script in /tmp <br>
     133http://geni-images.renci.org/images/GENIWinterCamp/worker.sh   </li>
     134<li>  Add an execute service to execute the script at boot time. For each VM, substitute
     135the VM’s name for where the following uses “hadoop-worker-0”. (Note: the following
     136should be placed on one line) <br>
     137<code> chmod +x /tmp/worker.sh; /tmp/worker.sh $hadoop-master.Name() $hadoop-master.IP("link0")  $hadoop-worker-0.Name() $hadoop-worker-0.IP("link0")  </code>  </li>
     138
     139
     140                 
     141
     142</ol>
     143             </pl>
     144           
     145       </td>
     146</tr>
     147<tr>
     148
     149       <td>
     150
     151        <img border="0" src="http://groups.geni.net/geni/attachment/wiki/GENIExperimenter/Tutorials/HadoopInASlice/ObtainResources/edit-workers.png?format=raw" alt="Add the Hadoop Master"  height="600" title="Add the Hadoop Master" />
     152<br />
     153         
     154       </td>
     155    </tr>
     156</table>
     157}}}
     158
     159== 4. Create the Network ==
     160
     161{{{
     162#!html
     163<table border="0">
     164<tr>
     165      <td >
     166             
     167             <ol type="A">
     168             <li>Link all three VMs with a broadcast network </li>
     169                 
     170             </pl>
     171           
     172       </td>
     173</tr>
     174<tr>
     175
     176       <td>
     177
     178        <img border="0" src="http://groups.geni.net/geni/attachment/wiki/GENIExperimenter/Tutorials/HadoopInASlice/ObtainResources/add-link.png?format=raw" alt="Add the Hadoop Master"  height="600" title="Add the Hadoop Master" />
     179<br />
     180       </td>
     181  </tr>
     182
     183
     184
     185
     186<tr>
     187      <td >
     188             
     189             <ol type="A" start="2">
     190             <li> Click the i button on the link to edit its properties.</li>
     191                    <ol type="i">
     192
     193<li> Name the link link0</li>
     194<li>  Under the interfaces tab add IP addresses and subnets to each VM’s interface.
     195hadoop-master: 172.16.1.1 and 255.255.255.0
     196hadoop-worker-0: 172.16.1.10 and 255.255.255.0
     197hadoop-worker-1: 172.16.1.11 and 255.255.255.0</li>
     198</ol>
     199             </ol>
     200           
     201       </td>
     202</tr>
     203<tr>
     204
     205       <td>
     206
     207        <img border="0" src="http://groups.geni.net/geni/attachment/wiki/GENIExperimenter/Tutorials/HadoopInASlice/ObtainResources/edit-link-interfaces.png?format=raw" alt="Add the Hadoop Master"  height="600" title="Add the Hadoop Master" />
     208<br />
     209         
     210       </td>
     211    </tr>
     212
     213
     214
     215<tr>
     216      <td >
     217             
     218              <ol>
     219                    <ol type="A" start="3">
     220
     221<li> Switch to the properties tab and set the link’s bandwidth 100Mb/s
     222Set capacity: 100000000 (note: Flack will report that this is 100Gb/s but it is actually
     223100Mb/s)</li>
     224
     225</ol>
     226             </ol>
     227           
     228       </td>
     229</tr>
     230<tr>
     231
     232       <td>
     233
     234        <img border="0" src="http://groups.geni.net/geni/attachment/wiki/GENIExperimenter/Tutorials/HadoopInASlice/ObtainResources/edit-link-properties.png?format=raw" alt="Add the Hadoop Master"  height="600" title="Add the Hadoop Master" />
     235<br />
     236         
     237       </td>
     238    </tr>
     239
     240
     241</table>
     242}}}
     243
     244== 5. Instantiate the Slice  ==
     245
     246{{{
     247#!html
     248<table border="0">
     249
     250<tr>
     251      <td >
     252             
     253             <ol type="A">
     254             <li>Submit the request</li>
     255<li> Wait until the slice is up </li>
     256                 
     257             </pl>
     258           
     259       </td>
     260</tr>
     261<tr>
     262
     263       <td>
     264
     265        <img border="0" src="http://groups.geni.net/geni/attachment/wiki/GENIExperimenter/Tutorials/HadoopInASlice/ObtainResources/slice-up.png?format=raw" alt="Add the Hadoop Master"  height="600" title="Add the Hadoop Master" />
     266<br />
     267       </td>
     268  </tr>
     269
     270
     271
     272
     273
     274 </table>
     275
     276
     277
     278}}}
     279
     280
     281
     282----
     283=  [wiki:GENIExperimenter/Tutorials/HadoopInASlice Introduction] =
     284= [wiki:GENIExperimenter/Tutorials/HadoopInASlice/ExecuteExperiment Next: Execute the Hadoop Experiment] =