| 1 | [[PageOutline]] |
| 2 | = Distributed Computing on GENI: Hadoop in a Slice = |
| 3 | |
| 4 | == Experiment Overview == |
| 5 | |
| 6 | In this tutorial you will create a slice composed of three virtual machines that are a Hadoop cluster. The tutorial will lead you through creating the slice, observing the properties of the slice, and running a Hadoop example which sorts a large dataset. |
| 7 | |
| 8 | After completing the tutorial you should be able to: |
| 9 | |
| 10 | 1. Use GENI to create a virtual distributed computational cluster. |
| 11 | |
| 12 | 2. Create simple post boot scripts with simple template replacement. |
| 13 | |
| 14 | 3. Use the basic functionality of a Hadoop filesystem. |
| 15 | |
| 16 | 4. Observe resource utilization of compute nodes in a virtual distributed computational cluster. |
| 17 | |
| 18 | |
| 19 | == Prerequisites == |
| 20 | In order to participate in this tutorial you need to have an account at an InCommon institution or from the GPO. If you haven't done so before, please [http://groups.geni.net/geni/wiki/SignMeUpPortal sign in to the GENI Portal]. |
| 21 | |
| 22 | Make sure you know which institution will provide you access to GENI and the username and password you need to authenticate. If you don't know, please let us know. |
| 23 | |
| 24 | It may be helpful for you to have access to your email. |
| 25 | |
| 26 | In addition, this tutorial assumes you have experience using the GENI portal and Flack to create and log into virtual machines. |
| 27 | |
| 28 | == Tools == |
| 29 | |
| 30 | [https://portal.geni.net GENI Experimenter Portal] |
| 31 | |
| 32 | == Where to get help == |
| 33 | |
| 34 | [mailto:geni-users@googlegroups.com geni-users@googlegroups.com] |
| 35 | |
| 36 | == Resources == |
| 37 | |
| 38 | * Three virtual machines within a single ExoGENI rack. |
| 39 | |
| 40 | == Tutorial Instructions == |
| 41 | {{{ |
| 42 | #!html |
| 43 | |
| 44 | |
| 45 | <table id="Table_01" height="409" border="0" cellpadding="0" cellspacing="0"> |
| 46 | <tr> |
| 47 | <td> |
| 48 | <a href="http://groups.geni.net/geni/wiki/GENIExperimenter/Tutorials/HadoopInASlice/ObtainResources"><img src="http://groups.geni.net/geni/attachment/wiki/GENIExperimenter/Tutorials/Graphics/design.png?format=raw" width="152" height="152" alt="Design/Setup"></a> |
| 49 | </td> |
| 50 | <td> |
| 51 | <ul> |
| 52 | <li>Part I: Design/Setup</li> |
| 53 | <ul> |
| 54 | <li><a href="http://groups.geni.net/geni/wiki/GENIExperimenter/Tutorials/HadoopInASlice/ObtainResources">Obtain Resources: Create a slice and reserve resources</a></li> |
| 55 | </ul></ul> |
| 56 | </td> |
| 57 | </tr> |
| 58 | <tr> |
| 59 | <td> |
| 60 | <a href="http://groups.geni.net/geni/wiki/GENIExperimenter/Tutorials/HadoopInASlice/ExecuteExperiment"><img src="http://groups.geni.net/geni/attachment/wiki/GENIExperimenter/Tutorials/Graphics/execute.png?format=raw" width="152" height="143" alt="Execute"></a> |
| 61 | </td> |
| 62 | <td> |
| 63 | <ul> |
| 64 | <li>Part II: Execute</li> |
| 65 | <ul> |
| 66 | <li><a href="http://groups.geni.net/geni/wiki/GENIExperimenter/Tutorials/HadoopInASlice/ExecuteExperiment">Execute Experiment: Login to nodes and execute the Hadoop experiment</a> </li> |
| 67 | </ul></ul> |
| 68 | </td> |
| 69 | </tr> |
| 70 | <tr> |
| 71 | <td> |
| 72 | <a href="http://groups.geni.net/geni/wiki/GENIExperimenter/Tutorials/HadoopInASlice/TeardownExperiment"><img src="http://groups.geni.net/geni/attachment/wiki/GENIExperimenter/Tutorials/Graphics/finish.png?format=raw" width="152" height="114" alt="Finish"></a> |
| 73 | </td> |
| 74 | |
| 75 | <td> |
| 76 | <ul> |
| 77 | <li>Part III: Finish</li> |
| 78 | <ul> |
| 79 | <li><a href="http://groups.geni.net/geni/wiki/GENIExperimenter/Tutorials/HadoopInASlice/TeardownExperiment">Teardown Experiment: Delete Resources</a></li> |
| 80 | </ul></ul> |
| 81 | </td> |
| 82 | |
| 83 | </tr> |
| 84 | </table> |
| 85 | |
| 86 | }}} |