Hadoop in a Slice

Part I/Step 1: Obtain Resources: create a slice and reserve resources

Instructions

1. Create a slice

Go to the Home tab. Press the Create Slice button for this project. As a slice name use the slice name on your worksheet (the slice name should be of the form portal##), you can leave the description empty and press Create Slice

Add a VM to your slice. The VM should be placed on the rack assigned to you.

Click the i button on the VM to set its properties: Name: hadoop-master Sliver Type: XOLarge Disk Image Name: http://geni-images.renci.org/images/GENIWinterCamp/images/gwc-hadoop.v0.4a.xml Disk Image Version: 16ff128df4cf10f2472a8d20796146bcd5a5ddc3 Add an install service to install following script in \tmp: http://geni-images.renci.org/images/GENIWinterCamp/master.sh Add an execute service to execute the script at boot time chmod +x /tmp/master.sh; /tmp/master.sh

6. Add a 2 more VMs to your assigned rack

5. Edit each worker’s attributes
1. Names: hadoop-worker-0 and hadoop-worker-1
2. Sliver Type: XOMedium
3. Disk Image Name: http://geni-images.renci.org/images/GENIWinterCamp/images/gwc-hadoop.v0.4a.xml
4. Disk Image Version: 16ff128df4cf10f2472a8d20796146bcd5a5ddc3
5. Add an install service to install following script in \tmp http://geni-images.renci.org/images/GENIWinterCamp/master.sh
6. Add an execute service to execute the script at boot time. For each VM substitute the VM’s name for where the following uses “hadoop-master”. (Note: the following should be placed on one line) chmod +x /tmp/worker.sh; /tmp/worker.sh \ $hadoop-master.Name() $hadoop-master.IP("link0") \ $hadoop-worker-0.Name() $hadoop-worker-0.IP("link0")

6. Link all three VMs with a broadcast network

5. Click the i button on the link to edit its properties.
1. Ensure the link is named link0
2. Under the interfaces tab add IP addresses and subnets to each VM’s interface. hadoop-master: 172.16.1.1 and 255.255.255.0 hadoop-worker-0: 172.16.1.10 and 255.255.255.0 hadoop-worker-1: 172.16.1.11 and 255.255.255.0

3. Switch to the properties tab and set the link’s bandwidth 100Mb/s Set capacity: 100000000 (note: Flack will report that this is 100Gb/s but it is actually 100Mb/s)

6. Submit the request
7. Wait until the slice is up

---

Introduction

Next: Execute the Hadoop Experiment