Version 5 (modified by 9 years ago) (diff) | ,
---|
Hadoop in a Slice
Part I: Obtain Resources: create a slice and reserve resources
Instructions
1. Create a slice
|
2. Bind the Slice
|
INSERT FIGURE HERE
3. Create the Hadoop Master
|
|
|
3. Create the Hadoop Workers
|
- Edit each worker’s attributes
- Names: hadoop-worker-0 and hadoop-worker-1
- Sliver Type: XOMedium
- Disk Image Name: http://geni-images.renci.org/images/GENIWinterCamp/images/gwc-hadoop.v0.4a.xml
- Disk Image Version: 16ff128df4cf10f2472a8d20796146bcd5a5ddc3
- Add an install service to install following script in /tmp
http://geni-images.renci.org/images/GENIWinterCamp/worker.sh - Add an execute service to execute the script at boot time. For each VM, substitute
the VM’s name for where the following uses “hadoop-worker-0”. (Note: the following
should be placed on one line)
chmod +x /tmp/worker.sh; /tmp/worker.sh $hadoop-master.Name() $hadoop-master.IP("link0") $hadoop-worker-0.Name() $hadoop-worker-0.IP("link0")
4. Create the Network
|
- Click the i button on the link to edit its properties.
- Name the link link0
- Under the interfaces tab add IP addresses and subnets to each VM’s interface. hadoop-master: 172.16.1.1 and 255.255.255.0 hadoop-worker-0: 172.16.1.10 and 255.255.255.0 hadoop-worker-1: 172.16.1.11 and 255.255.255.0
- Switch to the properties tab and set the link’s bandwidth 100Mb/s Set capacity: 100000000 (note: Flack will report that this is 100Gb/s but it is actually 100Mb/s)
5. Instantiate the Slice
|
Introduction
Next: Execute the Hadoop Experiment
Attachments (24)
-
add-master.png (228.0 KB) - added by 10 years ago.
HadoopInASlice - add-master.png
-
edit-master.png (216.1 KB) - added by 10 years ago.
HadoopInASlice - edit-master.png
-
add-workers.png (243.2 KB) - added by 10 years ago.
HadoopInASlice - add-workers.png
-
edit-workers.png (219.9 KB) - added by 10 years ago.
HadoopInASlice - edit-workers.png
-
add-link.png (266.8 KB) - added by 10 years ago.
HadoopInASlice - add-link.png
-
edit-link-interfaces.png (193.5 KB) - added by 10 years ago.
HadoopInASlice - edit-link-interfaces.png
-
edit-link-properties.png (201.2 KB) - added by 10 years ago.
HadoopInASlice - edit-link-properties.png
-
slice-up.png (240.5 KB) - added by 10 years ago.
HadoopInASlice - slice-up.png
-
Bind-Slice.png (59.4 KB) - added by 9 years ago.
Bind-Slice
- Add-Master.png (49.2 KB) - added by 9 years ago.
- Set-Master-Name.png (57.2 KB) - added by 9 years ago.
- Set-Master-Disk-Image.png (63.4 KB) - added by 9 years ago.
- Set-Master-Install-Script.png (54.2 KB) - added by 9 years ago.
- Set-Master-Execute-Script.png (53.6 KB) - added by 9 years ago.
- Add-Workers.png (51.8 KB) - added by 9 years ago.
- Set-Worker-Name.png (65.5 KB) - added by 9 years ago.
- Set-Worker-Disk-Image.png (62.7 KB) - added by 9 years ago.
- Set-Worker-Install-Script.png (57.5 KB) - added by 9 years ago.
- Set-Worker-Execute-Script.png (56.0 KB) - added by 9 years ago.
- Setup-Worker2.png (53.2 KB) - added by 9 years ago.
- Add-Link.png (54.4 KB) - added by 9 years ago.
- Set-Master-IP.png (60.5 KB) - added by 9 years ago.
- Set-Worker0-IP.png (60.5 KB) - added by 9 years ago.
- Set-Worker1-IP.png (56.3 KB) - added by 9 years ago.