Changes between Version 15 and Version 16 of GENIExperimenter/Tutorials/GettingStarted_PartII_Hadoop/Procedure/Execute
- Timestamp:
- 03/09/14 13:41:20 (10 years ago)
Legend:
- Unmodified
- Added
- Removed
- Modified
-
GENIExperimenter/Tutorials/GettingStarted_PartII_Hadoop/Procedure/Execute
v15 v16 61 61 62 62 </li> 63 <li>Now that your nodes are ready, go ahead and log into <tt>hadoop-master</tt> .</li>63 <li>Now that your nodes are ready, go ahead and log into <tt>hadoop-master</tt> as yourself (not as root).</li> 64 64 </ol> 65 65 }}} … … 74 74 75 75 {{{ 76 #/sbin/ifconfig76 $ /sbin/ifconfig 77 77 eth0 Link encap:Ethernet HWaddr fa:16:3e:72:ad:a6 78 78 inet addr:10.103.0.20 Bcast:10.103.0.255 Mask:255.255.255.0 … … 107 107 ==== 5.1.2 Observe the contents of the NEuca user data file. This file includes a script that will install and execute the script that you configured for the VM. ==== 108 108 {{{ 109 #neuca-user-data109 $ neuca-user-data 110 110 [global] 111 111 actor_id=67C4EFB4-7CBF-48C9-8195-934FF81434DC … … 142 142 143 143 {{{ 144 #cat /tmp/master.sh145 #!/bin/bash144 $ cat /tmp/master.sh 145 $!/bin/bash 146 146 147 147 echo "Hello from neuca script" > /home/hadoop/log … … 181 181 182 182 {{{ 183 #ping hadoop-worker-0183 $ ping hadoop-worker-0 184 184 PING hadoop-worker-0 (172.16.1.10) 56(84) bytes of data. 185 185 64 bytes from hadoop-worker-0 (172.16.1.10): icmp_req=1 ttl=64 time=0.747 ms … … 206 206 207 207 {{{ 208 #hadoop dfsadmin -report208 $ hadoop dfsadmin -report 209 209 Configured Capacity: 54958481408 (51.18 GB) 210 210 Present Capacity: 48681934878 (45.34 GB) … … 251 251 ==== 5.3.1 Create a small test file ==== 252 252 {{{ 253 #echo Hello GENI World > hello.txt254 }}} 255 256 ==== 5.3.2 Push the file into the Hadoop filesystem === 257 {{{ 258 #hadoop fs -put hello.txt hello.txt259 }}} 260 261 ==== 5.3.3 Check for the file's existence === 262 {{{ 263 #hadoop fs -ls253 $ echo Hello GENI World > hello.txt 254 }}} 255 256 ==== 5.3.2 Push the file into the Hadoop filesystem ==== 257 {{{ 258 $ hadoop fs -put hello.txt hello.txt 259 }}} 260 261 ==== 5.3.3 Check for the file's existence ==== 262 {{{ 263 $ hadoop fs -ls 264 264 Found 1 items 265 265 -rw-r--r-- 3 root supergroup 12 2014-01-04 21:59 /user/root/hello.txt 266 266 }}} 267 267 268 ==== 5.3.4 Check the contents of the file === 269 {{{ 270 #hadoop fs -cat hello.txt268 ==== 5.3.4 Check the contents of the file ==== 269 {{{ 270 $ hadoop fs -cat hello.txt 271 271 Hello GENI World 272 272 }}} … … 281 281 282 282 {{{ 283 #hadoop jar /usr/local/hadoop-0.20.2/hadoop-0.20.2-examples.jar teragen 10000000 random.data.1G283 $ hadoop jar /usr/local/hadoop-0.20.2/hadoop-0.20.2-examples.jar teragen 10000000 random.data.1G 284 284 Generating 10000000 using 2 maps with step of 5000000 285 285 14/01/05 18:47:58 INFO mapred.JobClient: Running job: job_201401051828_0003 … … 307 307 308 308 {{{ 309 #hadoop jar /usr/local/hadoop-0.20.2/hadoop-0.20.2-examples.jar terasort random.data.1G sorted.data.1G309 $ hadoop jar /usr/local/hadoop-0.20.2/hadoop-0.20.2-examples.jar terasort random.data.1G sorted.data.1G 310 310 14/01/05 18:50:49 INFO terasort.TeraSort: starting 311 311 14/01/05 18:50:49 INFO mapred.FileInputFormat: Total input paths to process : 2