Changes between Version 4 and Version 5 of GENIExperimenter/Tutorials/jacks/HadoopInASlice/ExecuteExperiment

Timestamp:

09/17/15 07:57:56 (9 years ago)

Author:

nriga@bbn.com

Comment:

--

GENIExperimenter/Tutorials/jacks/HadoopInASlice/ExecuteExperiment

@@ -74 +74 @@
 }}} 
  a. Observe the contents of the NEuca user data file.  This file includes a script that will install and execute the script that you configured for the VM. ===
-{{{
+ {{{
 # neuca-user-data 
 [global]
@@ -111 +111 @@
         eval "/bin/sh -c \"/home/hadoop/hadoop_config_dynamic.sh 2\""
 }}}
-
-
-=== C. Observe the contents of the of the script that was installed and executed on the VM. ===
-{{{
+ a. Observe the contents of the of the script that was installed and executed on the VM. ===
+ {{{
 # sudo cat /home/hadoop/hadoop_config_dynamic.sh 
 
@@ -125 +123 @@
 ....
 }}}
-
-
-=== D. Test for connectivity between the VMs. ===
-
-{{{
-# ping hadoop-worker-0
-PING hadoop-worker-0 (172.16.1.10) 56(84) bytes of data.
-64 bytes from hadoop-worker-0 (172.16.1.10): icmp_req=1 ttl=64 time=0.747 ms
-64 bytes from hadoop-worker-0 (172.16.1.10): icmp_req=2 ttl=64 time=0.459 ms
-64 bytes from hadoop-worker-0 (172.16.1.10): icmp_req=3 ttl=64 time=0.411 ms
-^C
---- hadoop-worker-0 ping statistics ---
-3 packets transmitted, 3 received, 0% packet loss, time 1998ms
-rtt min/avg/max/mdev = 0.411/0.539/0.747/0.148 ms
-# ping hadoop-worker-1
-PING hadoop-worker-1 (172.16.1.11) 56(84) bytes of data.
-64 bytes from hadoop-worker-1 (172.16.1.11): icmp_req=1 ttl=64 time=0.852 ms
-64 bytes from hadoop-worker-1 (172.16.1.11): icmp_req=2 ttl=64 time=0.468 ms
-64 bytes from hadoop-worker-1 (172.16.1.11): icmp_req=3 ttl=64 time=0.502 ms
-^C
---- hadoop-worker-1 ping statistics ---
-3 packets transmitted, 3 received, 0% packet loss, time 1999ms
-rtt min/avg/max/mdev = 0.468/0.607/0.852/0.174 ms
+ a. Test for connectivity between the VMs. ===
+ {{{
+# ping worker-0
+PING worker-0 (172.16.1.10) 56(84) bytes of data.
+64 bytes from worker-0 (172.16.1.10): icmp_seq=1 ttl=64 time=1.09 ms
+64 bytes from worker-0 (172.16.1.10): icmp_seq=2 ttl=64 time=0.772 ms
+64 bytes from worker-0 (172.16.1.10): icmp_seq=3 ttl=64 time=0.888 ms
+
+# ping worker-1
+PING worker-1 (172.16.1.11) 56(84) bytes of data.
+...
+etc 
+}}}
+
+=== 1.3 Configure the hadoop filesystem ===
+  a. Switch to the ‘hadoop’ user.      
+  {{{
+       sudo su hadoop -
+   }}}
+ b. Format the hadoop filesystem:
+ {{{
+hdfs namenode -format
+}}}
+ c.  Start the hadoop services:
+ {{{
+       start-dfs.sh
+}}}
+ {{{
+       start-yarn.sh
 }}}