For the past many months i have been out of blogging due to personal reasons. By the Grace of God, things have just turned perfectly good for me.  So, i am back to experimenting with some really cool stuff.

These instructions are an excerpt from

http://www.michael-noll.com/wiki/Running_Hadoop_On_Ubuntu_Linux_(Multi- Node_Cluster)

and Hadoop, HBase API documentation.

1) Download Hadoop (hadoop-0.18.1) 2) Download HBase (hbase-0.18.0) 3) I just setup the environment as Pseudo-Distributed.

a) Open up the hadoop-env.sh file in the conf directory of hadoop. Change the JAVA_HOME directory to point to your own machine setup. Mine looks like this :

export JAVA_HOME=/usr/lib/jvm/java-6-sun-1.6.0.07

b) Open up the hbase-env.sh file in the conf directory of hbase and set JAVA_HOME.

c) Edit hbase-site.xml and make your configuration tag look like this :

fs.default.name hdfs://localhost/hbase

d) Make hadoop-site.xml to look like the following :

fs.default.name hdfs://localhost/ dfs.replication 1

e) Issue the following command inside the bin directory of your hadoop ./start-all.sh

eg : arun@arun-laptop:~/softy/hadoop-0.18.1/bin$ ./start-all.sh

f) Issue the following command to start HBase

eg : arun@arun-laptop:~/softy/hbase-0.18.0/bin$ ./start-hbase.sh

You can play with the shell if you wanted to.

arun@arun-laptop:~/softy/hbase-0.18.0/bin$ ./hbase shell

There is an example on http://hadoop.apache.org/hbase/docs/r0.18.0/api/index.html which

i used to test my setup. The example would need us to create a table ‘myTable’ with a column family ‘myColumnFamily’

Execute the following command on the shell

create ‘myTable’,’myColumnFamily’

Here is what i got as output on execution of the example program :

Found row: myRow with value: timestamp=1225023942810, value=columnQualifier1 value!

Let me know if I could help you with any of the setup problems. I didnt copy the hadoop-site.xml to hbase conf. Later i learnt that it is useful only on “truly” distributed environment.

The above setup instructions were just derived from a) http://hadoop.apache.org/core/docs/r0.18.1/api/index.html and b) http://hadoop.apache.org/hbase/docs/r0.18.0/api/index.html

Food for the bots : Here is the list of exceptions i got during the process of setting this up :

INFO  20:39:19 [org.apache.hadoop.hbase.client.HConnectionManager$TableServers (202):getMaster]:

Attempt 0 of 10 failed with <java.io.IOException: Call failed on local exception>.

Retrying after sleep of 5000

Exception in thread “main” org.apache.hadoop.hbase.MasterNotRunningException: localhost:60000

The above log just means that the hbase and hadoop are not started at all. Check the log for exceptions.

Remember, Hadoop must be started first followed by HBase.

(Multi-Node_Cluster)