Hadoop : unable to load native hadoop library
NickName:Saurab Ask DateTime:2017-06-22T00:33:41

Hadoop : unable to load native hadoop library

I know that this is a famous question across internet and there are tons of websites showing how to solve this issue and there are hell lots of QA on SO too. BUT NONE of them helped me and I am frustrated now. So I am giving every details I can, if I overlooked anything, I appreciate your help.

**OS** : Ubuntu 16.04 32 bit
**Hadoop version** : Hadoop 3.0.0-alpha3
**bashrc** : 

export HADOOP_HOME=/usr/local/hadoopec/hadoop
export HADOOP_CONF_DIR=/usr/local/hadoopec/hadoop/etc/hadoop
export HADOOP_MAPRED_HOME=/usr/local/hadoopec/hadoop
export HADOOP_COMMON_HOME=/usr/local/hadoopec/hadoop
export HADOOP_HDFS_HOME=/usr/local/hadoopec/hadoop
export PATH=$PATH:/usr/local/hadoopec/hadoop/bin

export JAVA_HOME=/usr/lib/jvm/java-8-openjdk-i386

export LD_LIBRARY_PATH=/usr/local/hadoopec/hadoop/lib/native/:$LD_LIBRARY_PATH
#export HADOOP_OPTS="-Djava.library.path=$HADOOP_HOME/lib/native"

export HADOOP_COMMON_LIB_NATIVE_DIR=$HADOOP_HOME/lib/native
export HADOOP_OPTS="-Djava.library.path=$HADOOP_HOME/lib"

**core-site.xml** : 

<property>
  <name>hadoop.tmp.dir</name>
  <value>/usr/hadoopec/hadoop/tmp</value>
  <description>Temporary Directory.</description>
</property>

<property>
  <name>fs.default.name</name>
  <value>hdfs://localhost:9000</value>
  <description>Use HDFS as file storage engine</description>
</property>

 **hdfs-env.sh**

export HADOOP_OPTS="$HADOOP_OPTS -Djava.library.path=$HADOOP_HOME/lib/native"
export HADOOP_OPTS="$HADOOP_OPTS -XX:-PrintWarnings -Djava.net.preferIPv4Stack=true"
export LD_LIBRARY_PATH=/usr/local/hadoopec/hadoop/lib/native/:$LD_LIBRARY_PATH

**hdfs-site.xml**

<property>
<name>dfs.replication</name>
<value>3</value>
</property>

<property>
<name>dfs.permission</name>
<value>false</value>
</property>

 <property>
  <name>dfs.namenode.name.dir</name>
  <value>/usr/local/hadoopec/hadoop/tmp/hdfs/name</value>
  </property>

<property>
  <name>dfs.datanode.data.dir</name>
  <value>/usr/local/hadoopec/hadoop/tmp/hdfs/data</value>
  </property>

If anyone needs some more informations, feel free to ask me.

Copyright Notice:Content Author:「Saurab」,Reproduced under the CC 4.0 BY-SA copyright license with a link to the original source and this disclaimer.
Link to original article:https://stackoverflow.com/questions/44681653/hadoop-unable-to-load-native-hadoop-library

More about “Hadoop : unable to load native hadoop library” related questions

Unable to load native Hadoop library

I already saw these kind of problems but it didn't solve anything for me. So I've got Kubuntu 15.04 uname -a Linux laptop 3.19.0-31-generic #36-Ubuntu SMP Wed Oct 7 15:03:41 UTC 2015 i686 i68...

Show Detail

Unable to load native hadoop library for Mac OS X

I am using Hadoop in Mac OS X. I think I installed Hadoop properly. When I tried to run an example WordCount problem, I got this error: INFO util.NativeCodeLoader - Unable to load native-hadoop

Show Detail

Hadoop : unable to load native hadoop library

I know that this is a famous question across internet and there are tons of websites showing how to solve this issue and there are hell lots of QA on SO too. BUT NONE of them helped me and I am

Show Detail

Hadoop "Unable to load native-hadoop library for your platform" warning

I'm currently configuring hadoop on a server running CentOs. When I run start-dfs.sh or stop-dfs.sh, I get the following error: WARN util.NativeCodeLoader: Unable to load native-hadoop library f...

Show Detail

Hadoop "Unable to load native-hadoop library for your platform" warning

I'm currently configuring hadoop on a server running CentOs. When I run start-dfs.sh or stop-dfs.sh, I get the following error: WARN util.NativeCodeLoader: Unable to load native-hadoop library f...

Show Detail

Hadoop "Unable to load native-hadoop library for your platform" warning

I'm currently configuring hadoop on a server running CentOs. When I run start-dfs.sh or stop-dfs.sh, I get the following error: WARN util.NativeCodeLoader: Unable to load native-hadoop library f...

Show Detail

Hadoop: Unable to load native-hadoop library for your platform

I've installed Hadoop 2.7.2 single node on Ubuntu and I want to run the java wordcount program. The compilation and the creation of the jar file are done succesfully, but when I run the jar file on

Show Detail

hadoop WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform

I am following this tutorial. start-all.sh output: hduser@ubuntu12:~/hadoop/sbin$ start-dfs.sh 15/07/27 15:24:11 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform...

Show Detail

Failure to load the native-hadoop library

Without -Djava.library.path=/opt/mapr/hadoop/hadoop-0.20.2/lib/native/Linux-amd64-64/ as an argument to running Java, I get the following error, 2013-11-13 15:23:29,414 WARN pool-3-thread-3 org.

Show Detail

Unable to load bzip2 in native library of Hadoop

My environment is CentOS 7; Spark 1.6.1; Hadoop 2.6.4; and I have two slave-node in a cluster mode. When I tried hadoop command, I got WARN util.NativeCodeLoader: Unable to load native-hadoop libr...

Show Detail