I need to process some very large files and for this I am trying to use Hadoop (in version 2.4.1).
I'm not able to run the official tutorial on Ubuntu 14.04 (64-bit) and Java (Oracle version 1.7.0_60-b19). When starting DFS , even though you have configured SSH as specified, the return is as follows:
ssh: Could not resolve hostname ???: Name or service not known
How do I solve this problem?
I found the answer in another post ( in SO ): The problem seems to be related to the fact that the default Hadoop libraries for 32-bit architectures.
Some answers point to the possibility of recompiling things, but something much simpler for me: creating environment variables that correctly configure Hadoop and these native libraries.
Add two new variables to your etc / hadoop / hadoop-env.sh
export HADOOP_COMMON_LIB_NATIVE_DIR=${HADOOP_PREFIX}/lib/native
export HADOOP_OPTS="-Djava.library.path=$HADOOP_PREFIX/lib"