I installed Spark and Hadoop on Windows 10, and I get an error in the path of the winutils.exe
file. I already put in the appropriate folder, I already defined the environment variable HADOOP_HOME
as C:\hadoop\bin
, however in the error it appears:
Shell ERROR: Failed to locate the winutils binary in the hadoop binary path
java.io.IOException: Could not locate executable C: \ hadoop \ bin \ bin \ winutils.exe in the Hadoop binaries.
These two "bin" appear when it should be one. Strange.
In the spark/bin
directory, you can type spark-shell
or pyspark
, it shows the same error.
I ran tests with hadoop and it's ok. If anyone can help me thank you.