Winutil Hadoop For Mac

Using the correct version of winutils.exe did the trick for me. The winutils should be from the version of Hadoop that Spark has been pre built for. Set HADOOPHOME environment variable to the bin location of winutils.exe. I have stored winutils.exe along with C:Sparkbin files. So now my SPARKHOME and HADOOPHOME point to the same location C. Winutil Hadoop For Mac. By thisfumiddca1983 Follow Public. Set Hadoop configurations On the client you can set Hadoop configurations using the spark.conf.set API, which applies to SQL and DataFrame operations. Hadoop configurations set on the sparkContext must be set in the cluster configuration or using a notebook. The Apache Hadoop software.

之前在mac上调试hadoop程序(mac之前配置过hadoop环境)一直都是正常的。因为工作需要,需要在windows上先调试该程序,然后再转到linux下。程序运行的过程中,报Failed to locate the winutils binary in the hadoop binary path java.io.IOException: Could not locate executable nullbinwinutils.exe in the Hadoop binaries.

Winutils

通过断点调试、查看源码发现程序需要根据HADOOP_HOME找到winutils.exe,由于win机器并没有配置该环境变量,所以程序报 nullbinwinutils.exe。

Spark Winutils

privatestatic String HADOOP_HOME_DIR = checkHadoopHome();

找到原因后就去网上问了度娘,找到了解决方案,很简单,如下:

Download Hallmark Card Studio Mac for Mac to the best selling greeting card software for Windows is now available for Mac! WinRAR (64-bit) Internet Download Manager. Hallmark Card Studio ® for Mac extends this tradition, making it easy to create one-of-a-kind Hallmark cards as unique as the people you care for. But cards are just the beginning. Bridge the miles between family and friends with customizable photo frames, calendars, announcements, postcards, stationery, invitations, e-cards and scrapbook pages. Hallmark card studio free download windows 10. I have had several versions of Hallmark Card Studio over the past 10 years and have come to depend on it for my greeting card needs. When my Mac upgraded to 64 bit encryption my old version of Card Studio became incompatible with my Mac.

1.下载winutils的windows版本

GitHub上,有人提供了winutils的windows的版本,项目地址是:https://github.com/srccodes/hadoop-common-2.2.0-bin,直接下载此项目的zip包,下载后是文件名是hadoop-common-2.2.0-bin-master.zip,随便解压到一个目录

2.配置环境变量

Github Winutils

增加用户变量HADOOP_HOME,值是下载的zip包解压的目录,然后在系统变量path里增加$HADOOP_HOMEbin 即可。

Winutil Hadoop For Mac Os

再次运行程序,正常执行。

Download Winutils Exe

posted @ 2015-04-02 10:39zqhao 阅读(30281) 评论(2) 编辑收藏