Why does spark-shell fail with "The root scratch dir: /tmp/hive on HDFS should be writable."?

As per the error message:

Caused by: java.lang.RuntimeException: The root scratch dir: /tmp/hive on HDFS should be writable. Current permissions are: ---------
  at org.apache.hadoop.hive.ql.session.SessionState.createRootHDFSDir(SessionState.java:612)
  at org.apache.hadoop.hive.ql.session.SessionState.createSessionDirs(SessionState.java:554)
  at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:508)
  ... 85 more

You should change the permissions of C:\tmp\hive directory as follows:

winutils.exe chmod -R 777 C:\tmp\hive

Tags:

Windows 10

Apache Spark

Apache Spark Sql

Related

How to stop a scheduled task that was started using @Scheduled annotation? Return the result value with fetch call function from another page, React native attr/colorError not found error when using com.android.support:recyclerview-v7:26.0.0-beta2 How can I write multi-line code in the Terminal use python? React Webpack - Error: Module is not a loader (must have normal or pitch function) How do you Configure Python Keyring to pull credentials from Windows Credential Manager on Windows 7? How to include XML comments files in Swagger in ASP.NET Core Running development server with create-react-app inside of a docker container How to plot multi-color line if x-axis is date time index of pandas Advantages of Stream and Spring Data IntelliJ IDEA plugin to fold .conf files? Is there a maximum number of CPU's that a VirtualBox could bare?

Recent Posts