Skip to content

Instantly share code, notes, and snippets.

Show Gist options
  • Save rain1024/e21eedc4efc88b7406de269b2d524dae to your computer and use it in GitHub Desktop.
Save rain1024/e21eedc4efc88b7406de269b2d524dae to your computer and use it in GitHub Desktop.
Spark Hive errors and solutions
1.
Error:
java.io.IOException: java.lang.IllegalArgumentException: bucketId out of range: -1
Solution:
set hive.fetch.task.conversion=none;
2.
Error:
java.io.IOException: [Error 30022]: Must use HiveInputFormat to read ACID tables
Solution:
set hive.input.format=org.apache.hadoop.hive.ql.io.HiveInputFormat
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment