Skip to content

Instantly share code, notes, and snippets.

@iqbalhasnan
Created February 25, 2020 00:46
Show Gist options
  • Save iqbalhasnan/ed92fa2450cab9c5b63d2402f3ff2c72 to your computer and use it in GitHub Desktop.
Save iqbalhasnan/ed92fa2450cab9c5b63d2402f3ff2c72 to your computer and use it in GitHub Desktop.
Spark Hive errors and solutions
1.
Error:
java.io.IOException: java.lang.IllegalArgumentException: bucketId out of range: -1
Solution:
set hive.fetch.task.conversion=none;
2.
Error:
java.io.IOException: [Error 30022]: Must use HiveInputFormat to read ACID tables
Solution:
set hive.input.format=org.apache.hadoop.hive.ql.io.HiveInputFormat
@rain1024
Copy link

it save my life. thank you so much.

@twosom
Copy link

twosom commented May 14, 2024

Thanks!!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment