Skip to content

Instantly share code, notes, and snippets.

@M2shad0w

M2shad0w/hdp2_4bug.md

Created August 2, 2016 01:27
Show Gist options
  • Save M2shad0w/4fcc44714a1f932ecf602655b3ec5245 to your computer and use it in GitHub Desktop.
Save M2shad0w/4fcc44714a1f932ecf602655b3ec5245 to your computer and use it in GitHub Desktop.
Download ZIP
Default Spark env config error in HDP2.4 installation
Raw
hdp2_4bug.md

Default Spark env config error in HDP2.4 installation Default Spark env config error in HDP2.4 installation:

#SPARK_DRIVER_MEMORY="512 Mb"

This line include a wrong config param "512 Mb", it should be "512M" without space. This will cause spark-shell yarn client start error:

Invalid initial heap size.

Suggest to update the template.

@M2shad0w
Copy link
Author

M2shad0w commented Aug 2, 2016

https://community.hortonworks.com/questions/31613/default-spark-env-config-error-in-hdp24-installati.html

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment