Skip to content

Instantly share code, notes, and snippets.

@vndee
Created September 9, 2021 15:14
Show Gist options
  • Save vndee/1184ebadb84edefec7f8ded2dd17353a to your computer and use it in GitHub Desktop.
Save vndee/1184ebadb84edefec7f8ded2dd17353a to your computer and use it in GitHub Desktop.
# Spark slave node
FROM spark-base
# -- Runtime
ARG spark_worker_web_ui=8081
EXPOSE ${spark_worker_web_ui}
CMD bin/spark-class org.apache.spark.deploy.worker.Worker spark://${SPARK_MASTER_HOST}:${SPARK_MASTER_PORT} >> logs/spark-worker.out
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment