Mikhail Petrov jjstill
jjstill
/ spark-minikube.sh
Last active
February 4, 2024 15:58
Running Spark job on local kubernetes (minikube)
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # Starting minikube with 8Gb of memory and 3 CPUs | |
| minikube --memory 8192 --cpus 3 start | |
| # Creating separate Namespace for Spark driver and executor pods | |
| kubectl create namespace spark | |
| # Creating ServiceAccount and ClusterRoleBinding for Spark | |
| kubectl create serviceaccount spark-serviceaccount --namespace spark | |
| kubectl create clusterrolebinding spark-rolebinding --clusterrole=edit --serviceaccount=spark:spark-serviceaccount --namespace=spark |