Skip to content

Instantly share code, notes, and snippets.

@ZosBHAI
Last active August 2, 2020 16:05
Show Gist options
  • Save ZosBHAI/259998b4dd4b7d3fe1fec776e70ee31b to your computer and use it in GitHub Desktop.
Save ZosBHAI/259998b4dd4b7d3fe1fec776e70ee31b to your computer and use it in GitHub Desktop.
Enabling Custom Pyspark Kernel for Jupyterlab Running in DataProc 1.4.33-ubuntu18
cd /opt/anaconda3
curl -O https://repo.anaconda.com/archive/Anaconda3-2019.03-Linux-x86_64.sh
conda install -y -c conda-forge jupyterhub=1.1.0
conda install -y notebook
npm install -g configurable-http-proxy
#### Configurations
mkdir jupyerhub
cd /opt/jupyerhub
jupyterhub --generate-config
c.JupyterHub.authenticator_class = 'jupyterhub.auth.PAMAuthenticator'
c.Spawner.cmd = ['/opt/anaconda3/bin/jupyterhub-singleuser']
c.Spawner.notebook_dir = '/home/{username}'
c.Spawner.default_url = '/lab'
#### Start Jupyterhub
nohup /opt/anaconda3/bin/python /opt/anaconda3/bin/jupyterhub --port=8000
-f /opt/jupyterhub/jupyterhub_config.py --debug &
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment