ZosBHAI
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| ### Find the kernel.json location | |
| jupyter kernelspec list | |
| ###Create Pyspark Folder and create Kernel.json file with below content | |
| { | |
| "display_name": "pyspark", | |
| "language": "python", | |
| "argv": [ "/opt/anaconda3/bin/python", "-m", "ipykernel", "-f", "{connection_file}" ], | |
| "env": { | |
| "JAVA_HOME": "/usr/lib/jvm/java-8-openjdk-amd64", |
ZosBHAI
/ jupyterhub_installation_configuration_steps
Last active
August 2, 2020 16:05
Enabling Custom Pyspark Kernel for Jupyterlab Running in DataProc 1.4.33-ubuntu18
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| cd /opt/anaconda3 | |
| curl -O https://repo.anaconda.com/archive/Anaconda3-2019.03-Linux-x86_64.sh | |
| conda install -y -c conda-forge jupyterhub=1.1.0 | |
| conda install -y notebook | |
| npm install -g configurable-http-proxy | |
| #### Configurations | |
| mkdir jupyerhub | |
| cd /opt/jupyerhub | |
| jupyterhub --generate-config |