Skip to content

Instantly share code, notes, and snippets.

@minyk

minyk/spark-on-k8s.md

Last active May 11, 2022 01:26
Show Gist options
  • Save minyk/601b57f12bc6bc20ff91851e83246144 to your computer and use it in GitHub Desktop.
Save minyk/601b57f12bc6bc20ff91851e83246144 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
spark-on-k8s.md

Presentations and articles for Spark-on-K8S

For own self-education purpose

General

  1. Apache Spark on Kubernetes: A Technical Deep Dive - Yinan Li, Google, KubeCon + CloudNativeCon China 2018, Nov 15, 2018
  2. Ready to run! Get Started with Spark on Kubernetes, Jean-Yves Stephan, Spot.io, Feb 1, 2022
  3. Patterns and Anti-Patterns of running Apache bigdata projects in Kubernetes, Marton Elek, ApacheCon EU 2019, Oct 24, 2019

Scheduling

  1. State Of The Union With Apache Yunikorn (Incubating) - Cloud Native Scheduler For Big Data Usecases, SUNIL GOVINDAN, JULIA KINGA MARTON, ApacheCon 2021, Aug 8 2021
  2. Using Volcano and Kubernetes for Cutting-Edge AI Deployment - Yedong Liu & William Wang, Huawei, Opensource Summit EU 2020
  3. Spark-scheduling-in-kubernetes, Palantir, 2019 https://palantir.medium.com/spark-scheduling-in-kubernetes-4976333235f3

Use cases

  1. Scaling and Securing Spark on Kubernetes at Bloomberg - Ilan Filonenko, Bloomberg, KubeCon + CloudNativeCon Europe 2019, May 23, 2019

ETC

  1. Apache Spark on Kubernetes: Best Practices & Performance Tuning, Jean-Yves Stephan, Cloud Native Data Management (CNDM) Day, Oct 13th 2021
  2. Reliable Performance at Scale with Apache Spark on Kubernetes - Will Manning, Matthew Cheah Palantir, SPARK+AI Summit 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment