Skip to content

Instantly share code, notes, and snippets.

View FakerYFX's full-sized avatar

GeorgeJoe FakerYFX

89 followers · 201 following
View GitHub Profile
@oza
oza / SparkOnYARN.md
Last active October 9, 2022 08:53
How to run Spark on YARN with dynamic resource allocation

YARN

  1. General resource management layer on HDFS
  2. A part of Hadoop

Spark

  1. In memory processing framework

Spark on YARN