Skip to content

Instantly share code, notes, and snippets.

@mrk-andreev

mrk-andreev/in_notIn.scala

Last active June 27, 2022 21:03
Show Gist options
  • Save mrk-andreev/ace87dd95dd586bbaab4f89be1b9b73c to your computer and use it in GitHub Desktop.
Save mrk-andreev/ace87dd95dd586bbaab4f89be1b9b73c to your computer and use it in GitHub Desktop.
Download ZIP
Raw
in_notIn.scala
object PlaygroundUtil {
def in(main: DataFrame, dict: DataFrame, joinColumn: String): DataFrame = {
main.join(dict, Seq(joinColumn), "left_semi")
}
def notIn(main: DataFrame, dict: DataFrame, joinColumn: String): DataFrame = {
main.join(dict, Seq(joinColumn), "left_anti")
}
}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment