Skip to content

Instantly share code, notes, and snippets.

@mrk-andreev
Last active July 2, 2022 07:44
Show Gist options
  • Save mrk-andreev/e93a127e5b20c23f42210756368800a3 to your computer and use it in GitHub Desktop.
Save mrk-andreev/e93a127e5b20c23f42210756368800a3 to your computer and use it in GitHub Desktop.
test("in") {
# main = createDataDataset(Seq(Data("a", "Berlin"), Data("b", "Madrid"), Data("c", "Rome")))
# dict = createDictDataset(Seq(Dict("a"), Dict("b")))
val result = main.join(dict, Seq("index"), "left_semi")
val expected = createDataDataset(Seq(
Data("a", "Berlin"), Data("b", "Madrid"))).orderBy("index")
assert(result.schema === expected.schema)
assert(result.collect() === expected.toDF().collect())
}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment