Skip to content

Instantly share code, notes, and snippets.

@kristoff-it

kristoff-it/spark-redis-snippet-10

Created January 30, 2019 15:42
Show Gist options
  • Save kristoff-it/ecc21b1ea615a90efe1d461f495f4b3b to your computer and use it in GitHub Desktop.
Save kristoff-it/ecc21b1ea615a90efe1d461f495f4b3b to your computer and use it in GitHub Desktop.
Download ZIP
Raw
spark-redis-snippet-10
>>> no_pol = result.where(col("occupation") != "POLITICIAN")
>>> no_pol.write.format("org.apache.spark.sql.redis").option("table", "occupation").option("key.column", "countryCode").save()
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment