Skip to content

Instantly share code, notes, and snippets.

@ylashin
Created September 3, 2022 11:27
Show Gist options
  • Save ylashin/2e1fb15c080c42e3e84704eeca4db5d0 to your computer and use it in GitHub Desktop.
Save ylashin/2e1fb15c080c42e3e84704eeca4db5d0 to your computer and use it in GitHub Desktop.
last_commit_version = spark.conf.get("spark.databricks.delta.lastCommitVersionInSession")
commit_file = f"{last_commit_version.zfill(20)}.json"
display_stats_for_commit(f"dbfs:/user/hive/warehouse/source/_delta_log/{commit_file}")
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment