Skip to content

Instantly share code, notes, and snippets.

@dipanjanS

dipanjanS/spark_log_analytics_25.py

Created April 9, 2019 16:57
Show Gist options
  • Save dipanjanS/8627e5cd0576e3e3b298117243a505fa to your computer and use it in GitHub Desktop.
Save dipanjanS/8627e5cd0576e3e3b298117243a505fa to your computer and use it in GitHub Desktop.
Download ZIP
Raw
spark_log_analytics_25.py
status_freq_df = (logs_df
.groupBy('status')
.count()
.sort('status')
.cache())
print('Total distinct HTTP Status Codes:', status_freq_df.count())
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment