Skip to content

Instantly share code, notes, and snippets.

@NeerajBhadani

NeerajBhadani/win_rangeBetween_agg_boundary.scala

Created May 25, 2020 15:19
Show Gist options
  • Save NeerajBhadani/3a45f591c94c6ec3d4d20ca4332e9bf8 to your computer and use it in GitHub Desktop.
Save NeerajBhadani/3a45f591c94c6ec3d4d20ca4332e9bf8 to your computer and use it in GitHub Desktop.
Download ZIP
Apply custom window Specification with custom Boundary
Raw
win_rangeBetween_agg_boundary.scala
val winSpec = Window.partitionBy("depName").orderBy("salary")
.rangeBetween(300L, Window.unboundedFollowing)
val range_unbounded_df = empsalary.withColumn("max_salary", max("salary").over(winSpec))
range_unbounded_df.show()
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment