Skip to content

Instantly share code, notes, and snippets.

@simon-mo

simon-mo/parallel-sort.ipynb

Created June 26, 2019 21:19
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save simon-mo/842b73f74e664cb963fb5cf6c2c8062c to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save simon-mo/842b73f74e664cb963fb5cf6c2c8062c to your computer and use it in GitHub Desktop.
Download ZIP
Parallel Sorting in ray
Display the source blob
Display the rendered blob
Raw
parallel-sort.ipynb
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@gshimansky
Copy link

gshimansky commented Feb 5, 2021

Blocks are sorted twice here. First time they are sorted in partition_input_block which sorts a whole block. Second time they are sorted in compute_output_block. At the same time there is no such thing as "Step 2" where workers distribute unsorted data into blocks between cutoffs, as shown on the picture.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment