Skip to content

Instantly share code, notes, and snippets.

@atroche

atroche/pmap_over_split_files.clj

Created March 1, 2017 04:19
Show Gist options
  • Save atroche/d71fabe1fd3f26d524676ad930a64910 to your computer and use it in GitHub Desktop.
Save atroche/d71fabe1fd3f26d524676ad930a64910 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
pmap_over_split_files.clj
(reduce +
(pmap (fn [fname]
(with-open [rdr (io/reader fname)]
(count-lines rdr)))
["xaa" "xab" "xac" "xad"])) ;; 2.5gb JSON files
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment