Skip to content

Instantly share code, notes, and snippets.

@fbmnds

fbmnds/iota-fails.clj

Created July 10, 2013 17:40
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save fbmnds/5968418 to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save fbmnds/5968418 to your computer and use it in GitHub Desktop.
Download ZIP
Iota needs main memory
Raw
iota-fails.clj
;;
;; iota bails out main memory:
;;
user> (def test-file "/path/to/datafile-16gb.tsv")
#'user/test-file
user> (require '[iota]
'[clojure.core.reducers :as r])
nil
user> (time (def test-vec (iota/vec test-file)))
OutOfMemoryError Java heap space java.util.Arrays.copyOf (Arrays.java:2245)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment