Skip to content

Instantly share code, notes, and snippets.

@robinkraft
Created November 6, 2012 21:56
Show Gist options
  • Select an option

  • Save robinkraft/4027857 to your computer and use it in GitHub Desktop.

Select an option

Save robinkraft/4027857 to your computer and use it in GitHub Desktop.
combine part files from multiple directories into one directory - for forma trends
(let [a (hfs-seqfile "s3n://pailbucket/all-trends1")
b (hfs-seqfile "s3n://pailbucket/all-trends2")
c (hfs-seqfile "s3n://pailbucket/all-trends3")
d (hfs-seqfile "s3n://pailbucket/all-trends4")
e (hfs-seqfile "s3n://pailbucket/all-trends-redo2")
out-loc (hfs-seqfile "s3n://pailbucket/all-trends" :sinkmode :replace)]
(?- out-loc (union a b c d e)))
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment