Skip to content

Instantly share code, notes, and snippets.

@tbatchelli
Created July 1, 2011 18:49
Show Gist options
  • Save tbatchelli/1059162 to your computer and use it in GitHub Desktop.
Save tbatchelli/1059162 to your computer and use it in GitHub Desktop.
hadoop cluster example
(cluster-spec :private
{:jobtracker (node-group [:jobtracker :namenode])
:slaves (slave-group 2)}
:base-machine-spec {:os-family :ubuntu
:os-version-matches "10.10"
:os-64-bit true
:min-ram (* 4 1024)}
:base-props {:hdfs-site {:dfs.data.dir "/mnt/dfs/data"
:dfs.name.dir "/mnt/dfs/name"}
:mapred-site {:mapred.task.timeout 300000
:mapred.reduce.tasks 3
:mapred.tasktracker.map.tasks.maximum 3
:mapred.tasktracker.reduce.tasks.maximum 3
:mapred.child.java.opts "-Xms1024m"}}))
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment