Skip to content

Instantly share code, notes, and snippets.

@jmhodges
Created November 9, 2009 07:03
Show Gist options
  • Save jmhodges/229751 to your computer and use it in GitHub Desktop.
Save jmhodges/229751 to your computer and use it in GitHub Desktop.
(lines) M=> (w+c+j: smallcount) # YMapper
(w+c+j: smallcount) R=> (w+c+j: y_cj) # YReducer
(w+c+j: y_cj) M=> (w+c: y_cj) # XMapper
(w+c: y_cj) R=> (w+c: x_wc) # XReducer
(w+c: x_wc) M=> (w: x_wc) # GMapper
(w: x_wc) R=> (w: g_w) # GReducer
(w+c+j: y_cj) M=> (w: [c+j, y_cj]) # YToWordMapper
(w: [c+j, y_cj]) | (w: g_w) MR=> (c+j: [g_w,y_cj]) # Here be join-magic
(c+j: [g_w,y_cj]) M=> (c+j: combined_gy)
(c+j: combined_gy) R=> (c+j: H_cj)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment