Skip to content

Instantly share code, notes, and snippets.

@bepcyc

bepcyc/HdfsFindTool and MapReduceIndexerTool for CDH

Last active August 29, 2015 14:07
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save bepcyc/25dd18f039b4053cd10a to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save bepcyc/25dd18f039b4053cd10a to your computer and use it in GitHub Desktop.
Download ZIP
Raw
HdfsFindTool and MapReduceIndexerTool for CDH
# add these lines to .bashrc or to the other start script
export SEARCH_MR_JOB_JAR="/opt/cloudera/parcels/CDH/lib/solr/contrib/mr/search-mr-job.jar"
alias dfsFind="hadoop jar ${SEARCH_MR_JOB_JAR} org.apache.solr.hadoop.HdfsFindTool"
#alias MapReduceIndexerTool="hadoop jar ${SEARCH_MR_JOB_JAR} org.apache.solr.hadoop.MapReduceIndexerTool"
# use it like regular find:
# dfsFind / -name "*.snappy" | grep flume
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment