Skip to content

Instantly share code, notes, and snippets.

@niccolox

niccolox/nutch-clean.sh

Created December 10, 2013 19:29
Show Gist options
  • Save niccolox/7896639 to your computer and use it in GitHub Desktop.
Save niccolox/7896639 to your computer and use it in GitHub Desktop.
Download ZIP
clean nutch solr hdfs temp for www.BigDataDrupal.org
Raw
nutch-clean.sh
# nutch hdfs clean
echo "clean nutch solr hdfs temp"
#!/bin/bash
sudo -u hdfs hadoop fs -rm -R -skipTrash /user/pseudo/nutch/crawls
sudo -u hdfs hadoop fs -rm -R -skipTrash /user/hdfs/generate*
sudo -u hdfs hadoop fs -rm -R -skipTrash /user/hdfs/inject*
sudo -u hdfs hadoop fs -rm -R -skipTrash /user/hdfs/link*
sudo -u hdfs hadoop fs -rm -R -skipTrash /user/hdfs/tmp*
sudo -u hdfs hadoop fs -rm -R -skipTrash /user/hdfs/.staging/job*
curl http://searcher.server.ltd:8088/solr/somesolr/update?stream.body=%3Cdelete%3E%3Cquery%3E*:*%3C/query%3E%3C/delete%3E
curl http://searcher.server.ltd:8088/solr/somesolr/update?stream.body=%3Ccommit/%3E
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment