Skip to content

Instantly share code, notes, and snippets.

@austinsonger

austinsonger/cewl.md

Created February 27, 2018 19:53
Show Gist options
  • Save austinsonger/8383865f505d86b77c22e7a3c94a3633 to your computer and use it in GitHub Desktop.
Save austinsonger/8383865f505d86b77c22e7a3c94a3633 to your computer and use it in GitHub Desktop.
Download ZIP
cewl Cheatsheet
Raw
cewl.md

To spider a site and write all found words to a file

cewl -w

To spider a site and follow links to other sites

cewl -o

To spider a site using a given user-agent

cewl -u

To spider a site for a given depth and minimum word length

cewl -d -m

To spider a site and include a count for each word

cewl -c

To spider a site inluding meta data and separate the meta_data words

cewl -a -meta_file

To spider a site and store email adresses in a separate file

cewl -e -email_file

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment