get all URLs of all network requests made on a web page from the Chrome Dev Tools (from an exported HAR)

HOWTO.md

Setup

Using Homebrew on Mac OS X:

brew install jq

Add these aliases to your profile (e.g., ~/.zshrc, ~/.bashrc, ~/.profile, etc.):

alias hurlp='pbpaste | jq ".log.entries" | tee >(jq --raw-output "[.[] | .request.url] | sort | unique | .[]")'
alias hurld='pbpaste | jq ".log.entries" | jq --raw-output "[.[] | .request.url] | sort | unique | .[]" | harurls | tee >(xargs -n 1 curl -O $1)'

Usage

1. Open the Chrome Developer Tools (Command+Option+i)
2. Click the Network tab
3. Reload the page (Command+r)
4. In the Network tab, hover over any area in the table that is not a link (e.g., the Status column)
5. Right click (Control+click) to open the context menu and click Copy All as HAR
6. Open your favourite command-line interface (e.g., Terminal)
7. Enter hurlp to print the URLs or hurld to download the files

what's harurls ?