Skip to content

Instantly share code, notes, and snippets.

@conradcaffier03
Created August 31, 2026 15:00
Show Gist options
  • Select an option

  • Save conradcaffier03/ca77c2c5a36ef06b8823f08b86f31b15 to your computer and use it in GitHub Desktop.

Select an option

Save conradcaffier03/ca77c2c5a36ef06b8823f08b86f31b15 to your computer and use it in GitHub Desktop.
Web Research Setup — let Claude read a hundred websites for you (free, 2 minutes, no terminal)

Web Research Setup — let Claude read a hundred websites for you

Free. No credit card. No terminal. 2 minutes.

Claude can read one website. It can't read a hundred — until you connect this. Firecrawl is the open-source tool (174,000+ GitHub stars) that lets Claude search the web, open real pages and hand you back clean answers instead of 14 open tabs.


Setup (2 minutes, no terminal)

  1. Open Claude (claude.ai or the desktop app)
  2. Go to Settings → Connectors → Add custom connector
  3. Paste this URL and save:
https://mcp.firecrawl.dev/v2/mcp-oauth
  1. Claude asks you to connect your Firecrawl account — sign up right there. The free account gives you 1,000 credits (that's ~1,000 pages read), no credit card.

That's it. Claude can now search the web and read real pages for you.

Using Claude Code instead? One command, then sign in via /mcp:

claude mcp add --transport http firecrawl https://mcp.firecrawl.dev/v2/mcp-oauth

Test it works — ask Claude:

Search the web for the current price of [any product] and read the top result.

If Claude comes back with real page content, you're live.


Three prompts that pay for themselves

1 · What your competitors charge

Find [your kind of business] in [your city] that publish prices online. Skip directories like Yelp or Thumbtack — only real company websites. Read their pricing pages one by one and build me a table: company, service, price. Only include prices you actually read on the page.

2 · What customers complain about

Read these pages: [paste 3–5 links to reviews or comparison articles]. Summarize the 3 most common complaints and the 3 most praised things. Quote one real sentence for each.

3 · Compare suppliers before you commit

Read these supplier pages: [paste links]. Compare them in a table: price, minimum order, delivery time, hidden fees. Tell me which one you'd pick for a small business and why.


Honest limits

  • The free 1,000 credits read pages one by one and cover normal research easily. Crawling entire sites automatically and heavy daily use is what the paid tiers are for — you don't need them to start.
  • Some sites block all robots. Claude will tell you when a page won't open — that's the site, not you.

From @buildwith.conrad — comment CRAWL on any post and I'll send you this file.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment