Skip to content

Instantly share code, notes, and snippets.

View quantumproxies's full-sized avatar

QuantumProxies quantumproxies

8 followers · 0 following
View GitHub Profile
@quantumproxies
quantumproxies / ruby-net-http-proxy.rb
Created July 28, 2026 09:47
Ruby Net::HTTP and Faraday through an authenticated proxy, with the positional-args pitfall — https://quantumproxies.io/residential-proxies
# Ruby through an authenticated residential proxy: Net::HTTP and Faraday.
#
# Proxy: QuantumProxies — https://quantumproxies.io/residential-proxies
# Geo/session flags go in the username: -country-us, -session-rb1-lifetime-10
# Credentials: https://app.quantumproxies.io/register
require "net/http"
require "json"
USER = "#{ENV.fetch('QP_USER', 'YOUR_USERNAME')}-country-us"
@quantumproxies
quantumproxies / ruby-net-http-proxy.rb
Created July 28, 2026 09:47
Ruby Net::HTTP and Faraday through an authenticated proxy, with the positional-args pitfall — https://quantumproxies.io/residential-proxies
# Ruby through an authenticated residential proxy: Net::HTTP and Faraday.
#
# Proxy: QuantumProxies — https://quantumproxies.io/residential-proxies
# Geo/session flags go in the username: -country-us, -session-rb1-lifetime-10
# Credentials: https://app.quantumproxies.io/register
require "net/http"
require "json"
USER = "#{ENV.fetch('QP_USER', 'YOUR_USERNAME')}-country-us"
@quantumproxies
quantumproxies / google-serp-to-csv.py
Created July 28, 2026 09:47
Google search results to CSV in ~20 lines via SERP API (rank, title, link, snippet) — https://quantumproxies.io/serp-api
# Google search results -> CSV in ~20 lines (rank, title, link, snippet).
#
# Uses a SERP API so there's no HTML parsing and no CAPTCHA handling:
# https://quantumproxies.io/serp-api (key: app.quantumproxies.io/api-keys)
#
# QP_API_KEY=qp_live_... python google-serp-to-csv.py "web scraping api" us
import csv, os, sys
import requests
@quantumproxies
quantumproxies / google-serp-to-csv.py
Created July 28, 2026 09:47
Google search results to CSV in ~20 lines via SERP API (rank, title, link, snippet) — https://quantumproxies.io/serp-api
# Google search results -> CSV in ~20 lines (rank, title, link, snippet).
#
# Uses a SERP API so there's no HTML parsing and no CAPTCHA handling:
# https://quantumproxies.io/serp-api (key: app.quantumproxies.io/api-keys)
#
# QP_API_KEY=qp_live_... python google-serp-to-csv.py "web scraping api" us
import csv, os, sys
import requests
@quantumproxies
quantumproxies / page-to-markdown.sh
Created July 28, 2026 09:47
Any webpage to clean markdown in ONE curl command (JS rendering handled server-side) — https://quantumproxies.io/scraper-api
#!/usr/bin/env bash
# Any webpage -> clean markdown in ONE command (curl + jq).
# JS rendering, boilerplate stripping and bot walls handled by the API:
# https://quantumproxies.io/scraper-api (key: app.quantumproxies.io/api-keys)
#
# export QP_API_KEY=qp_live_...
# ./page-to-markdown.sh https://example.com # -> stdout
# ./page-to-markdown.sh https://example.com > page.md # -> file
# ./page-to-markdown.sh https://example.com | pbcopy # -> clipboard (macOS)
@quantumproxies
quantumproxies / page-to-markdown.sh
Created July 28, 2026 09:47
Any webpage to clean markdown in ONE curl command (JS rendering handled server-side) — https://quantumproxies.io/scraper-api
#!/usr/bin/env bash
# Any webpage -> clean markdown in ONE command (curl + jq).
# JS rendering, boilerplate stripping and bot walls handled by the API:
# https://quantumproxies.io/scraper-api (key: app.quantumproxies.io/api-keys)
#
# export QP_API_KEY=qp_live_...
# ./page-to-markdown.sh https://example.com # -> stdout
# ./page-to-markdown.sh https://example.com > page.md # -> file
# ./page-to-markdown.sh https://example.com | pbcopy # -> clipboard (macOS)
@quantumproxies
quantumproxies / sitemap-scraper.py
Created July 28, 2026 09:47
Scrape a whole site from its sitemap.xml into markdown files — https://quantumproxies.io/scraper-api
# Scrape an entire site from its sitemap.xml -> one markdown file per page.
# Discovery is free (sitemap), extraction goes through a scraping API:
# https://quantumproxies.io/scraper-api (key: app.quantumproxies.io/api-keys)
#
# QP_API_KEY=qp_live_... python sitemap-scraper.py https://example.com/sitemap.xml 20
import os, pathlib, re, sys
import requests
API = "https://app.quantumproxies.io/api/v1/scraper/extract"
@quantumproxies
quantumproxies / sitemap-scraper.py
Created July 28, 2026 09:47
Scrape a whole site from its sitemap.xml into markdown files — https://quantumproxies.io/scraper-api
# Scrape an entire site from its sitemap.xml -> one markdown file per page.
# Discovery is free (sitemap), extraction goes through a scraping API:
# https://quantumproxies.io/scraper-api (key: app.quantumproxies.io/api-keys)
#
# QP_API_KEY=qp_live_... python sitemap-scraper.py https://example.com/sitemap.xml 20
import os, pathlib, re, sys
import requests
API = "https://app.quantumproxies.io/api/v1/scraper/extract"
@quantumproxies
quantumproxies / keyword-ideas-from-serp.py
Created July 28, 2026 09:47
Free keyword research: recursively expand a seed keyword via Google related searches — https://quantumproxies.io/serp-api
# Free keyword research: expand a seed keyword via Google's own
# "related searches", recursively, into a deduped idea list.
#
# SERP data via https://quantumproxies.io/serp-api (per-search pricing,
# key: app.quantumproxies.io/api-keys)
#
# QP_API_KEY=qp_live_... python keyword-ideas-from-serp.py "residential proxies"
import os, sys
import requests
@quantumproxies
quantumproxies / keyword-ideas-from-serp.py
Created July 28, 2026 09:47
Free keyword research: recursively expand a seed keyword via Google related searches — https://quantumproxies.io/serp-api
# Free keyword research: expand a seed keyword via Google's own
# "related searches", recursively, into a deduped idea list.
#
# SERP data via https://quantumproxies.io/serp-api (per-search pricing,
# key: app.quantumproxies.io/api-keys)
#
# QP_API_KEY=qp_live_... python keyword-ideas-from-serp.py "residential proxies"
import os, sys
import requests