Skip to content

Instantly share code, notes, and snippets.

@erajanraja24

erajanraja24/Scrape search results with google apps script

Created January 20, 2018 15:16
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save erajanraja24/02279e405e28311f220f557156363d7b to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save erajanraja24/02279e405e28311f220f557156363d7b to your computer and use it in GitHub Desktop.
Download ZIP
Scraping google search results
Raw
Scrape search results with google apps script
function scrapeGoogle() {
var searchResults=UrlFetchApp.fetch("https://www.google.co.in/search?q="+encodeURIComponent("amarindaz youtube channel"));
var titleExp=/<h3 class=\"r\">([\s\S]*?)<\/h3>/gi;
var titleResults=searchResults.getContentText().match(titleExp);
// Logger.log(titleResults);
for(var i in titleResults)
{
var actualTitle=titleResults[i].replace(/(^\s+)|(\s+$)/g, "").replace(/<\/?[^>]+>/gi, "");
Logger.log(actualTitle);
}
}
@busan100
Copy link
Copy Markdown

busan100 commented Mar 30, 2020

thank you
I am learning Apps Script in your youtube channel

@F041
Copy link
Copy Markdown

F041 commented Jun 7, 2022

Which regex to use in the case I want to scrape the name of the projects here? https://defillama.com/recent

@user3691
Copy link
Copy Markdown

user3691 commented Jan 15, 2023

It does not work anymore. Google blocks bot searches.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment