Evidence Synthesis Methods Interest Group

  • 1.  Scraping SERPs

    Posted Oct 02, 2023 12:36 PM
    Hi all,

    I'm wanting to scrape Google's search engine results pages (SERPs) as part of a gray literature search. Does anyone know of any good tools that can scrape an entire set of search results and not just the first few results pages? If not, then recs that can scrape the first few pages would be welcome too. 

    --
    Thanks,

    Elle