I have a recruitment agency prospect whose clients (legal clinics) post jobs on their own websites instead of LinkedIn/Indeed/job platforms. Is there a way to scrape those custom job listings and their details, and can this be done at scale?
Great question — yes, absolutely. The best leads for any campaign are always 100% custom scraped, not pulled from big databases like Apollo or LinkedIn Sales Nav. Think a university directory of business admin students, a Hollywood directors listing that hasn't been updated in 15 years, or niche job sites aggregated by some hobbyist — those you can scrape via network requests and feed into Make.com or n8n. That's how you get the highest quality leads. As for doing it at scale: right now you basically have to design a custom scraper for each website — I think agentic scrapers that can navigate any site on their own will solve this within the next 3-6 months, but until then, I'd charge a per-website fee for the custom scraper build, plus an ongoing fee to maintain/manage the scraping after that.