A web scraper you configure with a YAML file instead of writing custom code, that first checks how hard a site is to scrape and automatically picks the right method.
#web-scraping
44 tools curated in this category — including Scrapeforge, Ui.Vision RPA, Crawlee
techFind on mySelectas all sites and tools related to web-scraping. This selection of 44 resources is reviewed and maintained by the community. The most popular include Scrapeforge, Ui.Vision RPA, Crawlee. Each tool comes with a review, tags, comparisons and alternatives to help you make the best choice.
A free browser extension that watches you click through a repetitive task once, then replays those exact clicks automatically — no coding needed.
A free, open-source toolkit that gives developers the plumbing needed to build web scrapers that keep working reliably — retrying failures, rotating proxies, and managing queues automatically.
Turns nearly 2,000 messy public websites — government portals, court records, supplier databases — into clean, stable REST APIs, so a change to the source site doesn't silently break your data pipeline or your AI agent's tool calls.
A developer platform where an AI agent writes and maintains the browser automation code for you — useful for connecting to services that don't offer an API, like scraping data or automating an old back-office system.
Find every plumber, physio or mechanic in a specific area, get their verified emails and social profiles automatically, and build an outreach pipeline — all from one tool instead of paying separately for a Maps scraper, an email finder, and a verification
Type in a search term like "plumbers in Chicago" and get back a spreadsheet of every matching business on Google Maps — names, phone numbers, emails, ratings — instead of manually copying details out of Google Maps one listing at a time.
A drag-and-drop editor for building browser automation — scraping a site, testing a workflow, monitoring a price — without writing Selenium or Playwright scripts by hand.
A searchable pile of 10,000+ real complaints people have posted online — on Reddit, in software reviews, in app store comments — organized so a would-be founder can find a problem people are actually annoyed about, instead of guessing what to build.
An open-source browser automation CLI that turns website workflows into reusable, typed scripts for developers and AI agents.
A Google Sheets add-on that fills in a column of your spreadsheet by reading websites for you, instead of you copy-pasting from each page by hand.
Turns websites that don't have an API into structured, reliable tools an AI agent can call — handling logins, 2FA and bot detection along the way.
A desktop app where you build a web automation — clicking buttons, filling forms, scraping data — by pointing and clicking, and it hands you real, ready-to-use Playwright code at the end instead of locking your work inside a subscription.
Turns any website or API into clean, structured JSON data by describing what you want in a config file — no scraping code to write or maintain.
Tracks any webpage for changes and alerts you the moment something meaningful updates — price drops, new listings, restocked items.
A remote-controlled, disguised web browser for AI agents — it lets an AI click around real websites like a person instead of getting blocked by "prove you're not a robot" checks, and can teach itself to repeat the task next time.
Instead of searching a stale database for leads, Lev8 sends AI agents out to search the live web right now — so the company info, contacts and buying signals it returns are current, not six months old.
AI browser that doesn't just answer questions about a page — it actually clicks, fills forms, and completes multi-step tasks across websites on its own, while showing you the plan first.
Web scraping and crawling API that turns entire websites into clean, structured data ready for AI models to read.
Cloud infrastructure of real, headless browsers that AI agents can control to browse, click and fill out forms like a human would.