Turn public web pages into structured data
Point and click to build a sitemap, then let cloud browsers crawl the pages, following robots.txt and site rate limits, and deliver clean rows as JSON, CSV or Excel. On demand, on a schedule, or through the API.
Free trial credits included. No card required.
Selectors
- categorylink
- pagespagination
- productelement
- titletext
- pricetext
- imageimage
Extracted data
| title | price | category |
|---|---|---|
| Trail Runner GTX | $129.00 | Footwear |
| Merino Base Layer | $74.50 | Apparel |
| Ultralight Tent 2P | $389.00 | Camping |
| Carbon Trek Poles | $98.00 | Hiking |
| Insulated Bottle 1L | $32.00 | Hydration |
Features
Everything between a URL and a spreadsheet
Better Scrape covers the whole pipeline: building the scraper, running it reliably against modern websites, and getting the data where it needs to go.
Point-and-click sitemaps
Pick elements on the live page with the Chrome extension. Selectors are generated for you and previewed before you save.
Hierarchical selector trees
Nest links, pagination and repeated elements to crawl from a category page down to every detail page in one run.
Dynamic pages handled
Infinite scroll, "Load more" buttons, virtualized lists, click-through pagination and iframes all have first-class support.
Responsible crawling
Cloud browsers that follow robots.txt, space out requests to each site and record any page that fails with a screenshot.
Schedules
Run sitemaps on a cron expression or a fixed interval, in your timezone. Each run becomes a tracked job with its own results.
Clean exports
Regex, trim and rename parsers shape every column. Download results as JSON, CSV or Excel, or fetch them from the API.
Webhooks
Signed webhook deliveries tell your systems when a job finishes, with a full dispatch log for debugging.
Built for teams
Organizations with owner, admin and member roles, invitations, and shared sitemaps, jobs and billing.
How it works
From first click to data feed in minutes
- 1
Build a sitemap
Open the target site, select the fields you want with the extension, and arrange them into a tree. Already use webscraper.io? Import your sitemap.
- 2
Run it in the cloud
Start a job with one click or on a schedule. Cloud browsers crawl in parallel, retry failed pages and record every failure with a screenshot.
- 3
Use the data
Watch rows arrive live, export them, or pull them from the REST API. A webhook lets your pipeline pick up each finished job.
Developers
Scraping as an API call
Design sitemaps visually, then drive them from code. Trigger runs from your backend, poll progress, and load results into your warehouse.
- REST API for sitemaps, scrape jobs, schedulers and credits
- Authenticate with an API key in X-API-Key or a Bearer token
- Export results as json, csv or xlsx from one endpoint
- Interactive OpenAPI reference with request examples
# Start a job from a saved sitemapcurl -X POST https://api.betterscrape.net/v1/scrape-jobs \ -H "X-API-Key: $BETTER_SCRAPE_API_KEY" \ -H "Content-Type: application/json" \ -d '{ "sitemapId": "6f1c2a9e-0b7d-4c5e-9a3f-2d8b1e4c7a60", "requestInterval": 2000, "pageLoadDelay": 1000 }' # Download the results when it finishescurl https://api.betterscrape.net/v1/scrape-jobs/$JOB_ID/export?format=csv \ -H "X-API-Key: $BETTER_SCRAPE_API_KEY" -o results.csvPricing
Pay for the rows you extract
One credit is one scraped row. Every new organization starts with 1,000 free trial credits, and credit packs top you up whenever you need more.
Starter
$39.00 / month
Billed every month
- 5,000 credits per month
- 1 parallel job
- Top up anytime with credit packs
- Schedules, API and webhooks
- Shared across your organization
Pro monthly
$89.00 / month
Billed every month
- 25,000 credits per month
- 3 parallel jobs
- Top up anytime with credit packs
- Schedules, API and webhooks
- Shared across your organization
Flexible monthly
From$178.00 / month
$89.00 per parallel job per month
- Unlimited credits
- Choose your parallel jobs (from 2)
- Schedules, API and webhooks
- Shared across your organization
Not ready to pick a plan? Start with 1,000 free trial credits. No card required.
FAQ
Questions, answered
Your first dataset is a few clicks away
Create an organization, install the extension, and run your first sitemap on free trial credits.