Visual web scraping, at scale

Turn public web pages into structured data

Point and click to build a sitemap, then let cloud browsers crawl the pages, following robots.txt and site rate limits, and deliver clean rows as JSON, CSV or Excel. On demand, on a schedule, or through the API.

Free trial credits included. No card required.

Sitemap · outdoor-store

Selectors

  • categorylink
  • pagespagination
  • productelement
  • titletext
  • pricetext
  • imageimage

Extracted data

titlepricecategory
Trail Runner GTX$129.00Footwear
Merino Base Layer$74.50Apparel
Ultralight Tent 2P$389.00Camping
Carbon Trek Poles$98.00Hiking
Insulated Bottle 1L$32.00Hydration
Export JSONExport CSVExport Excel

Features

Everything between a URL and a spreadsheet

Better Scrape covers the whole pipeline: building the scraper, running it reliably against modern websites, and getting the data where it needs to go.

Point-and-click sitemaps

Pick elements on the live page with the Chrome extension. Selectors are generated for you and previewed before you save.

Hierarchical selector trees

Nest links, pagination and repeated elements to crawl from a category page down to every detail page in one run.

Dynamic pages handled

Infinite scroll, "Load more" buttons, virtualized lists, click-through pagination and iframes all have first-class support.

Responsible crawling

Cloud browsers that follow robots.txt, space out requests to each site and record any page that fails with a screenshot.

Schedules

Run sitemaps on a cron expression or a fixed interval, in your timezone. Each run becomes a tracked job with its own results.

Clean exports

Regex, trim and rename parsers shape every column. Download results as JSON, CSV or Excel, or fetch them from the API.

Webhooks

Signed webhook deliveries tell your systems when a job finishes, with a full dispatch log for debugging.

Built for teams

Organizations with owner, admin and member roles, invitations, and shared sitemaps, jobs and billing.

How it works

From first click to data feed in minutes

  1. 1

    Build a sitemap

    Open the target site, select the fields you want with the extension, and arrange them into a tree. Already use webscraper.io? Import your sitemap.

  2. 2

    Run it in the cloud

    Start a job with one click or on a schedule. Cloud browsers crawl in parallel, retry failed pages and record every failure with a screenshot.

  3. 3

    Use the data

    Watch rows arrive live, export them, or pull them from the REST API. A webhook lets your pipeline pick up each finished job.

Selector types:texthtmlimageattributelinkiframepaginationelement

Developers

Scraping as an API call

Design sitemaps visually, then drive them from code. Trigger runs from your backend, poll progress, and load results into your warehouse.

  • REST API for sitemaps, scrape jobs, schedulers and credits
  • Authenticate with an API key in X-API-Key or a Bearer token
  • Export results as json, csv or xlsx from one endpoint
  • Interactive OpenAPI reference with request examples
Read the API reference
terminal
# Start a job from a saved sitemapcurl -X POST https://api.betterscrape.net/v1/scrape-jobs \  -H "X-API-Key: $BETTER_SCRAPE_API_KEY" \  -H "Content-Type: application/json" \  -d '{    "sitemapId": "6f1c2a9e-0b7d-4c5e-9a3f-2d8b1e4c7a60",    "requestInterval": 2000,    "pageLoadDelay": 1000  }' # Download the results when it finishescurl https://api.betterscrape.net/v1/scrape-jobs/$JOB_ID/export?format=csv \  -H "X-API-Key: $BETTER_SCRAPE_API_KEY" -o results.csv

Pricing

Pay for the rows you extract

One credit is one scraped row. Every new organization starts with 1,000 free trial credits, and credit packs top you up whenever you need more.

Starter

$39.00 / month

Billed every month

  • 5,000 credits per month
  • 1 parallel job
  • Top up anytime with credit packs
  • Schedules, API and webhooks
  • Shared across your organization
Get started

Pro monthly

$89.00 / month

Billed every month

  • 25,000 credits per month
  • 3 parallel jobs
  • Top up anytime with credit packs
  • Schedules, API and webhooks
  • Shared across your organization
Get started

Flexible monthly

From$178.00 / month

$89.00 per parallel job per month

  • Unlimited credits
  • Choose your parallel jobs (from 2)
  • Schedules, API and webhooks
  • Shared across your organization
Get started

Not ready to pick a plan? Start with 1,000 free trial credits. No card required.

FAQ

Questions, answered

Your first dataset is a few clicks away

Create an organization, install the extension, and run your first sitemap on free trial credits.