Web scraping API for LLMs

Web scraping API for LLMs and AI agents

Turn any public page into clean markdown an LLM can read, and give your agent live prices, search results, jobs and reviews as tools. Blocks and rate limits are handled, and a page that does not come back costs nothing.

Start for $15Read the API reference

7,500 credits, one-time. No subscription. Failed calls are free. The free trial covers the travel endpoints.

Sources and prices checked against the API on .

Every industry we cover

An agent that browses the web hits the same walls a scraper does: pages that refuse scripted visitors, content built by JavaScript, and HTML full of navigation and scripts that waste the context window. Retrieval pipelines for RAG have the same problem at a larger scale.

The web scraping endpoint returns a page as markdown or plain text with scripts, styles, navigation and footers removed and every link made absolute, ready to chunk or to hand to a model. For live data, the MCP server exposes the API’s endpoints as tools, signed in with OAuth or your API key, so Claude, Cursor and other MCP clients can look up hotel rates, flights, products, jobs and pages on their own.

The blocks are our problem

  • Blocks and bot checks. A block, a rate limit or a bot-check page is detected and the request is retried automatically; you get the answer, not the failed attempts.
  • Rate limits and IP addresses are handled for you. There is nothing to buy, rotate or warm up.
  • Site changes are ours to fix. Every hour, live checks call the routes customers rely on most against the real sites.
  • Failed calls are free. You pay a fixed credit price only for results.
How we keep the data flowing

Sources on the same key

Each one returns typed JSON fields, not HTML to parse. Prices are credits per successful call.

Any website

A site no ready-made source covers, or the raw page behind one

1 credit

Google Search

SERP analytics, SEO and AI Overview monitoring

4 credits

Google News

News monitoring

2 credits

YouTube

Video research and creator analytics

2 credits

Amazon

Product search and ratings

2 credits

Google Hotels

Forward rate calendars and destination search

From 2 credits

One call, structured JSON

POST /v1/scrape, 1 credits per successful call.

curl -X POST "https://api.scrapercompany.com/v1/scrape" \
  -H "x-api-key: $SCRAPERCOMPANY_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "url": "https://example.com"
  }'
Response (trimmed)
{
  "url": "https://example.com/",
  "final_url": "https://example.com/",
  "status_code": 200,
  "content_type": "text/html; charset=UTF-8",
  "format": "markdown",
  "content": "# Example Domain\n\nThis domain is for use in documentation examples without needing permission. Avoid use in operations.\n\n[Learn more](https://iana.org/domains/example)",
  "headers": {
    "content-type": "text/html; charset=UTF-8",
    "last-modified": "Mon, 05 Oct 2026 18:43:12 GMT",
    "etag": "\"84238dfc8092e5d9c0dac8ef93371a07:1736799080.121134\"",
    "location": []
  },
  "meta": {
    "render": false,
    "premium": false,
    "elapsed_s": 0.412,
    "bytes": 1256
  }
}

What teams build, and what it costs

Illustrative jobs priced from the credit schedule, 30 days a month. Failed calls would cost nothing.

Fresh pages for a RAG index

A support assistant re-reads 500 documentation and help-centre pages a day as markdown to keep its index current.

  • 500 pages as markdown a day, POST /v1/scrape

15,000 credits a month

Fits the Starter plan ($49 a month)

A research agent

A research agent runs 50 Google searches a day and reads the top results it picks as markdown.

  • 50 Google searches a day, POST /v1/google/search
  • 250 result pages as markdown a day, POST /v1/scrape

13,500 credits a month

Fits the Starter plan ($49 a month)

Estimate your own volume

Why markdown instead of HTML?

Markdown keeps the headings, lists, tables and links an LLM needs and drops the scripts, styles and page chrome it does not, so the same page takes far fewer tokens and reads cleanly.

Can Claude use it directly?

Yes. Connect the MCP server to Claude (it is listed in the Claude directory), Cursor or any MCP client; the web page tool and the data tools run on your key and say what each answer cost.

What about pages that need JavaScript?

Set render and the page’s JavaScript runs before the content is returned, with wait_for to wait for the element you need.

Do failed requests cost credits?

No. A failed or blocked call (any 4xx or 5xx response) costs 0 credits, and so does a search page that comes back empty. You pay only for successful results.

How do I get an API key?

Create an account on the sign-up page and verify your email. You get a free trial of 50 calls or 14 days, whichever ends first, no card needed on the travel endpoints (hotels, rentals, flights, reviews); for everything else, and after the trial, buy a credit pack (from $15) or pick a plan. You create and rotate keys yourself in the dashboard.

Other industries on the same key

All solutions

Start with 50 free calls

Create an account and verify your email: your own API keys and a free trial of 50 calls or 14 days, whichever ends first, no card needed. Then buy a credit pack from $15 or pick a plan from $49 a month.

Start for $15Start your free trial

7,500 credits, one-time. No subscription. Or try it free: 50 calls, no card.

Read the quickstart first