Skip to content
Docs
Any website

Any website

A site no ready-made source covers, or the raw page behind one.Any public URL as HTML, markdown or text. Set render to run the page's JavaScript first, wait_for to wait for an element, screenshot for a PNG, country to request it from a country you name, session_id to keep one address across requests, and premium for sites that refuse standard requests. A refusal, a rate limit or a bot-check page is retried automatically, and only a page that comes back with content is charged.
Look up by
The page URL
Coverage
Public pages on ports 80, 443, 8080 and 8443. Private and internal addresses are refused.
Cost
1 credit a call; failed and empty calls are free
Endpoints
1 endpoint
  • Details

Endpoints

Example

Any public web page as HTML, markdown or text, with POST /v1/scrape. Set SCRAPERCOMPANY_API_KEY to your key and run it; the full parameter list is in the API reference.

curl -X POST "https://api.scrapercompany.com/v1/scrape" \
  -H "x-api-key: $SCRAPERCOMPANY_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "url": "https://example.com"
  }'
200 response
{
  "url": "https://example.com/",
  "final_url": "https://example.com/",
  "status_code": 200,
  "content_type": "text/html; charset=UTF-8",
  "format": "markdown",
  "content": "# Example Domain\n\nThis domain is for use in documentation examples without needing permission. Avoid use in operations.\n\n[Learn more](https://iana.org/domains/example)",
  "headers": {
    "content-type": "text/html; charset=UTF-8",
    "last-modified": "Mon, 05 Oct 2026 18:43:12 GMT",
    "etag": "\"84238dfc8092e5d9c0dac8ef93371a07:1736799080.121134\"",
    "location": []
  },
  "meta": {
    "render": false,
    "premium": false,
    "elapsed_s": 0.412,
    "bytes": 1256
  }
}

Try it on your key

Good to know

  • The answer carries the site's own status_code. Only a 2xx with content is charged; a block, an error page or an empty page is free.
  • Markdown and text drop scripts, styles, navigation and footers and make every link absolute, ready for an LLM or a parser.
  • Use a ready-made source when there is one: it returns typed fields instead of a page to parse.

Questions about this page?

Send the page link and your question, and the team will answer.

Email support