# Any website

Best for: A site no ready-made source covers, or the raw page behind one. Category: Any website.

Any public URL as HTML, markdown or text. Set render to run the page's JavaScript first, wait_for to wait for an element, screenshot for a PNG, country to request it from a country you name, session_id to keep one address across requests, and premium for sites that refuse standard requests. A refusal, a rate limit or a bot-check page is retried automatically, and only a page that comes back with content is charged.

- Look up by: The page URL
- Coverage: Public pages on ports 80, 443, 8080 and 8443. Private and internal addresses are refused.
- Cost: 1 credit a call; failed and empty calls are free
- Answers: Details

## Endpoints

- `POST /v1/scrape`: Any public web page as HTML, markdown or text, 1 credit. https://scrapercompany.com/docs/reference/scrape

## Example

Any public web page as HTML, markdown or text (`POST /v1/scrape`):

```bash
curl -X POST "https://api.scrapercompany.com/v1/scrape" \
  -H "x-api-key: $SCRAPERCOMPANY_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "url": "https://example.com"
  }'
```

## Good to know

- The answer carries the site's own status_code. Only a 2xx with content is charged; a block, an error page or an empty page is free.
- Markdown and text drop scripts, styles, navigation and footers and make every link absolute, ready for an LLM or a parser.
- Use a ready-made source when there is one: it returns typed fields instead of a page to parse.

- [All data sources](https://scrapercompany.com/docs/data-sources)
