Skip to content
Docs

Docs for AI tools

Feed these docs to an AI assistant or coding agent: llms.txt, the full-text llms-full.txt, copy any page as Markdown, or open it in ChatGPT or Claude.

These docs are written to be read by people and by models. Give an assistant the right file and it can write correct calls on the first try.

llms.txt and llms-full.txt

FileWhat it containsUse it when
A short map of the site: use cases, product pages and every docs page, with one-line summaries.
An assistant needs to find the right page.
The whole API reference in one Markdown file: conventions, then every endpoint with its cost, parameters, body and response fields.
A coding agent is writing or reviewing calls.
The OpenAPI 3.1 document the reference is generated from.
You generate a typed client or validate requests.

All three are generated from the same source at build time, so they never drift from these pages.

Copy a page as Markdown

Every docs page has a Copy page button next to the breadcrumbs. It copies the page as clean Markdown, with the code samples in the language you picked, ready to paste into a chat. The menu beside it opens the page in ChatGPT or Claude with a prompt to read it.

Coding agents

Point Claude Code, Cursor or another agent at llms-full.txt from your project's rules file (CLAUDE.md, .cursor/rules or AGENTS.md), so it reads the reference before it writes integration code:

CLAUDE.md
# ScraperCompany API
- Reference: https://scrapercompany.com/llms-full.txt (read it before writing API calls)
- Base URL https://api.scrapercompany.com, key in the x-api-key header,
  read from the SCRAPERCOMPANY_API_KEY environment variable. Never hard-code it.
- Failed requests (4xx/5xx) are free; retry 429, 502 and 503 with backoff.

Agents that call the API

If your agent should fetch prices itself rather than write code that does, connect it to the MCP server. Each tool wraps one endpoint, states its cost in its description and uses the same API key.

Questions about this page?

Send the page link and your question, and the team will answer.

Email support