Skip to content
Docs
Datasets

List datasets

Every dataset with its sources, refresh cadence, item count and the first and last day collected. Free.

GET/v1/datasets
FreeTry it

Request

GEThttps://api.scrapercompany.com/v1/datasets

Authenticate with your API key in the x-api-key header (see Authentication).

Run this request on your own API key from this page, with the values you type. Signed out? Sign in or get an API key.

Example request

curl "https://api.scrapercompany.com/v1/datasets" \
  -H "x-api-key: $SCRAPERCOMPANY_API_KEY"

Response

200 — Every dataset with its freshness.

200 response
{
  "datasets": [
    {
      "name": "llm-prices",
      "title": "LLM token prices",
      "description": "Input, output and cache prices per million tokens for every model on every host we track.",
      "refresh_every_hours": 6,
      "sources": [
        "openrouter.ai/api/v1/models",
        "github.com/BerriAI/litellm model price table"
      ],
      "attribution": "",
      "tags": [
        "ai",
        "pricing"
      ],
      "stats": {
        "items": 3905,
        "observations": 3905,
        "first_day": "2027-02-20",
        "last_day": "2027-02-20",
        "built_at": "2026-11-03T04:17:40+00:00"
      }
    }
  ]
}

Errors

Errors return a JSON body with a detail field. Failed requests are not charged. See Errors for the full list and retry advice.

StatusMeaningRetry?
401Unauthorized

Missing or invalid API key.

{"detail":"missing or invalid API key"}
No, fix the request
429Too Many Requests

Too many requests: the key's requests-per-minute limit was exceeded, or (in enforce credits mode) the plan's concurrent-request limit. No rate-limit or Retry-After headers are sent; back off and retry.

{"detail":"rate limit 60/min exceeded"}
Yes, with backoff

Try it

Press Try it above to run this request on your own key, with the values you type (sign in first). For a no-code walkthrough, use the workspace’s guided Try it.

  1. Export your key: export SCRAPERCOMPANY_API_KEY=sk_... (no key yet? start a free trial).
  2. Copy the cURL example above and run it in a terminal.

Questions about this page?

Send the page link and your question, and the team will answer.

Email support