Web Scraping API - Get Raw HTML from Any URL with One Call

What You Get

Each request returns the full HTML document of the target page.

Full HTML source

Complete document including head, body, scripts, and inline styles

Automatic proxy escalation

Rotates through proxies to bypass bot protection and geo-blocks

Resolved URL

Returns the final URL after all redirects

Single GET request

No SDKs, browser automation, or manual scraping required

How It Works

We handle proxy escalation and HTML retrieval so you can focus on parsing.

— step 01 —

Pass a URL

Send any fully qualified URL including the protocol (https://)

— step 02 —

Proxy escalation

If the direct request is blocked, we transparently escalate through rotating proxies

— step 03 —

HTML retrieved

The full document source is fetched without modification

— step 04 —

Ready for parsing

Feed the HTML into your own parser, indexer, LLM pipeline, or data store

API Response

Extracted HTML for context.dev

GET /v1/web/scrape/html?url=https://context.dev

Try in API Playground

{
  "success": true,
  "url": "https://context.dev",
  "html": "<!DOCTYPE html><html lang=\"en\"><head>\n  <meta charset=\"UTF-8\" />\n  <title>Context.dev — The Internet's Brand API</title>\n  ...\n</head><body>\n  ...\n</body></html>"
}

Frequently asked questions

Common questions about the Context.dev Web Scraping API.

Am I billed for failed requests?

No. You are not billed for failed requests or requests where we are blocked (rarely happens). Credits are only consumed on successful responses.

How do you handle bot protection and Cloudflare-style blocks?

When the direct fetch is blocked or rate-limited, the API automatically escalates through a rotating proxy pool with realistic browser fingerprints. You don't configure anything — the same endpoint works whether the target is open or hard-protected. Pay-as-you-go: simple URLs bill cheap, hard ones bill the fair cost of the bypass.

How is this a ScrapingBee, ScraperAPI, or Bright Data alternative?

Same single-call ergonomics — pass URL, get HTML — but bundled with the rest of the Context.dev brand-data stack. One API key gets you scraping plus logos, colors, fonts, NAICS, SIC, transaction enrichment. Pricing is per-call, not per-tier, and the free tier is real (not a 3-day trial).

Is the web scraping API legal?

Scraping public web data is generally legal in the U.S. (per hiQ Labs v. LinkedIn). You're responsible for respecting target sites' Terms of Service, robots.txt, and rate limits, and for handling personal data per GDPR/CCPA. The API is a tool — how you use it is your responsibility.

How do I scrape HTML from a URL?

Send a GET request to /v1/web/scrape/html?url=<target>. The API fetches the page, transparently rotates proxies if the direct request is blocked, and returns the raw HTML plus the final resolved URL. One call, no setup.

Does the API render JavaScript?

Yes. JavaScript rendering is available so single-page apps and dynamically populated pages return the post-render HTML, not the empty shell. The API picks the right rendering strategy automatically based on the target.

What is the difference between scraping HTML and scraping Markdown?

The HTML endpoint returns the raw source, exactly as served by the target. The Markdown endpoint converts it to clean GitHub Flavored Markdown — better for feeding into LLMs and RAG pipelines because it strips ads, nav chrome, and HTML noise. Use HTML when you need exact DOM, Markdown when you need readable text.

Is there a free tier?

Yes — the free tier covers thousands of monthly scrapes, more than enough for prototyping. Bulk and production pricing scales linearly without forced annual commitments.