WebProxy API Scraper

What Is the WebProxy API Scraper?

The WebProxy API Scraper is a universal endpoint that fetches any public web page for you through a pool of rotating proxies. You send a URL — it returns the page content as the site served it (HTML, JSON, or anything else), handling IP rotation, retries, and optional JavaScript rendering. It is the building block for scraping sites that don't have a dedicated API in our catalog.

What Can You Do with It?

Fetch the raw content of any public URL — HTML, JSON, or other formats

Send GET or POST requests, with a JSON body for POST

Set request headers: User-Agent, Accept, Accept-Language, Cookie, Referer

Render JavaScript-heavy pages in a headless browser

Pass JavaScript challenges (Cloudflare and similar) in a browser

Get the page parsed into JSON — title, text, links, images

Route requests through proxies in a chosen country

Common Use Cases

Price monitoring on any online store

SEO audits and rank tracking

Collecting data from sites without a dedicated scraper

Testing how a site looks from different countries

Feeding your own parsers with reliable HTML

How It Works

• Describe the request to the site in one JSON body: url, and optionally method (GET or POST), headers, body (sent with POST), render, bypass, country (a two-letter code such as us or de) and autoparse
• The request goes out through a rotating proxy
• Failed attempts are retried with a fresh IP automatically
• You receive the page content with the site's own content type

Why Use a Proxy API Instead of Your Own Proxies?

No proxy pool to buy, rotate, or monitor

Built-in retries and block handling

One simple REST call instead of browser infrastructure

Pay only for the requests you make

Legal and Ethical Considerations

Use the API only for publicly available pages, respect each site's Terms of Service and robots rules, and keep request rates reasonable.

FAQ

Does it parse the data for me?

With autoparse set to true you get JSON with the page title, text, links, and images instead of HTML. For site-specific structured fields, use a dedicated scraper from our catalog.

Can it render JavaScript?

Yes, set render to true to get the page as a browser sees it, or bypass to also wait for a JavaScript challenge to pass. In the browser modes the page is always opened with GET.

Can I choose the proxy country?

Yes, pass a two-letter country code. Some countries have fewer proxies available, so requests through them can fail more often.

What happens if the target page returns an error?

If the site keeps answering with an error status (for example 404) on every proxy, the request ends with an error instead of the site's page.

Can I send custom headers or cookies?

Yes: pass them in headers. User-Agent, Accept, Accept-Language, Cookie, and Referer are sent to the site; other headers are ignored.