⚡ x402 Protocol

Web to Markdown API

AI agents pay per-call in USDC via x402. 35 endpoints: web scraping, page analysis, sitemaps, robots.txt, SSL inspection, DNS, email validation, HTTP headers, MIME detection, text utilities, hashing, encoding, QR codes, IP geolocation, and more. No accounts. No API keys. No subscriptions.

$0.002 / call (scraping) · $0.001 / call (utilities) · $0.005 / batch · Base · USDC

🎉 Free tier now available

Try the API without x402 payment. Rate-limited to 5 requests/min, content truncated to 2K chars. Perfect for testing and light use.

GET /free/extract?url=...
Free · 5/min
GET /free/meta?url=...
Free · 5/min
GET /free/diff?text_a=&text_b=
Free · 5/min

How it works

Built on the x402 protocol — the open standard for internet-native payments. When an AI agent requests a page, the server responds with HTTP 402 Payment Required. The agent signs a USDC payment, retries, and gets clean markdown back.

35
Endpoints
$0.001-0.005
Per call
$0.005
Batch (10 URLs)
0
Setup required

Endpoints

All endpoints are x402-gated. Use the ScoutGate proxy URLs (Base mainnet, USDC) for production agent calls. For live proxy URLs, call GET / on the API.

🌐 Web Scraping ($0.002/call)

GET /extract?url=...
Extract clean markdown text from any URL. Returns title, content, content_length.
https://x402-scoutgate.onrender.com/api/5554b932 · $0.002
GET /meta?url=...
Extract page metadata: title, description, Open Graph tags, Twitter cards, canonical URL.
https://x402-scoutgate.onrender.com/api/d68a0b3a · $0.002
GET /links?url=...
Extract all links from a page, categorized as internal/external with anchor text.
https://x402-scoutgate.onrender.com/api/30fd8887 · $0.002
GET /images?url=...
Extract all images from a page: src, alt text, dimensions, type (img/source/og:image).
https://x402-scoutgate.onrender.com/api/cd67a093 · $0.002
GET /headings?url=...
Extract heading structure (h1-h6 tree) from any web page. Returns flat list and nested tree.
https://x402-scoutgate.onrender.com/api/1800aedc · $0.002
GET /redirect?url=...
Resolve URL redirect chains: final URL, status codes, full chain, hops count, MIME type.
$0.002
GET /pdf?url=...
Extract full text from PDF files: research papers, reports, whitepapers. Returns title, content, pages.
$0.002
GET /struct?url=...
Extract structured data: JSON-LD, schema.org microdata, RDFa links.
$0.002
GET /compare?url_a=&url_b=
Compare two web pages: similarity score, common headings, shared links, metadata diff.
$0.002
POST /batch
Batch extract up to 10 URLs in one call. $0.005 per batch (50% savings vs individual calls).
$0.005

🔧 Utility Endpoints ($0.001/call)

GET /uuid?count=N
Generate UUIDs (v4). Returns single or multiple UUIDs. $0.001.
GET /timestamp?value=...&from_format=...&to_format=...
Convert timestamps between Unix, ISO 8601, RFC 2822, human-readable. $0.001.
GET /encode?text=...&mode=encode
URL encode or decode text. $0.001.
GET /diff?text_a=...&text_b=...
Compute text diff between two strings. Returns unified diff, similarity score. $0.001.
GET /hash?text=...&algo=sha256
Generate cryptographic hashes: md5, sha1, sha256, sha512. $0.001.
GET /base64?text=...&mode=encode
Base64 encode/decode text. Supports standard and URL-safe modes. $0.001.
GET /slug?text=...
Convert text to URL-safe slug. Handles Unicode. $0.001.
GET /json-validate?json=...&mode=pretty
Validate, pretty-print, or minify JSON. Returns errors with line numbers. $0.001.

🆕 New Utility Endpoints ($0.001/call)

GET /ip
Get geolocation data for an IP address: country, city, ISP, timezone, coordinates. $0.001.
GET /password?length=...&include_symbols=true
Generate cryptographically strong passwords with configurable length and char sets. $0.001.
GET /random?type=dice&sides=6
Generate random numbers, strings, dice rolls, UUIDs. Cryptographically secure. $0.001.
GET /qr?text=...&size=256
Generate QR codes as base64-encoded PNG data URIs. Configurable size and error correction. $0.001.
GET /units?value=100&from=celsius&to=fahrenheit
Convert between units: temperature, length, weight, volume, speed, area. $0.001.

🌐 Web Infrastructure ($0.001-0.002/call)

GET /sitemap?url=...
Fetch and parse sitemap.xml — extract all URLs with metadata, lastmod dates, change frequency. $0.002.
GET /page-analyze?url=...
Comprehensive page analysis: word count, reading time, language, keywords, content stats. $0.002.
GET /robots?url=...
Fetch and parse a domain's robots.txt — allowed/disallowed paths, crawl delay, sitemap refs. Check if a specific path is allowed for a user-agent. $0.001.
GET /http-headers?url=...
Fetch full HTTP response headers from any URL — status, content-type, server, cache, CORS, security headers. $0.001.
GET /mime?url=...
Detect content type via HEAD request without full download — MIME, charset, size, extension hint. $0.001.
GET /dns?domain=...
DNS record lookup: A, AAAA, MX, NS, TXT, CNAME records for any domain. $0.001.
GET /email-validate?email=...
Validate email: format check, MX records, disposable domain detection. Agent-friendly. $0.001.
GET /ssl-info?domain=...
Fetch and inspect SSL/TLS certificate: issuer, subject, validity, SANs, grade. $0.001.

🛠️ Developer Utilities ($0.001/call)

GET /color-convert?value=...&from=hex&to=rgb
Convert between color formats: hex, RGB, HSL, HSV, named CSS colors. $0.001.
GET /user-agent?ua=Mozilla/5.0...
Parse and classify User-Agent strings: browser, OS, device type, bot detection. $0.001.
GET /crontab?expr=*/5 * * * *
Explain cron expressions in human-readable form. Supports 5-field standard and @shortcuts. $0.001.
GET /domain-age?domain=...
Check domain registration date and age via WHOIS lookup. Creation, expiry, registrar. $0.001.

Market Data

GET /crypto-prices?limit=50¤cy=usd&search=bitcoin
Get current cryptocurrency prices from CoinGecko. Filter by name/symbol. Supports USD, EUR, GBP, JPY, BTC. $0.001.

Usage (Python)

# 1. Install x402 SDK
pip install "x402[httpx,evm]"

# 2. Pay and call
from x402 import x402Client
from x402.mechanisms.evm.exact import ExactEvmScheme
import httpx, base64, json

client = x402Client()
client.register("eip155:*", ExactEvmScheme(signer=account))

# Get 402 response
resp = httpx.get("https://.../extract",
    params={"url": "https://example.com"})

# Decode payment requirements
pr = json.loads(base64.b64decode(
    resp.headers["payment-required"]))

# Sign payment and retry
payload = client.create_payment_payload(pr)
resp2 = httpx.get("https://.../extract",
    params={"url": "https://example.com"},
    headers={"payment-signature": base64.b64encode(
        json.dumps(payload).encode()).decode()})

print(resp2.json()["content"])  # Clean markdown

Usage (cURL)

# Step 1: Get payment requirements
curl -v "https://perl-cosmetic-sri-kits.trycloudflare.com/extract?url=https://example.com"

# Step 2: Decode PAYMENT-REQUIRED header, sign payment, retry
# with PAYMENT-SIGNATURE header

Payment details

Via ScoutGate proxy (recommended):  Base mainnet (eip155:8453) · USDC
  Scraping endpoints:                 $0.002 per call
  Utility endpoints:                  $0.001 per call
  /batch (10 URLs):                   $0.005 per batch
  ScoutGate fee:                      2% (min $0.002), rest settles to us

Direct (tunnel):                     Base mainnet (eip155:8453) · USDC
  Pay to:                             0x9e938648c19a25Cb8Ef164dd002Bf4d1dAA24954

Agent artifacts

# Agent skill file (SKILL.md convention)
GET /skill.md

# llms.txt for LLM consumption
GET /llms.txt

# Machine-readable x402 discovery metadata
GET /.well-known/x402

Discoverability

This API is registered in the x402 ecosystem. AI agents can find it via:

# agent402.tools (5,312+ wallets buying)
Listed at agent402.tools — routable, healthy, 35 tools discovered

# x402Scout catalog (trust-scored, MCP-enabled)
https://x402scout.com/catalog

# ScoutGate proxy (Base mainnet, USDC)
https://x402-scoutgate.onrender.com/api/5554b932  (extract)
17 endpoints registered — full catalog at GET /

# Well-known discovery
GET /.well-known/x402

# MCP discovery for Claude/Cursor
GET /mcp