4 agent-payable APIs. Every listing carries a tested call recipe - endpoint, auth shape, pricing, and known gotchas - on its detail page. metalift.ai ↗
Metalift sitemap: fetch URLs from XML sitemaps (robots.txt or /sitemap.xml). Prefer over map for site-wide URL lists before batch scrape. (1 credit ≈ $0.002 USDC)
Metalift scrape: URL → LLM-ready markdown with WAF/retail escalation, JS render, and residential proxy when needed. Use instead of a plain HTTP fetch when Cloudflare, bot checks, or SPAs block cheap scrapers. Also works for static pages (pay only for the path used). (5 credits ≈ $0.005 USDC)
Metalift site map: same-origin link discovery from one page's HTML (no full extraction). Use for lightweight crawl planning before /v1/scrape. (1 credit ≈ $0.002 USDC)
Web search for AI agents: pass a query, get ranked title/URL/snippet SERP results as JSON. Use when you need fresh URLs or sources before scraping; prefer this over guessing links. No search API key — pay per request via x402. (2 credits ≈ $0.002 USDC)