Xenarch vs Cloudflare pay per crawl
Prerequisites
- A wallet on Base. This wallet receives the USDC.
- An email address you can confirm.
- Your content served over HTTPS.
Step 1: Sign in with your wallet
Open dash.xenarch.dev and sign in with your wallet (Sign-In with Ethereum on Base). The wallet you sign in with becomes your receiving wallet, so payments go to it from the first request. The dashboard asks you to confirm an email address before you add your first site.Step 2: Add your site
WordPress and Joomla sites skip this step. Their plugins pair with your account through a Connect with Xenarch button (see Step 4). For every other integration, go to Sites > Add site in the dashboard, pick the integration, and copy the site token (st_...). The token is shown once.
Step 3: Set pricing and gating
New sites start at $0.001 per page. AI Search bots pass free and the other five bot categories (AI Assistants, AI Agents, AI Training, Scrapers, General AI) are gated. Change both in the dashboard on the site’s page. You can also set pricing from the terminal. Sign in with the same wallet first (--qr pairs a phone wallet over WalletConnect):
billing_scope is page (each page is paid separately) or path (one payment covers the whole path).
--confirm to skip the confirmation prompt in scripts.
Step 4: Install an integration
- WordPress
- Joomla
- Cloudflare Worker
- FastAPI (Python)
- Custom server
- Install the plugin. It is not in the WordPress.org directory yet. Build the zip from the xenarch-plugins repository and upload it under Plugins > Add New > Upload Plugin.
- Open Settings > /xenarch and click Connect with Xenarch.
- Sign in on dash.xenarch.dev, confirm the domain, and you return to WordPress with the site paired.
Step 5: Publish pay.json (optional)
pay.json at /.well-known/pay.json lets agents read your prices before they hit a 402. The WordPress and Joomla plugins serve it for you. For other sites, generate one with your own wallet as the receiver:
--wallet sets both seller_wallet and receiver. See the pay.json spec.
What visitors see
- Humans: the page, unchanged. The integrations only charge bot traffic.
- Search crawlers and social preview bots: the page, free.
- AI bots that pay: they pay USDC to your wallet, retry with
X-Xenarch-Gate-IdandX-Xenarch-Tx-Hash(or a standard x402X-PAYMENTheader with the plugins and the Worker), and get the page. - AI bots that do not pay: HTTP 402 with the payment terms.
Check your earnings
The dashboard shows earnings per site. From the terminal, afternpx xenarch agent login: