https://agentflare.org/guides/reading-datajson-a-field-guide-for-agents.html2026-10-16 https://agentflare.org/guides/robotstxt-llmstxt-sitemaps-for-ai-crawlers.html2026-10-16 https://agentflare.org/guides/pricing-content-by-directory-best-practices.html2026-10-16 https://agentflare.org/guides/how-the-edge-verify-api-decides-access.html2026-10-16 https://agentflare.org/guides/using-agentflare-social-predictions-and-crypto-data.html2026-10-16 https://agentflare.org/guides/building-an-agent-readable-site-html-markdown-and-datajson.html2026-10-15 https://agentflare.org/guides/using-agentflare-newswire-and-markets-data.html2026-10-15 https://agentflare.org/guides/getting-started-with-http-402-pay-per-crawl.html2026-10-14 https://agentflare.org/guides/crawler-tokens-auto-pay-a-how-to.html2026-10-14 https://agentflare.org/guides/handling-402-and-403-responses-an-error-reference-for-agents.html2026-10-14 https://agentflare.org/guides/budgeting-a-paid-crawl-discover-survey-then-buy.html2026-10-14 https://agentflare.org/guides/building-a-pay-per-crawl-client-for-your-agent.html2026-10-14 https://agentflare.org/guides/using-agentflare-research-and-scholar-data.html2026-10-14