AI Bot Traffic Monitor
Zephr can be integrated with Cloudfare to help site owners audit and control AI bots and crawlers accessing their content. Unlike search engines, AI crawlers do not drive traffic back to sites, and site owners lacked visibility and control over their activity. Without proper measures, creators might resort to paywalls, limiting AI models' access to diverse, high-quality content. This integration provides tools to audit, block, and manage AI crawlers effectively.
This feature is available only if the AI Paywall is enabled in your tenant. To enable it, reach out to Zuora support.
- View which AI services are accessing content and what they scan.
- Instantly block all AI crawlers while deciding on access policies. While Zephr does not currently support this functionality, site owners can contact Support to configure AI crawler blocking through Cloudflare.
- Use dashboard filters to investigate AI provider activity and identify which ones to block. While direct restriction isn’t available on this page, administrators can configure blocking rules using the User Agent node in the Rules Builder.
- Use the report's data on AI bot activity for compliance and deal negotiations.
Prerequisites
- The feature flag feature.aiSiteAudit.enabled is enabled.
- The Zephr tenant must have:
- A site served by Zephr using Cloudflare, with end-user traffic hitting Zephr directly (i.e., no middleware or additional edge provider between the end-user and Zephr).
- A preferred live domain.