{"id":11982,"date":"2025-07-29T11:28:09","date_gmt":"2025-07-29T11:28:09","guid":{"rendered":"https:\/\/wealthbankers.com\/academy\/?p=11982"},"modified":"2025-07-29T11:32:36","modified_gmt":"2025-07-29T11:32:36","slug":"cloudflare-ai-scrapers-website-blocking-bots","status":"publish","type":"post","link":"https:\/\/wealthbankers.com\/academy\/cloudflare-ai-scrapers-website-blocking-bots\/","title":{"rendered":"Cloudflare vs. AI Scrapers: What Website Owners Need to Know About Blocking AI Bots"},"content":{"rendered":"\n<p>In the fast-evolving world of artificial intelligence, content is currency \u2014 and website owners are increasingly realizing that their original work is being scraped, indexed, and even used to train AI models, often without consent or compensation. <br><br>In response to growing demand for control, <strong>Cloudflare \u2014 a leading internet security and performance platform \u2014 has launched powerful new tools to let website owners block AI bots<\/strong> from accessing their content.<\/p>\n\n\n\n<p>This article dives deep into what these changes mean, how they work, and whether or not blocking AI bots could hurt your SEO and search traffic.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">What\u2019s Happening: Cloudflare\u2019s New AI Bot Controls<\/h2>\n\n\n\n<p>In mid-2025, Cloudflare introduced a major update that lets website owners easily manage whether or not AI bots can crawl and use their content. This includes a new <strong>\u201cAI Bot Management\u201d<\/strong> setting on the Cloudflare dashboard with three core options:<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Cloudflare AI Bot Options:<\/h3>\n\n\n\n<ol class=\"wp-block-list\">\n<li><strong>Block on all pages<\/strong>\n<ul class=\"wp-block-list\">\n<li>Blocks all known AI bots from accessing your site \u2014 no scraping, no indexing, no training.<\/li>\n\n\n\n<li>Applies site-wide.<\/li>\n<\/ul>\n<\/li>\n\n\n\n<li><strong>Block only on hostnames with ads<\/strong>\n<ul class=\"wp-block-list\">\n<li>Blocks AI bots <strong>only<\/strong> on subdomains or sections of your site that display advertisements (e.g. blog.example.com).<\/li>\n\n\n\n<li>Allows AI bots on non-commercial sections.<\/li>\n<\/ul>\n<\/li>\n\n\n\n<li><strong>Do not block (off)<\/strong>\n<ul class=\"wp-block-list\">\n<li>Allows all AI bots to access your site.<\/li>\n\n\n\n<li>Content can be scraped, indexed, and potentially used for AI training.<\/li>\n<\/ul>\n<\/li>\n<\/ol>\n\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<p><strong>Bonus Option:<\/strong> Cloudflare also allows users to &#8220;instruct&#8221; AI bots to avoid scraping via <code>robots.txt<\/code>, but this relies on <strong>voluntary compliance<\/strong>, and many bots don\u2019t honor it.<\/p>\n<\/blockquote>\n\n\n\n<h2 class=\"wp-block-heading\">What Are AI Bots?<\/h2>\n\n\n\n<p>AI bots are automated crawlers run by companies that develop artificial intelligence models. These bots visit public websites and scrape text, images, code, and metadata to use as training data for large language models (LLMs) like:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>OpenAI&#8217;s GPTBot<\/strong> (used for training ChatGPT)<\/li>\n\n\n\n<li><strong>Anthropic&#8217;s ClaudeBot<\/strong><\/li>\n\n\n\n<li><strong>Google\u2019s AI Overviews \/ Bard crawler<\/strong><\/li>\n\n\n\n<li><strong>Common Crawl<\/strong> (used by many open-source AI models)<\/li>\n\n\n\n<li><strong>PerplexityBot<\/strong><\/li>\n\n\n\n<li>And many others<\/li>\n<\/ul>\n\n\n\n<p>These bots often operate quietly in the background, collecting massive amounts of web data to improve the capabilities of generative AI platforms \u2014 and in some cases, repackage your content without linking back or giving credit.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Why Did Cloudflare Do This?<\/h2>\n\n\n\n<p>Several reasons led Cloudflare to take a stand:<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li><strong>User Demand for Control:<\/strong><br>Publishers and creators have long complained about AI companies using their content without permission or compensation.<\/li>\n\n\n\n<li><strong>AI Ethics and Copyright Issues:<\/strong><br>There\u2019s a growing legal and ethical debate about whether training AI on copyrighted or monetized content constitutes fair use.<\/li>\n\n\n\n<li><strong>New Monetization Opportunities:<\/strong><br>Cloudflare is preparing to launch a <strong>Pay-Per-Crawl<\/strong> licensing system \u2014 allowing site owners to monetize access to their data.<\/li>\n\n\n\n<li><strong>AI Arms Race:<\/strong><br>As AI continues to grow rapidly, giving website owners granular control is seen as a way to balance power between creators and AI companies.<\/li>\n<\/ol>\n\n\n\n<h2 class=\"wp-block-heading\">How the Blocking Actually Works<\/h2>\n\n\n\n<p>Cloudflare blocks AI bots using multiple methods:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Fingerprinting and user-agent detection:<\/strong> Identifies known AI crawlers.<\/li>\n\n\n\n<li><strong>Bot behavior analysis:<\/strong> Detects traffic patterns consistent with scraping.<\/li>\n\n\n\n<li><strong>IP address reputation:<\/strong> Blocks known data center IPs used by bot networks.<\/li>\n\n\n\n<li><strong>WAF rules:<\/strong> Applies Web Application Firewall rules to deny access in real time.<\/li>\n\n\n\n<li><strong>AI Labyrinth (experimental):<\/strong> Sends unauthorized bots into fake, AI-generated pages that waste their resources.<\/li>\n<\/ul>\n\n\n\n<p>These protections are <strong>automatically updated<\/strong> as new bots appear, ensuring your site remains protected without manual rule changes.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Does This Affect SEO and Search Traffic?<\/h2>\n\n\n\n<p>This is one of the most asked \u2014 and misunderstood \u2014 questions. Let\u2019s break it down.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">If You Enable AI Bot Blocking:<\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Your content <strong>will NOT<\/strong> be used to train AI models like ChatGPT or Claude.<\/li>\n\n\n\n<li>Your site <strong>may not appear<\/strong> in <strong>AI-powered summaries, answers, or citations<\/strong> on platforms like:\n<ul class=\"wp-block-list\">\n<li>ChatGPT search mode<\/li>\n\n\n\n<li>Bing Chat \/ Copilot<\/li>\n\n\n\n<li>Google\u2019s AI Overviews (future)<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\">But This Does <em>NOT<\/em> Impact Traditional SEO \u2014 IF You Do It Right<\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Googlebot and Bingbot are <strong>not classified as AI bots<\/strong> in Cloudflare&#8217;s system.<\/li>\n\n\n\n<li>As long as you don\u2019t block those specific bots, your site <strong>will still be indexed<\/strong> and shown in traditional search results.<\/li>\n\n\n\n<li>You can still rank organically, earn traffic from search, and be found via regular queries.<\/li>\n<\/ul>\n\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<p>\ud83d\udca1 <strong>Important:<\/strong> Accidentally blocking Googlebot could destroy your SEO visibility. Always test using Google Search Console and Cloudflare logs.<\/p>\n<\/blockquote>\n\n\n\n<h2 class=\"wp-block-heading\"> Real World Scenarios: What You Should Do<\/h2>\n\n\n\n<figure class=\"wp-block-table\"><table class=\"has-fixed-layout\"><thead><tr><th>Website Type<\/th><th>Recommended Setting<\/th><th>Why<\/th><\/tr><\/thead><tbody><tr><td><strong>News or Ad-Supported Blog<\/strong><\/td><td>Block on all pages OR ads only<\/td><td>Protect monetized content from AI usage<\/td><\/tr><tr><td><strong>Personal Blog \/ Portfolio<\/strong><\/td><td>Do not block<\/td><td>AI visibility may help your exposure<\/td><\/tr><tr><td><strong>E-commerce Store<\/strong><\/td><td>Block on all pages<\/td><td>Prevent product data scraping<\/td><\/tr><tr><td><strong>Documentation \/ Support<\/strong><\/td><td>Do not block (or partial block)<\/td><td>Helpful to be indexed by AI assistants<\/td><\/tr><tr><td><strong>Creative \/ Art Site<\/strong><\/td><td>Block on all pages<\/td><td>Protect intellectual property<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\">How to Monitor AI Bot Access<\/h2>\n\n\n\n<p>Cloudflare provides useful tools to track AI bots:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Bot Analytics Dashboard<\/strong>: See which bots are hitting your site.<\/li>\n\n\n\n<li><strong>Firewall Logs<\/strong>: Check for blocked AI crawlers.<\/li>\n\n\n\n<li><strong>AI Audit Reports<\/strong> (coming soon): View which AI bots tried to crawl your site and when.<\/li>\n<\/ul>\n\n\n\n<p>You can also manually test access:<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\">bashCopyEdit<code>curl -A \"GPTBot\" https:\/\/yoursite.com\n<\/code><\/pre>\n\n\n\n<p>If it returns a 403 Forbidden, the bot is blocked.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Best Practices for Site Owners<\/h2>\n\n\n\n<ol class=\"wp-block-list\">\n<li><strong>Don\u2019t block all bots blindly.<\/strong><br>Use Cloudflare\u2019s targeted AI bot controls instead of generic \u201cBot Fight Mode,\u201d which can block useful bots too.<\/li>\n\n\n\n<li><strong>Update your <code>robots.txt<\/code>.<\/strong><br>Add entries like: txtCopyEdit<code>User-agent: GPTBot Disallow: \/<\/code> This helps instruct compliant bots not to crawl your content.<\/li>\n\n\n\n<li><strong>Monitor search traffic.<\/strong><br>Use Google Search Console and Bing Webmaster Tools to ensure you&#8217;re still indexed properly.<\/li>\n\n\n\n<li><strong>Consider monetization.<\/strong><br>Stay tuned to Cloudflare\u2019s Pay-Per-Crawl initiatives \u2014 they may let you license your content to AI companies legally and profitably.<\/li>\n<\/ol>\n\n\n\n<h2 class=\"wp-block-heading\">Final Thoughts<\/h2>\n\n\n\n<p>Cloudflare\u2019s move to empower site owners is a <strong>major step forward in digital sovereignty<\/strong>. In an era where AI companies are hungry for training data, website owners now have a clearer choice: <strong>opt-in or opt-out<\/strong> \u2014 and decide how their content is used.<\/p>\n\n\n\n<p>Whether you&#8217;re protecting ad revenue, preserving intellectual property, or just asserting control over your digital footprint, Cloudflare\u2019s AI bot blocking tools give you the leverage to act.<\/p>\n\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<p>\ud83e\udde9 Remember: What you block today may not be part of tomorrow\u2019s AI internet.<\/p>\n<\/blockquote>\n\n\n\n<h2 class=\"wp-block-heading\">Quick FAQ<\/h2>\n\n\n\n<p><strong>Q: Will blocking AI bots hurt my search ranking?<\/strong><br>A: No \u2014 as long as you don\u2019t block Googlebot or Bingbot.<\/p>\n\n\n\n<p><strong>Q: Can AI bots still use my content if I block them?<\/strong><br>A: If blocked via Cloudflare or properly disallowed in robots.txt, most reputable bots will not access your data. But some rogue bots may still try \u2014 which Cloudflare helps detect and stop.<\/p>\n\n\n\n<p><strong>Q: Should I block all AI bots?<\/strong><br>A: Depends on your goals. If you\u2019re monetizing or protecting IP, yes. If you want exposure via AI answers, consider partial access.<\/p>\n\n\n\n<h4 class=\"wp-block-heading\">What Do You Think?<\/h4>\n\n\n\n<p>Are you going to block AI bots on your site? Do you think AI companies should pay for access to publisher content? Let us know in the comments or tag us on social media.<\/p>\n\n\n<style>.kb-row-layout-id11982_44c71e-9d > .kt-row-column-wrap{align-content:start;}:where(.kb-row-layout-id11982_44c71e-9d > .kt-row-column-wrap) > .wp-block-kadence-column{justify-content:start;}.kb-row-layout-id11982_44c71e-9d > .kt-row-column-wrap{column-gap:var(--global-kb-gap-md, 2rem);row-gap:var(--global-kb-gap-md, 2rem);padding-top:var(--global-kb-spacing-sm, 1.5rem);padding-bottom:var(--global-kb-spacing-sm, 1.5rem);grid-template-columns:minmax(0, 1fr);}.kb-row-layout-id11982_44c71e-9d > .kt-row-layout-overlay{opacity:0.30;}@media all and (min-width: 1025px){.kb-row-layout-id11982_44c71e-9d{display:none !important;}}@media all and (max-width: 1024px){.kb-row-layout-id11982_44c71e-9d > .kt-row-column-wrap{grid-template-columns:minmax(0, 1fr);}}@media all and (min-width: 768px) and (max-width: 1024px){.kb-row-layout-id11982_44c71e-9d{display:none !important;}}@media all and (max-width: 767px){.kb-row-layout-id11982_44c71e-9d > .kt-row-column-wrap{grid-template-columns:minmax(0, 1fr);}.kb-row-layout-id11982_44c71e-9d{display:none !important;}}<\/style><div class=\"kb-row-layout-wrap kb-row-layout-id11982_44c71e-9d alignnone kb-v-lg-hidden kb-v-md-hidden kb-v-sm-hidden wp-block-kadence-rowlayout\"><div class=\"kt-row-column-wrap kt-has-1-columns kt-row-layout-equal kt-tab-layout-inherit kt-mobile-layout-row kt-row-valign-top\">\n<style>.kadence-column11982_36cc32-e2 > .kt-inside-inner-col,.kadence-column11982_36cc32-e2 > .kt-inside-inner-col:before{border-top-left-radius:0px;border-top-right-radius:0px;border-bottom-right-radius:0px;border-bottom-left-radius:0px;}.kadence-column11982_36cc32-e2 > .kt-inside-inner-col{column-gap:var(--global-kb-gap-sm, 1rem);}.kadence-column11982_36cc32-e2 > .kt-inside-inner-col{flex-direction:column;}.kadence-column11982_36cc32-e2 > .kt-inside-inner-col > .aligncenter{width:100%;}.kadence-column11982_36cc32-e2 > .kt-inside-inner-col:before{opacity:0.3;}.kadence-column11982_36cc32-e2{position:relative;}@media all and (max-width: 1024px){.kadence-column11982_36cc32-e2 > .kt-inside-inner-col{flex-direction:column;justify-content:center;}}@media all and (max-width: 767px){.kadence-column11982_36cc32-e2 > .kt-inside-inner-col{flex-direction:column;justify-content:center;}}<\/style>\n<div class=\"wp-block-kadence-column kadence-column11982_36cc32-e2\"><div class=\"kt-inside-inner-col\">\n<p>i saw this on cloudflare dashborad v<\/p>\n\n\n\n<h6 class=\"wp-block-heading\">ChatGPT said:<\/h6>\n\n\n\n<p>Could you clarify what you mean by &#8220;v&#8221;? Did you see just the letter &#8220;v&#8221; on your <a>Cloudflare<\/a> dashboard, or was it part of a larger message, status, or setting? If you can share a screenshot or provide more context (such as where exactly you saw it\u2014on a domain overview, under DNS, WAF, analytics, etc.), I can give a much more accurate explanation.<\/p>\n\n\n\n<h5 class=\"wp-block-heading\">You said:<\/h5>\n\n\n\n<p>Block on all pages AI bots will not be able to scrape any content on your site Block only on hostnames with ads AI training bots will be blocked on subdomains that show ads, but allowed otherwise Do not block (off) AI bots will be allowed to scrape content Instruct AI bots to not scrape content<\/p>\n\n\n\n<h6 class=\"wp-block-heading\">ChatGPT said:<\/h6>\n\n\n\n<p>Thanks \u2014 that\u2019s a helpful snippet. What you&#8217;re seeing on your <strong>Cloudflare Dashboard<\/strong> is likely related to their <strong>AI bot management feature<\/strong>, which lets you control whether <strong>AI bots (like web scrapers or AI training bots)<\/strong> can access your content. Here&#8217;s what each setting means:<\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<h3 class=\"wp-block-heading\">\ud83d\udd12 <strong>1. Block on all pages<\/strong><\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Effect:<\/strong> Cloudflare blocks AI bots site-wide.<\/li>\n\n\n\n<li><strong>Use case:<\/strong> You don\u2019t want any AI companies or bots scraping your content \u2014 for any purpose, including training models.<\/li>\n\n\n\n<li><strong>Example:<\/strong> Prevents bots like OpenAI\u2019s GPTBot, Anthropic\u2019s ClaudeBot, or Common Crawl from reading your pages.<\/li>\n<\/ul>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<h3 class=\"wp-block-heading\">\u26a0\ufe0f <strong>2. Block only on hostnames with ads<\/strong><\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Effect:<\/strong> Blocks AI bots <strong>only on subdomains<\/strong> that show ads (e.g., <code>ads.example.com<\/code> or <code>blog.example.com<\/code> with monetization).<\/li>\n\n\n\n<li><strong>Use case:<\/strong> You allow bots on most of your site but want to prevent scraping on sections that generate ad revenue (so your monetized content isn\u2019t used without consent).<\/li>\n<\/ul>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<h3 class=\"wp-block-heading\">\u2705 <strong>3. Do not block (off)<\/strong><\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Effect:<\/strong> AI bots are allowed to crawl and scrape your site.<\/li>\n\n\n\n<li><strong>Use case:<\/strong> You are okay with AI systems using your content for indexing, training, or data gathering.<\/li>\n<\/ul>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<h3 class=\"wp-block-heading\">\ud83e\udde0 <strong>Instruct AI bots to not scrape content<\/strong><\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li>This likely refers to the <code>robots.txt<\/code> rule: txtCopyEdit<code>User-agent: GPTBot Disallow: \/<\/code>\n<ul class=\"wp-block-list\">\n<li>Cloudflare might automatically add or remove those lines depending on your setting.<\/li>\n\n\n\n<li><strong>Note:<\/strong> Not all bots respect <code>robots.txt<\/code>, so active blocking is stronger than instruction.<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<p>Would you like help choosing the best setting for your use case? Let me know your goals (e.g., protect your writing, allow indexing, monetize safely), and I\u2019ll guide you.<\/p>\n\n\n\n<h5 class=\"wp-block-heading\">You said:<\/h5>\n\n\n\n<p>find out more about this situation from the ineternet<\/p>\n\n\n\n<h6 class=\"wp-block-heading\">ChatGPT said:<\/h6>\n\n\n\n<p>Here\u2019s a clearer, updated overview of what\u2019s happening with Cloudflare\u2019s AI bot controls \u2014 based on the specific settings you shared \u2014 along with background context and what it means for your website:<\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<h2 class=\"wp-block-heading\">\ud83d\udd0d Cloudflare AI Bot Management: How It Works<\/h2>\n\n\n\n<h3 class=\"wp-block-heading\">\ud83d\udee0\ufe0f Dashboard Settings Explained<\/h3>\n\n\n\n<p>From your snippet, Cloudflare provides three explicit options in your <strong>Security \u2192 Bots \u2192 AI bot settings<\/strong> panel:<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li><strong>Block on all pages<\/strong> \u2014 Blocks all known AI crawlers across your domain<\/li>\n\n\n\n<li><strong>Block only on hostnames with ads<\/strong> \u2014 Block AI bots <strong>only where ads are served<\/strong>, while leaving other pages crawlable<\/li>\n\n\n\n<li><strong>Do not block (off)<\/strong> \u2014 Allows all AI bots by default<\/li>\n<\/ol>\n\n\n\n<p>These are managed through Cloudflare\u2019s WAF and Bot Management system using ML-based detection, user-agent analysis, and fingerprinting.<a href=\"https:\/\/medium.com\/%40kocerroxy\/cloudflare-just-changed-the-game-for-ai-bots-and-website-owners-are-cheering-2105fb4b3cb5?utm_source=chatgpt.com\" target=\"_blank\" rel=\"noreferrer noopener\">WIRED+7Medium+7Reddit+7<\/a><a href=\"https:\/\/www.reddit.com\/r\/CloudFlare\/comments\/1jdda2o?utm_source=chatgpt.com\" target=\"_blank\" rel=\"noreferrer noopener\">Reddit+1Reddit+1<\/a><a href=\"https:\/\/developers.cloudflare.com\/bots\/additional-configurations\/block-ai-bots\/?utm_source=chatgpt.com\" target=\"_blank\" rel=\"noreferrer noopener\">Reddit+13Cloudflare Docs+13The Cloudflare Blog+13<\/a><\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<h2 class=\"wp-block-heading\">\ud83c\udf10 The Big Picture: Why This Matters Now<\/h2>\n\n\n\n<h3 class=\"wp-block-heading\">\ud83d\udcbc Default Blocking &amp; Pay\u2011Per\u2011Crawl<\/h3>\n\n\n\n<p>As of <strong>July&nbsp;1,&nbsp;2025<\/strong>, Cloudflare began <strong>blocking AI crawlers by default<\/strong> on new accounts, as part of a broader movement toward giving creators control over how their content is used. They\u2019re also rolling out a <strong>Pay\u2011Per\u2011Crawl<\/strong> initiative to enable sites to license access to AI companies.<a href=\"https:\/\/searchengineland.com\/cloudflare-to-block-ai-crawlers-by-default-with-new-pay-per-crawl-initiative-457708?utm_source=chatgpt.com\" target=\"_blank\" rel=\"noreferrer noopener\">WIRED+3Search Engine Land+3LinkedIn+3<\/a><\/p>\n\n\n\n<h3 class=\"wp-block-heading\">\ud83e\udde0 Smarter Bot Detection<\/h3>\n\n\n\n<p>Cloudflare now uses multiple signals \u2014 behavioral fingerprinting, ML models, IP reputation, and even cryptographic signing of bot traffic \u2014 to identify crawling bots, including those evading robots.txt directives.<a href=\"https:\/\/medium.com\/%40kocerroxy\/cloudflare-just-changed-the-game-for-ai-bots-and-website-owners-are-cheering-2105fb4b3cb5?utm_source=chatgpt.com\" target=\"_blank\" rel=\"noreferrer noopener\">Medium<\/a><\/p>\n\n\n\n<h3 class=\"wp-block-heading\">\ud83c\udf00 AI Labyrinth: Tricking Scrapers<\/h3>\n\n\n\n<p>For bots that ignore or bypass blocking rules, Cloudflare offers a new <strong>AI Labyrinth<\/strong> feature. Rather than outright block bots, it sends them through a maze of decoy AI-generated pages, wasting their resources while keeping legitimate users unaffected and remaining invisible to search engines.<a href=\"https:\/\/www.theverge.com\/news\/634345\/cloudflare-ai-labyrinth-web-scraping-bots-training-data?utm_source=chatgpt.com\" target=\"_blank\" rel=\"noreferrer noopener\">Cloudflare Docs+10The Verge+10Reddit+10<\/a><\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<h2 class=\"wp-block-heading\">\ud83e\udde9 How It Relates to Your Dashboard Options<\/h2>\n\n\n\n<p>Your settings snippet maps to these capabilities:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Block on all pages<\/strong>: Enforces default AI crawler blocking. It prevents scraping entirely across your site.<\/li>\n\n\n\n<li><strong>Block only on hostnames with ads<\/strong>: Uses Cloudflare\u2019s ad-detection logic to selectively block AI bots where monetization exists. Other content remains accessible.<a href=\"https:\/\/blog.cloudflare.com\/he-il\/control-content-use-for-ai-training\/?utm_source=chatgpt.com\" target=\"_blank\" rel=\"noreferrer noopener\">Reddit+15The Cloudflare Blog+15Cloudflare Docs+15<\/a><\/li>\n\n\n\n<li><strong>Do not block (off)<\/strong>: Turns off specialized AI-bot rules, leaving only standard bot protections like robots.txt or general Bot Fight\/WAF in place.<\/li>\n<\/ul>\n\n\n\n<p>These align with Cloudflare\u2019s shift toward giving users precise control over bot access \u2014 whether across the board or on specific monetized subdomains.<a href=\"https:\/\/developers.cloudflare.com\/bots\/additional-configurations\/block-ai-bots\/?utm_source=chatgpt.com\" target=\"_blank\" rel=\"noreferrer noopener\">Cloudflare Docs<\/a><\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<h2 class=\"wp-block-heading\">\ud83d\udde3\ufe0f Community Insights &amp; Warnings<\/h2>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Some site owners report bots <strong>ignoring robots.txt<\/strong> altogether \u2014 including those labelled <code>GPTBot<\/code> or other AI scrapers \u2014 which Cloudflare\u2019s systems are now better at detecting.<a href=\"https:\/\/www.reddit.com\/r\/selfhosted\/comments\/1i154h7?utm_source=chatgpt.com\" target=\"_blank\" rel=\"noreferrer noopener\">WIRED+6Reddit+6Reddit+6<\/a><\/li>\n\n\n\n<li>Others warn that advanced bot mitigation modes (like Bot Fight Mode) sometimes interfere with legitimate third-party integrators or even search engine bots if configured too aggressively.<a href=\"https:\/\/www.reddit.com\/r\/CloudFlare\/comments\/1jdda2o?utm_source=chatgpt.com\" target=\"_blank\" rel=\"noreferrer noopener\">Reddit+1Cloudflare Docs+1<\/a><\/li>\n<\/ul>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<h2 class=\"wp-block-heading\">\u2705 Summary Table<\/h2>\n\n\n\n<figure class=\"wp-block-table\"><table class=\"has-fixed-layout\"><thead><tr><th>Setting<\/th><th>What It Does<\/th><th>Best For&#8230;<\/th><\/tr><\/thead><tbody><tr><td><strong>Block on all pages<\/strong><\/td><td>Denies all recognized AI crawlers<\/td><td>Full protection, best if you don\u2019t want any scraping<\/td><\/tr><tr><td><strong>Block only on hostnames with ads<\/strong><\/td><td>Blocks bots only where ads are shown<\/td><td>Monetized sections protected, rest of site open<\/td><\/tr><tr><td><strong>Do not block (off)<\/strong><\/td><td>Allows AI crawling by default<\/td><td>Permissive access when bots are acceptable or desired<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<h2 class=\"wp-block-heading\">\ud83e\udded What Should You Do?<\/h2>\n\n\n\n<ul class=\"wp-block-list\">\n<li>If you want a <strong>clean, global block on AI scraping<\/strong>, use <strong>\u201cBlock on all pages.\u201d<\/strong><\/li>\n\n\n\n<li>If your goal is to <strong>protect revenue-generating ad pages<\/strong>, but still allow bots on support or documentation pages, choose <strong>\u201cBlock only on hostnames with ads.\u201d<\/strong><\/li>\n\n\n\n<li>For <strong>public visibility or SEO reasons<\/strong>, use <strong>\u201cDo not block\u201d<\/strong>, but be aware many AI bots may ignore robots.txt. Monitor via Cloudflare&#8217;s AI Audit or Bot Analytics to manage access selectively.<\/li>\n<\/ul>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<h2 class=\"wp-block-heading\">\ud83d\udccc Additional Notes<\/h2>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Enterprise customers<\/strong> can access more refined control using custom rules and bot scoring (1\u201399 scale) via <strong>Bot Management add-on<\/strong>.<a href=\"https:\/\/developers.cloudflare.com\/bots\/additional-configurations\/block-ai-bots\/?utm_source=chatgpt.com\" target=\"_blank\" rel=\"noreferrer noopener\">Medium+5Cloudflare Docs+5The Cloudflare Blog+5<\/a><a href=\"https:\/\/www.wired.com\/story\/cloudflare-tools-detect-block-ai-bots?utm_source=chatgpt.com\" target=\"_blank\" rel=\"noreferrer noopener\">Reddit+11WIRED+11Reddit+11<\/a><a href=\"https:\/\/developers.cloudflare.com\/bots\/get-started\/bot-management\/?utm_source=chatgpt.com\" target=\"_blank\" rel=\"noreferrer noopener\">The Cloudflare Blog+2Cloudflare Docs+2Cloudflare Docs+2<\/a><a href=\"https:\/\/blog.cloudflare.com\/he-il\/control-content-use-for-ai-training\/?utm_source=chatgpt.com\" target=\"_blank\" rel=\"noreferrer noopener\">WIRED+7The Cloudflare Blog+7WIRED+7<\/a><a href=\"https:\/\/www.linkedin.com\/news\/story\/cloudflare-restricts-ai-crawlers-7479514\/?utm_source=chatgpt.com\" target=\"_blank\" rel=\"noreferrer noopener\">Search Engine Land+2LinkedIn+2WIRED+2<\/a><a href=\"https:\/\/www.reddit.com\/r\/CloudFlare\/comments\/um6fld?utm_source=chatgpt.com\" target=\"_blank\" rel=\"noreferrer noopener\">Reddit<\/a><a href=\"https:\/\/developers.cloudflare.com\/bots\/get-started\/bm-subscription\/?utm_source=chatgpt.com\" target=\"_blank\" rel=\"noreferrer noopener\">Forbes+3Cloudflare Docs+3Cloudflare Docs+3<\/a><\/li>\n\n\n\n<li>The <strong>AI Labyrinth<\/strong> feature is opt-in and can complement blocking by misleading unauthorized bots into consuming useless, bot-only pages.<a href=\"https:\/\/www.theverge.com\/news\/634345\/cloudflare-ai-labyrinth-web-scraping-bots-training-data?utm_source=chatgpt.com\" target=\"_blank\" rel=\"noreferrer noopener\">The Verge+4The Verge+4Reddit+4<\/a><\/li>\n<\/ul>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<p>Would you like help navigating the AI Audit dashboard, setting custom exceptions, or evaluating what works best for your content or subdomains? I\u2019d be happy to guide you.<\/p>\n\n\n\n<p>Related news on Cloudflare AI blocking<\/p>\n\n\n\n<p><a href=\"https:\/\/www.theverge.com\/news\/695501\/cloudflare-block-ai-crawlers-default?utm_source=chatgpt.com\" target=\"_blank\" rel=\"noreferrer noopener\"><\/a><\/p>\n\n\n\n<figure class=\"wp-block-image\"><a class=\"flex flex-col items-center gap-4 overflow-hidden pb-6\" href=\"https:\/\/www.theverge.com\/news\/695501\/cloudflare-block-ai-crawlers-default?utm_source=chatgpt.com\" target=\"_blank\" rel=\"noreferrer noopener\"><img data-recalc-dims=\"1\" decoding=\"async\" data-src=\"https:\/\/i0.wp.com\/platform.theverge.com\/wp-content\/uploads\/sites\/2\/2025\/06\/STKB326_CLOUDFLARE_B.jpg?w=1290&#038;ssl=1\" alt=\"Cloudflare will now block AI crawlers by default\" src=\"data:image\/svg+xml;base64,PHN2ZyB3aWR0aD0iMSIgaGVpZ2h0PSIxIiB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciPjwvc3ZnPg==\" class=\"lazyload\" \/><\/a><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><a class=\"flex flex-col items-center gap-4 overflow-hidden pb-6\" href=\"https:\/\/www.theverge.com\/news\/695501\/cloudflare-block-ai-crawlers-default?utm_source=chatgpt.com\" target=\"_blank\" rel=\"noreferrer noopener\"><img decoding=\"async\" src=\"https:\/\/www.google.com\/s2\/favicons?domain=https:\/\/www.theverge.com&amp;sz=32\" alt=\"\"\/><\/a><\/figure>\n\n\n\n<p><a href=\"https:\/\/www.theverge.com\/news\/695501\/cloudflare-block-ai-crawlers-default?utm_source=chatgpt.com\" target=\"_blank\" rel=\"noreferrer noopener\">The Verge<\/a><\/p>\n\n\n\n<p><a href=\"https:\/\/www.theverge.com\/news\/695501\/cloudflare-block-ai-crawlers-default?utm_source=chatgpt.com\" target=\"_blank\" rel=\"noreferrer noopener\">Cloudflare will now block AI crawlers by default<\/a><\/p>\n\n\n\n<p><a href=\"https:\/\/www.theverge.com\/news\/695501\/cloudflare-block-ai-crawlers-default?utm_source=chatgpt.com\" target=\"_blank\" rel=\"noreferrer noopener\">28 days ago<\/a><\/p>\n\n\n\n<p><a href=\"https:\/\/www.theverge.com\/news\/634345\/cloudflare-ai-labyrinth-web-scraping-bots-training-data?utm_source=chatgpt.com\" target=\"_blank\" rel=\"noreferrer noopener\"><\/a><\/p>\n\n\n\n<figure class=\"wp-block-image\"><a class=\"flex flex-col items-center gap-4 overflow-hidden pb-6\" href=\"https:\/\/www.theverge.com\/news\/634345\/cloudflare-ai-labyrinth-web-scraping-bots-training-data?utm_source=chatgpt.com\" target=\"_blank\" rel=\"noreferrer noopener\"><img data-recalc-dims=\"1\" decoding=\"async\" data-src=\"https:\/\/i0.wp.com\/platform.theverge.com\/wp-content\/uploads\/sites\/2\/2025\/02\/STKB326_CLOUDFLARE_A.jpg?w=1290&#038;ssl=1\" alt=\"Cloudflare is luring web-scraping bots into an 'AI Labyrinth'\" src=\"data:image\/svg+xml;base64,PHN2ZyB3aWR0aD0iMSIgaGVpZ2h0PSIxIiB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciPjwvc3ZnPg==\" class=\"lazyload\" \/><\/a><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><a class=\"flex flex-col items-center gap-4 overflow-hidden pb-6\" href=\"https:\/\/www.theverge.com\/news\/634345\/cloudflare-ai-labyrinth-web-scraping-bots-training-data?utm_source=chatgpt.com\" target=\"_blank\" rel=\"noreferrer noopener\"><img decoding=\"async\" src=\"https:\/\/www.google.com\/s2\/favicons?domain=https:\/\/www.theverge.com&amp;sz=32\" alt=\"\"\/><\/a><\/figure>\n\n\n\n<p><a href=\"https:\/\/www.theverge.com\/news\/634345\/cloudflare-ai-labyrinth-web-scraping-bots-training-data?utm_source=chatgpt.com\" target=\"_blank\" rel=\"noreferrer noopener\">The Verge<\/a><\/p>\n\n\n\n<p><a href=\"https:\/\/www.theverge.com\/news\/634345\/cloudflare-ai-labyrinth-web-scraping-bots-training-data?utm_source=chatgpt.com\" target=\"_blank\" rel=\"noreferrer noopener\">Cloudflare is luring web-scraping bots into an &#8216;AI Labyrinth&#8217;<\/a><\/p>\n\n\n\n<p><a href=\"https:\/\/www.theverge.com\/news\/634345\/cloudflare-ai-labyrinth-web-scraping-bots-training-data?utm_source=chatgpt.com\" target=\"_blank\" rel=\"noreferrer noopener\">Mar 22, 2025<\/a><\/p>\n\n\n\n<p><a href=\"https:\/\/www.wired.com\/story\/cloudflare-blocks-ai-crawlers-default?utm_source=chatgpt.com\" target=\"_blank\" rel=\"noreferrer noopener\"><\/a><\/p>\n\n\n\n<figure class=\"wp-block-image\"><a class=\"flex flex-col items-center gap-4 overflow-hidden pb-6\" href=\"https:\/\/www.wired.com\/story\/cloudflare-blocks-ai-crawlers-default?utm_source=chatgpt.com\" target=\"_blank\" rel=\"noreferrer noopener\"><img data-recalc-dims=\"1\" decoding=\"async\" data-src=\"https:\/\/i0.wp.com\/media.wired.com\/photos\/6862d387b5d0f2cb11745512\/1%3A1\/pass\/Cloudflare-Block-AI-Crawlers-Business-2194278597.jpg?w=1290&#038;ssl=1\" alt=\"Cloudflare Is Blocking AI Crawlers by Default\" src=\"data:image\/svg+xml;base64,PHN2ZyB3aWR0aD0iMSIgaGVpZ2h0PSIxIiB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciPjwvc3ZnPg==\" class=\"lazyload\" \/><\/a><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><a class=\"flex flex-col items-center gap-4 overflow-hidden pb-6\" href=\"https:\/\/www.wired.com\/story\/cloudflare-blocks-ai-crawlers-default?utm_source=chatgpt.com\" target=\"_blank\" rel=\"noreferrer noopener\"><img decoding=\"async\" src=\"https:\/\/www.google.com\/s2\/favicons?domain=https:\/\/www.wired.com&amp;sz=32\" alt=\"\"\/><\/a><\/figure>\n\n\n\n<p><a href=\"https:\/\/www.wired.com\/story\/cloudflare-blocks-ai-crawlers-default?utm_source=chatgpt.com\" target=\"_blank\" rel=\"noreferrer noopener\">WIRED<\/a><\/p>\n\n\n\n<p><a href=\"https:\/\/www.wired.com\/story\/cloudflare-blocks-ai-crawlers-default?utm_source=chatgpt.com\" target=\"_blank\" rel=\"noreferrer noopener\">Cloudflare Is Blocking AI Crawlers by Default<\/a><\/p>\n\n\n\n<p><a href=\"https:\/\/www.wired.com\/story\/cloudflare-blocks-ai-crawlers-default?utm_source=chatgpt.com\" target=\"_blank\" rel=\"noreferrer noopener\">28 days ago<\/a><\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/www.google.com\/s2\/favicons?domain=https:\/\/developers.cloudflare.com&amp;sz=32\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/www.google.com\/s2\/favicons?domain=https:\/\/www.reddit.com&amp;sz=32\" alt=\"\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/www.google.com\/s2\/favicons?domain=https:\/\/medium.com&amp;sz=32\" alt=\"\"\/><\/figure>\n\n\n\n<p>Sources<\/p>\n\n\n\n<h5 class=\"wp-block-heading\">You said:<\/h5>\n\n\n\n<p>does this mean that activating this, AI result will not direct people to may website. does this stop AI platforms from indexing my site? and this this affect my search result traffic from SEO?<\/p>\n\n\n\n<h6 class=\"wp-block-heading\">ChatGPT said:<\/h6>\n\n\n\n<p>Great and very important questions \u2014 let&#8217;s unpack each one carefully, because <strong>blocking AI bots<\/strong> (like Cloudflare now allows) <strong>can impact how your site appears \u2014 or doesn&#8217;t \u2014 in AI results and potentially SEO<\/strong>.<\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<h2 class=\"wp-block-heading\">\u2705 1. <strong>Will activating AI bot blocking stop AI platforms from showing my site in answers?<\/strong><\/h2>\n\n\n\n<p><strong>Yes \u2014 potentially.<\/strong><\/p>\n\n\n\n<p>When you <strong>block AI bots<\/strong>, especially major ones like:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><code>GPTBot<\/code> (OpenAI),<\/li>\n\n\n\n<li><code>CCBot<\/code> (Common Crawl),<\/li>\n\n\n\n<li><code>ClaudeBot<\/code> (Anthropic),<\/li>\n\n\n\n<li>or others like Google\u2019s AI crawlers (when they roll out fully),<\/li>\n<\/ul>\n\n\n\n<p>&#8230;you <strong>prevent them from crawling or accessing your content<\/strong>, meaning they <strong>cannot use your data<\/strong> for:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>training their models<\/strong>, or<\/li>\n\n\n\n<li><strong>answering questions using your site\u2019s content<\/strong>, or<\/li>\n\n\n\n<li><strong>indexing your content in their AI-powered results<\/strong> (like Google&#8217;s AI Overviews or Bing Copilot).<\/li>\n<\/ul>\n\n\n\n<p>So, <strong>yes \u2014 if someone asks an AI a question and your site has the best answer<\/strong>, your site <strong>may not be cited or linked<\/strong> in the response, <strong>because the AI can&#8217;t see it<\/strong>.<\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<h2 class=\"wp-block-heading\">\ud83d\udd0d 2. <strong>Does this stop AI platforms from indexing my site?<\/strong><\/h2>\n\n\n\n<p>It depends on <strong>how you block<\/strong> and <strong>who\u2019s crawling<\/strong>:<\/p>\n\n\n\n<figure class=\"wp-block-table\"><table class=\"has-fixed-layout\"><thead><tr><th>Platform<\/th><th>Respects <code>robots.txt<\/code>?<\/th><th>Blocked by Cloudflare AI settings?<\/th><th>Affects Indexing?<\/th><\/tr><\/thead><tbody><tr><td><strong>Google<\/strong><\/td><td>\u2705 Yes<\/td><td>\u274c Not yet (AI Overviews still use Search index)<\/td><td>\u26a0\ufe0f No (unless you block Googlebot itself)<\/td><\/tr><tr><td><strong>OpenAI (GPTBot)<\/strong><\/td><td>\u2705 Yes<\/td><td>\u2705 Yes<\/td><td>\u2705 Yes<\/td><\/tr><tr><td><strong>Common Crawl<\/strong><\/td><td>\u2705 Yes<\/td><td>\u2705 Yes<\/td><td>\u2705 Yes<\/td><\/tr><tr><td><strong>Bing (Microsoft)<\/strong><\/td><td>\u2705 Yes<\/td><td>\u2753 Somewhat (unclear)<\/td><td>\u26a0\ufe0f Maybe<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<p>So if you&#8217;re <strong>only blocking AI bots<\/strong>, your content may <strong>still appear in search engine results<\/strong> \u2014 like Google or Bing <strong>normal search<\/strong> \u2014 unless:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>You also block Googlebot or Bingbot,<\/li>\n\n\n\n<li>Or use robots meta tags (<code>noindex<\/code>).<\/li>\n<\/ul>\n\n\n\n<p>\u2705 <strong>TL;DR<\/strong>: AI-specific blocking <strong>does not block traditional SEO indexing unless you also block search bots<\/strong>.<\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<h2 class=\"wp-block-heading\">\ud83d\udcc9 3. <strong>Will this hurt my organic SEO traffic?<\/strong><\/h2>\n\n\n\n<p><strong>Generally: No \u2014 unless misconfigured.<\/strong><\/p>\n\n\n\n<p>If you <strong>only block AI bots<\/strong>, your <strong>SEO search traffic from Google, Bing, DuckDuckGo, etc.<\/strong> will likely <strong>not be affected<\/strong>.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">However:<\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li>If you block bots <strong>too aggressively<\/strong> (e.g. with overly broad Cloudflare firewall rules), you <strong>could accidentally block Googlebot or Bingbot<\/strong>, which <strong>would tank your SEO<\/strong>.<\/li>\n\n\n\n<li>Also, <strong>Google\u2019s AI Overviews (in some countries)<\/strong> are starting to display fewer traditional links \u2014 so <strong>not appearing in those AI answers could mean less traffic<\/strong>, even if your site ranks in classic search.<\/li>\n<\/ul>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<h2 class=\"wp-block-heading\">\u2705 What to Do<\/h2>\n\n\n\n<h3 class=\"wp-block-heading\">\ud83d\udd10 If your goal is to:<\/h3>\n\n\n\n<p><strong>Protect content from being used to train AI<\/strong>, but still <strong>appear in search results:<\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\u2705 Enable <strong>AI Bot Blocking in Cloudflare<\/strong><\/li>\n\n\n\n<li>\u2705 Keep allowing Googlebot and Bingbot<\/li>\n\n\n\n<li>\u2705 Use <code>robots.txt<\/code> to block known AI bots: txtCopyEdit<code>User-agent: GPTBot Disallow: \/<\/code><\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\">\ud83d\udcc8 If your goal is SEO traffic:<\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\u26a0\ufe0f Don&#8217;t block traditional search engine bots<\/li>\n\n\n\n<li>\u26a0\ufe0f Test with tools like <a>Google Search Console<\/a> and <a>Bing Webmaster Tools<\/a> to verify bot access<\/li>\n<\/ul>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<h2 class=\"wp-block-heading\">\ud83e\uddea How to Check Impact<\/h2>\n\n\n\n<p>Use tools like:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><code>curl -A GPTBot yoursite.com<\/code> to test if AI bots are blocked<\/li>\n\n\n\n<li>Google Search Console \u2192 <strong>Crawl Stats<\/strong> to ensure Googlebot is unaffected<\/li>\n\n\n\n<li>Cloudflare Bot Analytics \u2192 To monitor actual bot traffic (good\/bad\/AI)<\/li>\n<\/ul>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<p>Would you like a sample <code>robots.txt<\/code> file and a guide to safely configure this in Cloudflare without affecting SEO?<\/p>\n\n\n\n<h5 class=\"wp-block-heading\">You said:<\/h5>\n\n\n\n<p>Read everything about and create a comprhresive and detailed long article on this issues&#8230; providing the readers of my news blog what they want to know as they research this situation<\/p>\n\n\n\n<h6 class=\"wp-block-heading\">ChatGPT said:<\/h6>\n\n\n\n<p>Failed to generate<\/p>\n\n\n\n<p>To create a comprehensive and detailed article in a collaborative format, you\u2019ll need to <strong>log in to ChatGPT<\/strong> to use <strong>ChatGPT canvas<\/strong>. Once logged in, you can generate, edit, and expand articles directly within a document interface.<\/p>\n\n\n\n<p>However, I can begin drafting the full article for you right here. Would you like me to do that now and then you can copy it into your blog or Canvas afterward?<\/p>\n<\/div><\/div>\n\n<\/div><\/div>","protected":false},"excerpt":{"rendered":"<p>In the fast-evolving world of artificial intelligence, content is currency \u2014 and website owners are increasingly realizing that their original work is being scraped, indexed, and even used to train AI models, often without consent or compensation. In response to growing demand for control, Cloudflare \u2014 a leading internet security and performance platform \u2014 has&#8230;<\/p>\n","protected":false},"author":1,"featured_media":11989,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_kad_post_transparent":"","_kad_post_title":"","_kad_post_layout":"","_kad_post_sidebar_id":"","_kad_post_content_style":"","_kad_post_vertical_padding":"","_kad_post_feature":"","_kad_post_feature_position":"","_kad_post_header":false,"_kad_post_footer":false,"_kad_post_classname":"","_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[20],"tags":[],"class_list":["post-11982","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-computers-internet-mobile"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.5 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Cloudflare vs. AI Scrapers: What Website Owners Need to Know About Blocking AI Bots - DevWorld Tech Academy<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/wealthbankers.com\/academy\/cloudflare-ai-scrapers-website-blocking-bots\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Cloudflare vs. AI Scrapers: What Website Owners Need to Know About Blocking AI Bots - DevWorld Tech Academy\" \/>\n<meta property=\"og:description\" content=\"In the fast-evolving world of artificial intelligence, content is currency \u2014 and website owners are increasingly realizing that their original work is being scraped, indexed, and even used to train AI models, often without consent or compensation. In response to growing demand for control, Cloudflare \u2014 a leading internet security and performance platform \u2014 has...\" \/>\n<meta property=\"og:url\" content=\"https:\/\/wealthbankers.com\/academy\/cloudflare-ai-scrapers-website-blocking-bots\/\" \/>\n<meta property=\"og:site_name\" content=\"DevWorld Tech Academy\" \/>\n<meta property=\"article:published_time\" content=\"2025-07-29T11:28:09+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2025-07-29T11:32:36+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/wealthbankers.com\/academy\/wp-content\/uploads\/2025\/07\/futuristic-humanoid-robot-against-a-blue-network-pattern-backdrop-showcasing-modern-technology.-8566474-scaled.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1920\" \/>\n\t<meta property=\"og:image:height\" content=\"2560\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"DevWorld Tech Academy\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"DevWorld Tech Academy\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"15 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/wealthbankers.com\\\/academy\\\/cloudflare-ai-scrapers-website-blocking-bots\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/wealthbankers.com\\\/academy\\\/cloudflare-ai-scrapers-website-blocking-bots\\\/\"},\"author\":{\"name\":\"DevWorld Tech Academy\",\"@id\":\"https:\\\/\\\/wealthbankers.com\\\/academy\\\/#\\\/schema\\\/person\\\/a84632b56d65d50f47c6a1c355924d82\"},\"headline\":\"Cloudflare vs. AI Scrapers: What Website Owners Need to Know About Blocking AI Bots\",\"datePublished\":\"2025-07-29T11:28:09+00:00\",\"dateModified\":\"2025-07-29T11:32:36+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/wealthbankers.com\\\/academy\\\/cloudflare-ai-scrapers-website-blocking-bots\\\/\"},\"wordCount\":2904,\"publisher\":{\"@id\":\"https:\\\/\\\/wealthbankers.com\\\/academy\\\/#organization\"},\"image\":{\"@id\":\"https:\\\/\\\/wealthbankers.com\\\/academy\\\/cloudflare-ai-scrapers-website-blocking-bots\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/i0.wp.com\\\/wealthbankers.com\\\/academy\\\/wp-content\\\/uploads\\\/2025\\\/07\\\/futuristic-humanoid-robot-against-a-blue-network-pattern-backdrop-showcasing-modern-technology.-8566474-scaled.jpg?fit=1920%2C2560&ssl=1\",\"articleSection\":[\"Computers, Internet &amp; Mobile\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/wealthbankers.com\\\/academy\\\/cloudflare-ai-scrapers-website-blocking-bots\\\/\",\"url\":\"https:\\\/\\\/wealthbankers.com\\\/academy\\\/cloudflare-ai-scrapers-website-blocking-bots\\\/\",\"name\":\"Cloudflare vs. AI Scrapers: What Website Owners Need to Know About Blocking AI Bots - DevWorld Tech Academy\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/wealthbankers.com\\\/academy\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/wealthbankers.com\\\/academy\\\/cloudflare-ai-scrapers-website-blocking-bots\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/wealthbankers.com\\\/academy\\\/cloudflare-ai-scrapers-website-blocking-bots\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/i0.wp.com\\\/wealthbankers.com\\\/academy\\\/wp-content\\\/uploads\\\/2025\\\/07\\\/futuristic-humanoid-robot-against-a-blue-network-pattern-backdrop-showcasing-modern-technology.-8566474-scaled.jpg?fit=1920%2C2560&ssl=1\",\"datePublished\":\"2025-07-29T11:28:09+00:00\",\"dateModified\":\"2025-07-29T11:32:36+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/wealthbankers.com\\\/academy\\\/cloudflare-ai-scrapers-website-blocking-bots\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/wealthbankers.com\\\/academy\\\/cloudflare-ai-scrapers-website-blocking-bots\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/wealthbankers.com\\\/academy\\\/cloudflare-ai-scrapers-website-blocking-bots\\\/#primaryimage\",\"url\":\"https:\\\/\\\/i0.wp.com\\\/wealthbankers.com\\\/academy\\\/wp-content\\\/uploads\\\/2025\\\/07\\\/futuristic-humanoid-robot-against-a-blue-network-pattern-backdrop-showcasing-modern-technology.-8566474-scaled.jpg?fit=1920%2C2560&ssl=1\",\"contentUrl\":\"https:\\\/\\\/i0.wp.com\\\/wealthbankers.com\\\/academy\\\/wp-content\\\/uploads\\\/2025\\\/07\\\/futuristic-humanoid-robot-against-a-blue-network-pattern-backdrop-showcasing-modern-technology.-8566474-scaled.jpg?fit=1920%2C2560&ssl=1\",\"width\":1920,\"height\":2560,\"caption\":\"Futuristic humanoid robot against a blue network pattern backdrop, showcasing modern technology.\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/wealthbankers.com\\\/academy\\\/cloudflare-ai-scrapers-website-blocking-bots\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/wealthbankers.com\\\/academy\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Cloudflare vs. AI Scrapers: What Website Owners Need to Know About Blocking AI Bots\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/wealthbankers.com\\\/academy\\\/#website\",\"url\":\"https:\\\/\\\/wealthbankers.com\\\/academy\\\/\",\"name\":\"DevWorld Tech Academy\",\"description\":\"Learn Computer &amp; Business Courses through Real Projects\",\"publisher\":{\"@id\":\"https:\\\/\\\/wealthbankers.com\\\/academy\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/wealthbankers.com\\\/academy\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/wealthbankers.com\\\/academy\\\/#organization\",\"name\":\"DevWorld Tech Academy - Learn Programming and Computer Courses through Real Projects - Best IT School in Accra, Ghana\",\"url\":\"https:\\\/\\\/wealthbankers.com\\\/academy\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/wealthbankers.com\\\/academy\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/i0.wp.com\\\/wealthbankers.com\\\/academy\\\/wp-content\\\/uploads\\\/2020\\\/02\\\/DevWorld-Tech-Academy-image-brand.png?fit=341%2C331&ssl=1\",\"contentUrl\":\"https:\\\/\\\/i0.wp.com\\\/wealthbankers.com\\\/academy\\\/wp-content\\\/uploads\\\/2020\\\/02\\\/DevWorld-Tech-Academy-image-brand.png?fit=341%2C331&ssl=1\",\"width\":341,\"height\":331,\"caption\":\"DevWorld Tech Academy - Learn Programming and Computer Courses through Real Projects - Best IT School in Accra, Ghana\"},\"image\":{\"@id\":\"https:\\\/\\\/wealthbankers.com\\\/academy\\\/#\\\/schema\\\/logo\\\/image\\\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/wealthbankers.com\\\/academy\\\/#\\\/schema\\\/person\\\/a84632b56d65d50f47c6a1c355924d82\",\"name\":\"DevWorld Tech Academy\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/357aaec0bf0fbde819fb3ddb874bdc44494f095b36a6944091cf919fad36f02f?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/357aaec0bf0fbde819fb3ddb874bdc44494f095b36a6944091cf919fad36f02f?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/357aaec0bf0fbde819fb3ddb874bdc44494f095b36a6944091cf919fad36f02f?s=96&d=mm&r=g\",\"caption\":\"DevWorld Tech Academy\"},\"url\":\"https:\\\/\\\/wealthbankers.com\\\/academy\\\/author\\\/frank10\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Cloudflare vs. AI Scrapers: What Website Owners Need to Know About Blocking AI Bots - DevWorld Tech Academy","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/wealthbankers.com\/academy\/cloudflare-ai-scrapers-website-blocking-bots\/","og_locale":"en_US","og_type":"article","og_title":"Cloudflare vs. AI Scrapers: What Website Owners Need to Know About Blocking AI Bots - DevWorld Tech Academy","og_description":"In the fast-evolving world of artificial intelligence, content is currency \u2014 and website owners are increasingly realizing that their original work is being scraped, indexed, and even used to train AI models, often without consent or compensation. In response to growing demand for control, Cloudflare \u2014 a leading internet security and performance platform \u2014 has...","og_url":"https:\/\/wealthbankers.com\/academy\/cloudflare-ai-scrapers-website-blocking-bots\/","og_site_name":"DevWorld Tech Academy","article_published_time":"2025-07-29T11:28:09+00:00","article_modified_time":"2025-07-29T11:32:36+00:00","og_image":[{"width":1920,"height":2560,"url":"https:\/\/wealthbankers.com\/academy\/wp-content\/uploads\/2025\/07\/futuristic-humanoid-robot-against-a-blue-network-pattern-backdrop-showcasing-modern-technology.-8566474-scaled.jpg","type":"image\/jpeg"}],"author":"DevWorld Tech Academy","twitter_card":"summary_large_image","twitter_misc":{"Written by":"DevWorld Tech Academy","Est. reading time":"15 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/wealthbankers.com\/academy\/cloudflare-ai-scrapers-website-blocking-bots\/#article","isPartOf":{"@id":"https:\/\/wealthbankers.com\/academy\/cloudflare-ai-scrapers-website-blocking-bots\/"},"author":{"name":"DevWorld Tech Academy","@id":"https:\/\/wealthbankers.com\/academy\/#\/schema\/person\/a84632b56d65d50f47c6a1c355924d82"},"headline":"Cloudflare vs. AI Scrapers: What Website Owners Need to Know About Blocking AI Bots","datePublished":"2025-07-29T11:28:09+00:00","dateModified":"2025-07-29T11:32:36+00:00","mainEntityOfPage":{"@id":"https:\/\/wealthbankers.com\/academy\/cloudflare-ai-scrapers-website-blocking-bots\/"},"wordCount":2904,"publisher":{"@id":"https:\/\/wealthbankers.com\/academy\/#organization"},"image":{"@id":"https:\/\/wealthbankers.com\/academy\/cloudflare-ai-scrapers-website-blocking-bots\/#primaryimage"},"thumbnailUrl":"https:\/\/i0.wp.com\/wealthbankers.com\/academy\/wp-content\/uploads\/2025\/07\/futuristic-humanoid-robot-against-a-blue-network-pattern-backdrop-showcasing-modern-technology.-8566474-scaled.jpg?fit=1920%2C2560&ssl=1","articleSection":["Computers, Internet &amp; Mobile"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/wealthbankers.com\/academy\/cloudflare-ai-scrapers-website-blocking-bots\/","url":"https:\/\/wealthbankers.com\/academy\/cloudflare-ai-scrapers-website-blocking-bots\/","name":"Cloudflare vs. AI Scrapers: What Website Owners Need to Know About Blocking AI Bots - DevWorld Tech Academy","isPartOf":{"@id":"https:\/\/wealthbankers.com\/academy\/#website"},"primaryImageOfPage":{"@id":"https:\/\/wealthbankers.com\/academy\/cloudflare-ai-scrapers-website-blocking-bots\/#primaryimage"},"image":{"@id":"https:\/\/wealthbankers.com\/academy\/cloudflare-ai-scrapers-website-blocking-bots\/#primaryimage"},"thumbnailUrl":"https:\/\/i0.wp.com\/wealthbankers.com\/academy\/wp-content\/uploads\/2025\/07\/futuristic-humanoid-robot-against-a-blue-network-pattern-backdrop-showcasing-modern-technology.-8566474-scaled.jpg?fit=1920%2C2560&ssl=1","datePublished":"2025-07-29T11:28:09+00:00","dateModified":"2025-07-29T11:32:36+00:00","breadcrumb":{"@id":"https:\/\/wealthbankers.com\/academy\/cloudflare-ai-scrapers-website-blocking-bots\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/wealthbankers.com\/academy\/cloudflare-ai-scrapers-website-blocking-bots\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/wealthbankers.com\/academy\/cloudflare-ai-scrapers-website-blocking-bots\/#primaryimage","url":"https:\/\/i0.wp.com\/wealthbankers.com\/academy\/wp-content\/uploads\/2025\/07\/futuristic-humanoid-robot-against-a-blue-network-pattern-backdrop-showcasing-modern-technology.-8566474-scaled.jpg?fit=1920%2C2560&ssl=1","contentUrl":"https:\/\/i0.wp.com\/wealthbankers.com\/academy\/wp-content\/uploads\/2025\/07\/futuristic-humanoid-robot-against-a-blue-network-pattern-backdrop-showcasing-modern-technology.-8566474-scaled.jpg?fit=1920%2C2560&ssl=1","width":1920,"height":2560,"caption":"Futuristic humanoid robot against a blue network pattern backdrop, showcasing modern technology."},{"@type":"BreadcrumbList","@id":"https:\/\/wealthbankers.com\/academy\/cloudflare-ai-scrapers-website-blocking-bots\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/wealthbankers.com\/academy\/"},{"@type":"ListItem","position":2,"name":"Cloudflare vs. AI Scrapers: What Website Owners Need to Know About Blocking AI Bots"}]},{"@type":"WebSite","@id":"https:\/\/wealthbankers.com\/academy\/#website","url":"https:\/\/wealthbankers.com\/academy\/","name":"DevWorld Tech Academy","description":"Learn Computer &amp; Business Courses through Real Projects","publisher":{"@id":"https:\/\/wealthbankers.com\/academy\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/wealthbankers.com\/academy\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/wealthbankers.com\/academy\/#organization","name":"DevWorld Tech Academy - Learn Programming and Computer Courses through Real Projects - Best IT School in Accra, Ghana","url":"https:\/\/wealthbankers.com\/academy\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/wealthbankers.com\/academy\/#\/schema\/logo\/image\/","url":"https:\/\/i0.wp.com\/wealthbankers.com\/academy\/wp-content\/uploads\/2020\/02\/DevWorld-Tech-Academy-image-brand.png?fit=341%2C331&ssl=1","contentUrl":"https:\/\/i0.wp.com\/wealthbankers.com\/academy\/wp-content\/uploads\/2020\/02\/DevWorld-Tech-Academy-image-brand.png?fit=341%2C331&ssl=1","width":341,"height":331,"caption":"DevWorld Tech Academy - Learn Programming and Computer Courses through Real Projects - Best IT School in Accra, Ghana"},"image":{"@id":"https:\/\/wealthbankers.com\/academy\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/wealthbankers.com\/academy\/#\/schema\/person\/a84632b56d65d50f47c6a1c355924d82","name":"DevWorld Tech Academy","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/357aaec0bf0fbde819fb3ddb874bdc44494f095b36a6944091cf919fad36f02f?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/357aaec0bf0fbde819fb3ddb874bdc44494f095b36a6944091cf919fad36f02f?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/357aaec0bf0fbde819fb3ddb874bdc44494f095b36a6944091cf919fad36f02f?s=96&d=mm&r=g","caption":"DevWorld Tech Academy"},"url":"https:\/\/wealthbankers.com\/academy\/author\/frank10\/"}]}},"jetpack_publicize_connections":[],"jetpack_featured_media_url":"https:\/\/i0.wp.com\/wealthbankers.com\/academy\/wp-content\/uploads\/2025\/07\/futuristic-humanoid-robot-against-a-blue-network-pattern-backdrop-showcasing-modern-technology.-8566474-scaled.jpg?fit=1920%2C2560&ssl=1","jetpack-related-posts":[],"jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/paZWMY-37g","_links":{"self":[{"href":"https:\/\/wealthbankers.com\/academy\/wp-json\/wp\/v2\/posts\/11982","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/wealthbankers.com\/academy\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/wealthbankers.com\/academy\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/wealthbankers.com\/academy\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/wealthbankers.com\/academy\/wp-json\/wp\/v2\/comments?post=11982"}],"version-history":[{"count":2,"href":"https:\/\/wealthbankers.com\/academy\/wp-json\/wp\/v2\/posts\/11982\/revisions"}],"predecessor-version":[{"id":11991,"href":"https:\/\/wealthbankers.com\/academy\/wp-json\/wp\/v2\/posts\/11982\/revisions\/11991"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/wealthbankers.com\/academy\/wp-json\/wp\/v2\/media\/11989"}],"wp:attachment":[{"href":"https:\/\/wealthbankers.com\/academy\/wp-json\/wp\/v2\/media?parent=11982"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/wealthbankers.com\/academy\/wp-json\/wp\/v2\/categories?post=11982"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/wealthbankers.com\/academy\/wp-json\/wp\/v2\/tags?post=11982"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}