Translation

Cloudflare sets AI crawler deadline: separate search or be blocked

Cloudflare announced new rules requiring AI crawlers to follow a specific protocol for data collection or risk being blocked. The company aims to give website owners more control over how their content is used by AI models, requiring crawlers to identify themselves clearly and respect site policies.

Background

- **Cloudflare** is a major internet infrastructure company that runs a global content delivery network (CDN) and offers services like DDoS protection, website security, and bot management. Many websites route their traffic through Cloudflare. - The company is now taking a stance on **AI crawlers** — automated bots that scrape website content to train large language models (LLMs) like ChatGPT, Google's Gemini, and others. Publishers have increasingly complained that these crawlers use their content without permission or compensation. - Cloudflare already gave site owners tools to block such bots. The new policy goes further: any AI crawler that wants to access Cloudflare-protected sites must publicly identify itself via a standard "user-agent" string (like "GPTBot" or "Google-Extended") and obey the site's robots.txt rules. If it doesn't, Cloudflare will block it automatically by default. - This matters because many AI crawlers have been disguising their identity or ignoring opt-out signals. It also pressures AI companies to negotiate licensing deals with publishers rather than taking data without permission.

RT Max Weinbach: I had early access to this model and I'll post more Thursday, but I think the most impressive part is this model NEVER GIVES UP If yo...
9.0
Max Weinbach says he had early access to OpenAI's new model GPT-5.6 Sol, calling it his favorite model by far. He highlights that it never gives up and will keep reasoning until it's done. OpenAI announced that GPT-5.6 Sol, along with Terra and Luna, will launch publicly on Thursday, with preview access expanding globally now.
Statement on the US government directive to suspend access to Fable 5 and Mythos 5
9.0
The US government ordered Anthropic to suspend access to its Fable 5 and Mythos 5 models for all customers, citing a potential jailbreak technique that involved asking the model to review a codebase for vulnerabilities—a capability Anthropic says is available in other public models. Access was abruptly cut off on June 12.
This is a super exciting release - Claude Fable 5 is the same underlying model as Mythos but with added safeguards. The benchmarks are great and it's ...
9.0
Andrej Karpathy announces the release of Claude Fable 5, the same underlying model as Mythos but with added safeguards. He calls it a major step forward, particularly for long problem-solving sessions on difficult tasks, and describes it as state-of-the-art on nearly all benchmarks with exceptional performance in software engineering, research, and vision.
RT Roman Storm 🇺🇸 🌪️: The gov't theory in my case isn't about me. It's a template. Under US v. Storm, "money transmitting" no longer require...
8.5
Roman Storm warns that the legal theory in his case could set a precedent making open-source developers liable for how others use their code, potentially criminalizing the mere publication of privacy, messaging, or crypto tools. He notes that developer Michael Lewellen cannot publish lawful code due to prosecution fears, and argues this chilling effect extends beyond any single case.
‘Why Is Meta Destroying Its Engineering Organization?’
8.5
Meta's engineering culture is deteriorating under Mark Zuckerberg and Scale AI CEO Alexandr Wang, who have introduced keyboard tracking, reassignments to data labeling, and AI-centric performance metrics. Critics argue this incentivizes performative AI use, drives away experienced engineers, and contributed to a major Instagram hijacking incident caused by AI-written and AI-reviewed code.

Cloudflare sets AI crawler deadline: separate search or be blocked

Background

Related stories

RT Max Weinbach: I had early access to this model and I'll post more Thursday, but I think the most impressive part is this model NEVER GIVES UP If yo...

Statement on the US government directive to suspend access to Fable 5 and Mythos 5

This is a super exciting release - Claude Fable 5 is the same underlying model as Mythos but with added safeguards. The benchmarks are great and it's ...

RT Roman Storm 🇺🇸 🌪️: The gov't theory in my case isn't about me. It's a template. Under US v. Storm, "money transmitting" no longer require...

‘Why Is Meta Destroying Its Engineering Organization?’