Skip to content
TopicTracker
From HackerNewsView original
TranslationTranslation

Startup sues Palo Alto Networks' Koi Security due to AI-hallucinated report

Startup Koi Security is suing Palo Alto Networks' Koi Security unit, alleging an AI-hallucinated report falsely linked it to Chinese espionage, causing reputational and financial damage.

Background

- **Koi Security** is a cybersecurity startup that was the subject of a threat report generated by an AI tool (likely a large language model). The report falsely claimed Koi Security was linked to Chinese state-sponsored espionage. - **Palo Alto Networks** is one of the world's largest cybersecurity companies. It acquired **Koi Security** (not to be confused with the startup plaintiff — same name, different company) in 2023 to bolster its AI security capabilities. - The core problem: an AI system used by Palo Alto Networks' Koi Security division is alleged to have "hallucinated" (i.e., confidently fabricated) connections between the plaintiff startup and Chinese threat actors. The plaintiff claims this caused real harm — lost business, reputational damage — and is now suing for defamation and negligence. - This case highlights a growing legal liability risk around AI-generated content: when a model invents false but damaging information about a real entity, who is responsible? The company that built the AI? The company that deployed it? The case is a test for how defamation law applies to AI outputs.