, ,

Some Notion AI chats were exposed in a breach at an AI provider, so pasted passwords should be changed

Attackers who broke into Fireworks AI, a company that runs AI models for other businesses, took more customer data than it first reported. In an update on 9 November, Fireworks said the intruders accessed billing details, resource metadata, stored secrets and, for some customers, “a subset of incomplete model weights and datasets”. It says payment card numbers are not stored on its systems, and that it has not detected any impact on its inference service.

One customer has already felt the effects. Notion, which ran some AI models through Fireworks, says Notion AI chat transcripts used for its Insights feature were exposed for fewer than 1% of workspaces. Notion says this was not a breach of its own systems, that it had cut its connection to Fireworks by 3 November and that it contacted affected customers on 9 November. Its advice: treat the data as exposed, and if you pasted passwords, API keys or other credentials into Notion AI during the incident, change them. If Notion has not contacted you, it says it has not identified your workspace as affected.

Fireworks says the evidence points to a financially motivated criminal group. It connects the attack to LLMjacking, in which stolen access to AI models is sold on to others. The case is a reminder that what you type into an AI tool can pass through companies you may never have heard of.

Sources: Fireworks security bulletin; Notion security advisory


Related