Your AI Chats Are Not as Private as You Think
I had never heard of Notion AI before this story crossed my desk. My guess is they’re one of those companies that builds an AI product on top of one of the big models, or maybe they’re running an open model they host themselves. Either way, they got breached, and all of their chat transcripts got exposed.
And that is a problem, because people put things into AI chats they absolutely should not.
Rule One: Never Put Anything in a Chat You Would Not Want on a Billboard
Passwords. API keys. Sensitive client data. I see it happen. When I first started using AI heavily, I put too much in myself. I did it once, caught myself, and thought, oh no, I should not have done that. I stopped immediately. But a lot of people never have that moment.
Your chat logs can get exposed two ways. Either there is a breach like this one, or somebody inside the company you are trusting with your data reads them. Both are real risks. The Notion AI situation is a good reminder that when you use an AI tool, there is infrastructure underneath it that you never directly agreed to trust. That infrastructure can get hit too.
The AI Companies Are Not Making This Easy Enough
It has taken the AI companies way too long to build easy, secure ways to get data into these systems without it flowing through the chat itself. Grok has a vault built in where you can share credentials, which is great. Claude does not have anything like that, and I do not understand why. I ended up building my own credential management system so my bots can get what they need without sensitive information ever going into the chat log. It is more complicated than it should be, but it works.
Most small businesses are not going to build something like that. So the practical answer right now is simple: just do not put sensitive stuff in the chat.
What to Do Right Now
If your team uses Notion AI, go look at what has gone through it. Check what your people have been typing in there. If you are using any AI tool, have a conversation with your team about what is and is not appropriate to share in a chat window.
- No passwords in AI chats, ever.
- No API keys or credentials.
- No sensitive client financial or personal information.
- If you are on Notion AI specifically, review your chat history and rotate any credentials that may have been mentioned.
You can even have the Notion AI read back through your own chat logs and flag anything that looks like it needs to be rotated. Use the tool to clean up after itself.
This is not going to be the last time something like this happens. Every AI tool has a supply chain running underneath it, and any part of that chain can have a bad day. The best protection right now is just keeping sensitive information out of the chat in the first place.
Questions about how this affects your setup? Schedule a free IT consultation and we’ll walk through it with you.
Wherever your team is based, ACS provides hands-on managed IT support — see how we help businesses in Central Florida.
