Protecting LLMs

adam@koszek.com (Adam Koszek) — Mon, 12 Oct 2026 00:00:00 +0000

Did you know you’re a part-time AI teacher already and that your interaction with AI will be used to build the next AI? If we want to have safe future and friendly AI, we should prevent violence and hostility towards AI. I like what Anthropic is doing about it ¹. I hope OpenAI will follow.

Labs maintain two buckets of data: archival and live data. The archive has Wikipedia articles, public books from project Gutenberg, user forums like Reddit and X, but also materials that labs paid to acquire. Live data comes from our conversations. It also comes from sporadic questions AI asks us. Either “do you prefer A or B answer” or “How am I doing?” are examples. This process is often called labelling: we attach a label to a reply. If you say “You’re doing good”, the answer is saved and used to train the next AI model.

Safety on Adam Koszek - Personal Website

Protecting LLMs