Learning should change guidance, never permissions
How an AI assistant can learn from your edits without quietly giving itself more power.
- Based on
- An assistant in production whose lessons are proposed in plain words and approved by a person before they apply.
- Not claimed
- That approved lessons always improve the drafts. That has to be measured, one kind of draft at a time.
Plenty of AI tools promise that they learn. Few say what they learn, or who decides.
Here’s how I think about it. An assistant has two kinds of rules. Guidance is how it writes: your tone, your phrasing, the way you open an email to a stockist. Permissions are what it’s allowed to do: which messages it may draft, which claims it may use, and whether anything can go out without you.
Learning should only ever touch the first.
When you edit a draft, that edit is information. If you keep softening the same kind of sentence, the assistant should notice and propose a lesson in plain words, such as “When replying to wholesale buyers, use a more formal greeting.” You read it and decide. If you approve it, it becomes part of the guidance. If you don’t, nothing changes.
What it should never do is learn its way into new permissions. Approving the same kind of reply a hundred times doesn’t mean the assistant may now send it alone. That’s a separate decision, made by a person on the evidence, and reversible with one switch.
It sounds like a fine distinction. It’s the whole thing. An assistant that can quietly widen its own permissions is one bad lesson away from saying something you’d never say, to someone you’d never say it to. An assistant that can only change how it writes, and only with your approval, stays inside the boundary you drew, however much it learns.
There’s an honesty point too. It’s tempting to show founders a chart that says the assistant is “learning your voice”. I’ve stopped making that claim. Fewer edits might mean it’s learning, or that you’re busy, or that you’ve stopped reading closely. What I can show is what changed, who approved it, and how often you still edit each kind of draft. That’s evidence. “Learning your voice” is a story.
Let it learn how to write. Never let it learn what it’s allowed to do.