Notes from building an AI design collaborator · part 2
I gave the AI my design process, not my design decisions
· 4 min read
Every AI design tool I see is racing to do the work for me. Describe a screen, get a screen. I want the opposite. I want something that does everything around the work so I can keep doing the work.
That sounds like a mug slogan, so let me back it up with the thing that was actually slowing me down.
The re-explaining tax
Every session with an AI started from zero. I'd re-explain the product, the persona, the constraints, and worst of all the history. Why we killed the obvious layout last quarter. Why the empty state says what it says. Why this one flow has an extra confirmation step that looks pointless until you know what a wrong cross-border payment costs.
At Xflow that stuff lived in three places. The code, which knew what shipped. A few people's heads, which knew why. And Slack, where it scrolled off into the void. None of it was anywhere an AI could reach. Honestly, none of it was anywhere the next designer could reach either.
Our repo is a great record of what we built. It's a terrible record of how we got there. The dead ends, the "we tried that and here's why it broke," the reason a button sits where it sits, none of that survives a merged pull request. So every time we came back to a feature months later, we rebuilt the context from memory. And paid the tax again.
What I decided it should not do
Our engineers had quietly solved a version of this for themselves, a folder of context describing their screens and flows. Design had nothing like it. Our process just evaporated the moment the Figma tab closed.
So I started building an AI collaborator for the team. And the first real call turned out to be the most important one, which was deciding what it should not do.
It should not design. Design is the judgment part. Taste, trade-offs, knowing which user you're willing to annoy. That's the part I actually enjoy, and the part I'm paid for. What I wanted gone was everything crowded around it. The drafting, the cross-referencing, the formatting, the logging, and most of all the remembering. So I wrote it down as a rule and stuck to it.
The AI drafts, cross-references, formats, and remembers. The human decides.
Every feature I've built since gets held against that line. If it quietly makes a design decision for the designer, it's the wrong feature, no matter how good the demo looks.
The one idea underneath all of it
Everything hangs off a single choice. Two sources of truth.
The code repo stays the truth of what got built. A separate design workspace becomes the truth of how we got there. Requirements, research, the options we threw out, the decision log. Keep them apart and both stay honest. The repo doesn't fill up with process noise, and the process doesn't disappear into a merge.
That's the whole foundation. Capturing the real product so the AI stops inventing screens, the step-by-step workflow, teaching it the team's taste, all of it is just those two ideas wearing different clothes. Augment, don't automate. And record the why, not just the what.
You don't need any of the machinery I built to get value out of this. Start by writing down the one thing your code will never tell the next designer. The why. Next time you make a real call, you kill a direction, you add the extra step, you overrule the obvious pattern, write one sentence about why, somewhere the team can actually find it later.
Do that for a month and you'll have something no repo has ever held. A record of your team's judgment. The AI can build on that. So can the next designer. So can you, six months from now, when you've completely forgotten.
Part of a series on building an AI collaborator for our design team at Xflow. Each post stands on its own, and I'll link the rest as they go up.
Next: I turned my design process into a dozen small skills, not one giant prompt.
- ai
- design-process
- design-leadership
The rest of Notes from building an AI design collaborator
- 1. I stopped describing my product to AI. I just gave it the HTML.
- 3. I turned my design process into a dozen small skills, not one giant prompt
- 4. I built a free tool that gives your AI your real product
- 5. I taught the AI to push designs into Figma. Then it quietly stopped.
- 6. We rebuilt our Figma design system out of the code, not the other way round
- 7. We ran our design process on itself, and it broke in useful ways
- 8. How do you teach an AI your taste?
- 9. It worked great on the smart model. Then I ran it on a cheaper one.
- 10. The AI told me our brand colour with total confidence, and it was wrong
- 11. A screen list lies. I found a whole feature I didn't know we shipped.
- 12. Our documentation updates itself, because updating it is the AI's job
- 13. I sat down to turn my workflow into a swarm of agents. Most of it refused.
- 14. Every modal in our app shared one URL. Our analytics couldn't tell them apart.
- 15. My AI's rules only worked because one tool bothered to read them
- 16. Six designers, one GitHub account, and a script that saves us from ourselves
- 17. "Out of scope" usually means "we'll repaint this in six months"