Theme

Professional Ethics

Publication

Bootcamp

The Risks of Doing What’s Necessary

Design in the age of Language User Interfaces: the possibilities of AI-driven narrative and its countless risks.

Originally published in Bootcamp. This essay closes a trilogy on design, AI, and self-knowledge, and is where the investigation gets most uncomfortable. If the previous pieces argued that metrics destroy what they try to measure, this one asks: if we replace numbers with narrative, what new risks do we introduce? The crossroads is concrete: how do you design for sensitive territories, grief, trauma, self-knowledge, when everything that performs well in the market destroys them? The answer Pedro builds here comes not from theory but from the experience of designing Amia — a conversational AI for self-reflection — and catching himself reproducing the exact patterns he set out to dismantle. Eight months obsessed with sleep metrics. A smartwatch discarded. Then, months later, building a self-knowledge tool and realizing he was designing the same dashboards and streaks that had imprisoned him. The essay documents what came next: the decision to replace scoring with narrative, the technical and ethical architecture behind progressive question unlocking, the distinction between AI as reflection tool and AI as intimacy simulation.

"The question is no longer whether we should use AI for self-knowledge. That question has already been answered by massive use. The real question is: how do we design this mediation in a way that respects human complexity instead of reducing it?"