We talk to six people with unique daily struggles
and run into the hard limits of adapting a single interface. Using AI we could unlock an infinite number of interfaces,
generated with empathy to our individual personal situations,
capabilities and needs.

  • Simon Lenz
    Software Engineer—DeepL
  • Matt Seccafien
    Design Engineer—DeepL

AI & accessibility today

Chatbots and agents are a revolution for accessibility

User
research

Interviews

We talked with six people who have a daily physical or cognitive disability and asked them about their setups and their AI use.

Illustration of a video call between Matt and Simon, laid over a calendar with an interview booked on each of six days, Rose’s AI accessibility interview highlighted

Molly

Uses AI as an assistant, not a replacement.

“I do use AI, but only as an assistant for what I’m looking for. Not to do the searching from scratch.”
Illustration of a woman in dark glasses at a desk, holding a letter in one hand and a phone in the other, its camera aimed at the page

Michael

Uses AI as training wheels, not autopilot.

“[…] you have to put your name to things. If it went ahead, did a bunch of tasks, emailed people, and I couldn’t really take it back — that feels … uncomfortable, giving it that much autonomy.”
Illustration of a man in headphones typing on a laptop beside a stack of books

Sarah

With context about you, AI can help you in ways you didn’t anticipate.

“I was really struggling one day … but then, interestingly, it came up with a really insightful reason: it was the drop in barometric pressure. The change had been so fast. And it said that’s really common with people with brain injuries.”
Illustration of a woman at a laptop with her hand to her head, a storm cloud overhead and numbered overlays stacked across her screen

No revolution

  • Chatbots & agents: helpful tools
  • The simple interface is very accessible
  • Trust & reliability are the problem
  • We want assistants, not replacements

Amelia

AI should remove the disability tax on everyday tasks.

“Part of the enjoyable thing in life is struggling through things. Having everything taken care of for you takes away a bit of the fun.”
Illustration from behind of a woman on a video call, holding an enormous laptop, a coffee beside her

Rose

Everyone’s settings are different and incompatible.

“I live in a disabled house […] all our settings are different, even across our iPads. It’s actually an in-house joke: I can’t look at my husband’s iPad, he can’t look at mine, and the kids hate using either.”
Illustration of a woman in dark glasses knitting on a sofa, curtains drawn, with laptops and a stack of tablets beside her

Myron

An interface where you’re already a power user

“If I had an AI box, I could tell it to line up all my headers from cell A1 to A20 and just send it. That would save so much time. That would be a life changer for me.”
Illustration of a man in a wheelchair wearing a headset microphone, working on a spreadsheet at his desk

The limits of
adaptability

Today’s model

One interface for the average person, with tools and settings on top

…and they start to conflict

Sarah’s setup: her browser showing a lecture page, with four extensions laid on it, each a separate layer. Bionic reading bolds the first half of every word, voice control’s number badges land off their targets, a dark mode plugin darkens the page under them, and voice control’s number grid is lost dark on dark. Empty layers below them wait for every preference still to come. The layers start to conflict.

One UI doesn’t fit everyone

  • Setups are very personal
  • Adaptations conflict with each other
  • Configuration costs energy
  • Standards have limits
Two identical fishbowls side by side on a table. In one, a small fish swims at ease; in the other, a fish far too big for it is crammed in against the glass, water splashing over the rim.

A UI generated for your needs.

  • your circumstances
  • your state of mind
  • your external environment

Empathy is
our point

Intent What you’re trying to do

Empathy Who you are right now

AI already generates UIs

A Google AI Mode answer about transcription: a generated, animated diagram of DNA, RNA polymerase and a ribosome, with a dropdown, phase tabs and a progress slider, marked AI-generated
Google AI Mode
A visual Claude made in a chat about a slow file transfer: presets for Wi-Fi and Ethernet, sliders for link rate, efficiency and data size, bars comparing speeds and the time the transfer will take
Claude, inline visual
A Claude artifact, Checkout v2 experiment readout: an interactive chart of the lift in conversion over three weeks, with a hover tooltip for one day
Claude, artifact

One task, many UIs

Three stacks side by side, each starting from the same intent, I’d like to translate this text, and gathered by a bracket into an arrow pointing down at the UI made from it. Rose’s: condition, hyperphotosensitivity; environment, on the couch, curtains drawn; situation, a medium energy budget today; and below it an iPad with a dark, dim translator. Myron’s: a spine injury, steering by head; at his desk, headset on; focused on a spreadsheet; and below it a monitor with a translator that only listens. A third, unnamed person’s, drawn fainter: needs reading glasses; in a crowded subway, one hand free; running late, heatwave, stressful; and below it a phone with big buttons in reach of the thumb. Past it, another empty stack runs off the edge.

Launching
is creating

Apps aren’t built for you

Google Maps directions from Tempelhofer Feld in Berlin to The Brewery in London, 21 hr 48 min by car, with route options to avoid highways, tolls and ferries

The economics changed

“We are excited about a future where users […] have access to an infinite catalog, where the right ephemeral interface is generated on the spot tailored for their need.”
Google Research

Rose
(8 months later)

Her own app picks a game for her energy budget.
Built by her, for her.

Illustration of the same woman in dark glasses on her sofa, the knitting put down, holding up her iPad, her Steam Deck on the seat beside her; a zoomed-in circle shows the iPad’s screen: her own app, with a slider for her energy budget and the game it picks

Chatbots and agents are a revolution for accessibility

By the people,
for the people

Maggie Appleton’s drawing of a barefoot developer: a stick figure in a big orange circle, beside a smaller circle labelled LLM agent
Maggie Appleton, Home-Cooked Software and Barefoot Developers,
Local-first Conference, Berlin, 2024
The thumbnail of the Pragmatic Engineer episode Design Engineering with Maggie Appleton, Design Engineer at GitHub Next: Maggie in a striped sweater, leaning on the back of a chair
The Pragmatic Engineer podcast

Imagine everything
is bespoke

  • Lack of privacy
  • Instability
  • Isolation
  • More dependent on AI
Rose, Myron and Sarah, each sealed in a bubble of their own with a screen made only for them, floating apart. Among them float more bubbles, faded: everyone else, each sealed in one too.

Closing

Back to Sarah

Illustration of Sarah typing at her laptop with both hands, the sun and a rainbow out of the window behind her and one calm page of large text on her screen

Thank you!

Your UI
is not my UI

your-ui-is-not-my-ui.cartogram.ca