Building Ladders: Extending Human Agency with AI
How AI can build ladders between human intent and digital experiences by adapting to people rather than forcing them to adapt
Large Language Models arenât just AIâtheyâre translators between worlds.
For the first time in history, we have technology that can take expertise locked in one personâs head and make it accessible to someone who thinks completely differently. Not by dumbing it down. Not by forcing adaptation. But by translating between epistemologiesâbetween fundamentally different ways of knowing. LLMs have absorbed countless perspectives across every domain imaginable, giving them the unique ability to reframe any concept through the lens you likely already understand.
I discovered this through my own journey as a translator between worlds. As a developer, I translated between front-end and back-end. As an accessibility coach, between disabled and non-disabled experiences. Now as an AI engineer, between human intention and machine comprehension. But it wasnât until I embedded myself in product teamsâtranslating visual hierarchy for keyboard navigators, helping developers see how loading states affect screen readersâthat I realized what I was actually doing: translating between different ways of knowing.
Then it hit me: Large Language Models do exactly what Iâd been doing manually. They have access to knowledge across disciplines. They can pull the important information relevant to a discipline from unstructured sources. They can reframe complex information using the receiverâs own mental models. They act as translators between different epistemologies. If accessibility coaching is translating between ways of knowing in order to help teams build inclusive experiences, then AI engineering is building the translators themselvesâgiving everyone the ability to approach domains that were previously opaque to them.
The Vision That Drives Everything
To make the digital world equitable by enabling everyone to reach expertise and capabilities that were previously impossible for them to accessâthrough patterns that encode human expertise and adapt to how each person thinks.
This isnât about making things easier. Itâs about recognizing that expertise shouldnât be gatekept by whether you think in the ârightâ way. That innovation shouldnât be limited to those who intuitively grasp our current interfaces. That human potential shouldnât be constrained by the historical accident of how we built our tools. Just because youâre better at using technology doesnât make you smarter or your perspective more important.
The Rule We Need to Break
For decades, computing has followed one ironclad rule: humans adapt to computers.
We memorize keyboard shortcuts. We learn programming syntax. We internalize the logic of file systems and command lines. We learn to navigate the mazes of forms and cookie banners. This has left the benefits of computing to concentrate among those who think like computersâor can afford to pay someone who does.
But what if we could flip this entirely?
What if computers adapted to humans?
Hereâs what that looks like in practiceâand why it matters for how we think about AI.
The Moment It Clicked: Apple Math Notes
I was in college when a math major friend complained about LaTeX. âIâve been writing equations by hand for fifteen years,â he said. âNow I have to learn a new language just to write what I already know how to write?â
Fast forward to iOS 18âs Math Notes. You write equations by hand. The system recognizes your notation and computes the results and even graphs it. No new syntax. No learning to navigate a TI-84âs menus (if you know, you know). No adaptation required.
Think about what this means. We developed mathematical notation over centuriesâa visual language refined by countless mathematicians. Then computers arrived and said: âForget all that. Learn our way.â and just because of their power, we said âokâ. What if computers donât have to be this way. What if everyone obviously understood that because you donât know how to use an antiquated calculatorâs menus, it doesnât make you incapable of advanced mathematics?
Math Notes says: âKeep writing how youâve always written. Weâll adapt to youâ and thatâs how computers should be. Theyâre our computers arenât they?
Apple isnât using LLMs in Math Notes, but it is a form of AI. And this same principleâadapting to human conventions rather than forcing humans to adaptâis exactly what LLMs can do with language. They can structure unstructured information into something computers understand while letting us communicate naturally.
This is what AI can enableânot forcing us to abandon human conventions refined over millennia, but building ladders that let us reach capabilities we couldnât access before. These arenât bridges connecting existing abilitiesâtheyâre ladders that help us climb, rung by rung, to entirely new forms of engagement with complex domains. They transform disciplines that seemed impossible into something we can finally grasp on our own terms.
My Contribution to the Movement: Alt Text Generation
As an accessibility expert, Iâve spent years developing a methodology for creating meaningful alt text. The questions I ask, the patterns I look for, the way I decode author intentionâthis is expertise that took years to develop. But what if I could encode that expertise into a pattern that anyone could use?
Thatâs exactly what I did. I mapped my personal methodologyâthe exact line of questioning I use when writing alt textâinto a programmatic pattern. Now anyone can access my expertise to create equivalent experiences for screen reader users.
The Creatorâs Epistemology Is Already There
Hereâs the key insight: The creatorâs epistemologyâtheir way of understanding and organizing informationâis embedded throughout the pageâs markup. Itâs in the heading hierarchy, the proximity of elements, the metadata, the structural choices.
The creatorâs intention exists in one representation (visual design, HTML structure, content relationships) and can be interpolated through noticing and comparing various details on the page in tandem with the content itself.
I can write these observation instructions and recipes in reusable prompts. Then that makes my accessibility expertise a reusable pattern that can snap a creatorâs intention to the nearest mapping to the accessibility APIs that others depend on. I imagine it working somewhat like a drum machineâs beat quantizing functionality that can snap an imperfectly timed beat to the nearest correctly timed beat.
For alt text, I can use the following information that can be programmatically extracted from any page and transform it into a contextual alternative for that photo that fits within the needed ~120 character mark for an ideal alt text size for screen reader UX. This is modality translation in actionâconverting visual information to text.
- Page structure reveals information hierarchy through DOM headings, page title and the website itself indicates author intention (sales, news, social media, etc).
- Proximity and size indicates relationships through surrounding text blocks
- Visual design encodes importance through the image itself (the 1000 words in an image)
- Structural patterns show usage through element positioning
This is the power of encoding expertise as a ladder. I took my years of experience and mapped it to a structured prompt with output instructions specific to screen reader UX. Now itâs a reusable pattern others can climb. A creator can express their vision using their own words, and my encoded expertise helps translate that intention into the correct symbolic representation for users who depend on accessibility metadata.
How It Actually Works
When I see a graph labeled âSemantic Feature Spaceâ with four words plotted by gender and age, I can begin the process of decoding the visual information using the visual semantics and conventions Iâve internalized throughout my life. That understanding comes from synthesizing multiple signals: the visual pattern, the surrounding explanation, the pageâs educational context.
The AI does the same synthesis:
Source: CMU Word Embedding Demo Tutorial
It reads the surrounding text: âTwo refer to males, two to females. Two refer to adults, two to children.â It sees the graph structure. It understands from the page context this is educational material about word embeddings.
Then it generates not just a description, but an equivalent experience:
Alt text: âScatter plot showing four words plotted by gender and age coordinates in semantic feature space.â
Structured alternative for those who want details:
Word | Gender (X-axis) | Age (Y-axis) | Semantic Position |
---|---|---|---|
man | 1 (male) | 7 (adult) | Male adult characteristics |
woman | 9 (female) | 7 (adult) | Female adult characteristics |
boy | 1 (male) | 2 (child) | Male child characteristics |
girl | 9 (female) | 2 (child) | Female child characteristics |
The Movement Is Already Here
This approach is already emerging at scale. Fabric, an open-source framework by Daniel Miessler, collects âpatternsââbattle-tested prompts encoding expert thinking. Each pattern is a ladder, with rungs that guide users step by step through expert reasoning.
Take the Extract Wisdom pattern, for example. It can take any contentâa two-hour YouTube interview, a dense research paper, a rambling podcastâand extract the key insights, memorable quotes, and references. In minutes, you get the wisdom that would take hours to extract manually. Itâs not replacing deep engagement; itâs helping you decide what deserves that deep engagement. As Miessler explains in this breakdown of Fabric, itâs about filtering signal from noise so you can focus your limited time on what matters most.
The philosophy is profound: âAI isnât a thing; itâs a magnifier of a thing. And that thing is human creativity.â What Iâve shown with accessibility, others are doing for security analysis, content creation, code review. Experts arenât losing their value by sharing patternsâtheyâre multiplying their impact. The infrastructure for sharing expertise is being built.
The Choice: Walls or Ladders
Right now, as you read this, AI and technology at large, is being deployed in two fundamentally different ways:
Walls: Dark patterns that manipulate. Systems that obscure their workings. Tools that create dependency. Corporate AI designed to extractâyour attention, your data, your agency.
Ladders: Tools that reveal their reasoning through glass box approaches. Systems that teach while they assist. Ladders with clear rungs connecting different ways of understanding. AI that extends human agency rather than replacing it.
The choice seems obvious. But look around. How many AI tools actually empower versus extract?
Standing on Open Shoulders
Iâd like you to pause and reflect on your life. How did you get here? How did you learn what you know? What tools do you rely on everyday to make a living or to bring joy into your life and the lives of your loved ones. What is the force that raises the tides of us all?
The answer for most of us is openness.
If youâre technical, you built on open protocols and learned from shared code. If youâre not, you still benefit from openness every dayâWikipediaâs free knowledge, open source software running your favorite apps, free tutorials teaching you new skills, community forums answering your questions.
The pioneers of the last technical revolution chose to share knowledge rather than gatekeep it. They gave us View Source
. They gave us free browsers that render the web. They gave us open standards that let anyone participate. They gave us the ability to learn by seeing, by copying, by understanding.
Now itâs our turn. And the stakes are higher.
This Is THE Challenge of Our Time
Marshall McLuhan: âWe shape our tools, and thereafter our tools shape us.â
Never more true than now. The AI systems we build today will shape how billions interact with information, services, each other. We continue on this trajectory where we build systems that demand human adaptation, that gatekeep knowledge, that maintain existing power structures, that continue the onslaught of slop and enshittification.
Or we can build ladders.
Not someday. Right now.
Every tool you create. Every pattern you share. Every word you writeâwhether itâs code, content, or community guidelines. Each is a vote for the world you want. The infrastructure of openness surrounds us: open source software user interfaces, free browsers rendering the web, and now free or incredibly cheap tech support via AI that can run locally on your own computer indefinitely.
Your Turn
The tools are in our collective hands. Local models. Open frameworks like Fabric. Accessible APIs. We have everything we need.
But having tools isnât enough. The question is: What will you build with them?
My ask of you is this:
Build ladders, not walls.
Make your unique perspective multiplied. Allow others to benefit from your unique perspective and approach.
Take your expertiseâwhatever domain you know deeplyâand encode it as patterns others can use. That accessibility formula youâve perfected? Make it a ladder. That security analysis process youâve refined? Lay it down for others to climb. That creative workflow that took you years to develop? Turn it into a pattern that can serve humanity indefinitely.
Build tools that see people in all their complexity and help them engage with the world on their own terms. Build systems that trust users rather than trapping them. Build ladders between ways of knowing rather than enforcing a single pathâeach rung a manageable step toward understanding.
Remember the open spirit that gave you your start. Pay it forward. Use your skills not to create higher barriers, but to build adaptable ladders that others can climb. Contribute patterns. Share your perspectives. Multiply your impact.
Because hereâs the truth: The most profound innovations donât come from making people adapt to our tools. They come from people creating tools for the service of others â tools that make people more capable.
The question isnât whether AI will change how knowledge moves through the world. The question is whether that knowledge will flow freely or be dammed up behind artificial walls.
This is why I call to you: Build ladders. The world is waiting to climb.