Why AI Fails at Technical Documentation (and How to Fix It)

The Pragmatic AI Podcast is sponsored by Tighten.  T-I-G-H-T-E-N. We will take your AI ideas, prototypes or even vibe-coded apps, and we'll take them to production. Scalable and secure. Check us out at tighten.com.

In this episode, Matt Stauffer talks with Sarah O’Keefe, founder and CEO of Scriptorium, about why AI keeps falling short on technical and product content, and what organizations can do about it.

They dig into why dumping unmanaged PDFs into an LLM produces confident but unreliable answers. They also cover how structured, topic-based content and metadata change the outcome, and where AI genuinely shines: summarizing, translating, and transforming content.

The conversation also takes on bigger questions: the “uninvited author” that now sits between writers and readers, deterministic versus probabilistic content, the EU AI Act, digital sovereignty, and why polished output is no longer a proxy for quality.

-----

Editing and transcription sponsored by Tighten - https://tighten.com/

Creators and Guests

Matt Stauffer
Host
Matt Stauffer
CEO of Tighten, where we write Laravel and more w/some of the best devs alive. "Worst twerker ever, best Dad ever" –My daughter
Sarah O'Keefe
Guest
Sarah O'Keefe
Founder and CEO of Scriptorium
Why AI Fails at Technical Documentation (and How to Fix It)
Broadcast by