Rented Competence
"Why can't we just use this?" I've heard that question more in the last six months than in the previous ten years.
In the era of GenAI, it's a fair question. The AI-built site or app or chatbot works. It was demoed to a client in a pitch and everyone saw it working, so it must be real.
But here's the thing: it's the equivalent of a movie set. A movie set only has to look right for the camera. Walk around the back and you'll see plywood, paint, braces, and sandbags. A demo only has to work along its scripted happy path for the hour or two that one person is showing it.
Dunning-Kruger research found that the skills to produce a correct answer are the same skills needed to judge it. GenAI has pulled them apart. I call this "rented competence": the ability to produce something beyond someone's skill set, but not the ability to judge it. It's an unearned superpower.
Because people with rented competence only ever see the facade from the camera angle, they don't even know to walk around the back to see it's not a real building.
You're not fooled by a facade because you know what a house should be and roughly what it takes to build one. You'd never consider living in a movie set. You wouldn't expect a house to be as quick or as cheap to build as a movie set. And you wouldn't construct the rest of the building around the set. Real buildings require architects, structural engineers, licensed plumbers and electricians, and are inspected for safety.
Everyone uses software. Almost no one knows how it's built or what's required to run it in production. Your senior software engineers and DevOps teams, do. They earned their judgment the hard way: getting it wrong and fixing it year after year.
GenAI's rented competence makes building software faster, easier, and more accessible. What it doesn't do is help you understand the new problems it creates: token management, model selection and retirement, agent identity, comprehension debt, to name a few. Rented competence doesn't tell you what you don't know.
Build all the movie sets you want. But a camera-ready GenAI demo is not the same as a production-ready system. Ask your senior engineers and DevOps teams to take a peek around the back.