Andrej Karpathy on AI architecture
From Andrej Karpathy on Future Of AI, LLM OS, and Building Ecosystems · · Perfology Clips
“I think roughly speaking the way things are happening is everyone is trying to build what I refer to as kind of like this LM OS and basically I like to think of it as an operating system you have to get a bunch of like basically peripherals that you plug into this new CPU or something like that the peripherals are of course like text, images, audio, and all the modalities. And then you have a CPU, which is the LLM transformer itself. And then it's also connected to all the software 1.0 infrastructure that we've already built up for ourselves.”
On , Andrej Karpathy, Independent AI Researcher and Former Director of AI at Tesla/Independent, spoke about AI architecture during Andrej Karpathy on Future Of AI, LLM OS, and Building Ecosystems on Perfology Clips.
About Andrej Karpathy
Andrej Karpathy has continued to speak publicly about the evolution of software development in the age of large language models. In a June 2025 keynote at the AI Startup School, he described a shift he calls "Software 3.0," where natural language prompts function as programs that direct LLMs, and he argued that LLMs have "flipped the direction of technology diffusion" by making advanced tools available to consumers before corporations or governments. He cautioned that "2025 is the year of agents" was an overstatement, saying "this is the decade of agents" and stressing that "we need humans in the loop." In 2026 appearances, Karpathy revisited the term "vibe coding," which he coined in 2025, and contrasted it with what he now calls "agentic engineering." He said vibe coding is about "raising the floor for everyone" to create software, while agentic engineering is about "preserving the quality bar" of professional software and avoiding vulnerabilities. He stated that he has "never felt more behind as a programmer" despite using agentic tools, and described LLMs as "statistical simulation circuits" rather than animal intelligence, adding that "if you'll yell at them, they're not going to work better." He also suggested that hiring for AI-era roles should involve evaluating candidates on large, real-world projects rather than traditional interviews.