Karpathy: Software Is Changing, Again (Software 3.0)

Why it matters

Karpathy — OpenAI founding member and former Tesla AI director — frames 'Software 3.0': 1.0 is code, 2.0 is neural-net weights, and 3.0 is programming LLMs in natural language. With metaphors like 'LLMs are the new OS' and 'partial-autonomy products', he lays out how software should be designed in the AI era.

Key takeaways

• Three paradigms of software: 1.0 write code, 2.0 tune weights, 3.0 write prompts in English.
• LLMs are like early mainframe OS: expensive compute, centrally hosted, time-shared.
• LLM 'psychology': a people-simulator trained on all human text, with superhuman memory but also hallucinations.
• Great products are 'partially autonomous': AI generates, humans verify — minimize verification cost.
• Everyone can program now — the biggest opportunity is non-programmers building software in natural language.