Seonglae ChoMeta-algorithms that complete themselves through data compression
Humans imagined AI as a unified, mechanically synchronised massive intelligence, but artificial intelligence, which is much easier to replicate and modify than human brain, is created with far more diverse tastes and sizes tailored to specific situations. This diversity and AI society mediate human society and are ambiguously superpositioned, enabling collaboration on a larger scale.
AI Notion
AI Usages
How AI is Understanding the World
Technological singularity, AGI, Superintelligence
The AI Revolution: The Road to Superintelligence
Part 1 of 2: "The Road to Superintelligence". Artificial Intelligence — the topic everyone in the world should be talking about.
https://waitbutwhy.com/2015/01/artificial-intelligence-revolution-1.html
The AI Revolution: Our Immortality or Extinction
Part 2: "Our Immortality or Our Extinction". When Artificial Intelligence gets superintelligent, it's either going to be a dream or a nightmare for us.
https://waitbutwhy.com/2015/01/artificial-intelligence-revolution-2.html
Transcript of "What happens when our computers get smarter than we are?"
TED Talk Subtitles and Transcript: Artificial intelligence is getting smarter by leaps and bounds -- within this century, research suggests, a computer AI could be as "smart" as a human being. And then, says Nick Bostrom, it will overtake us: "Machine intelligence is the last invention that humanity will ever need to make."
https://www.ted.com/talks/nick_bostrom_what_happens_when_our_computers_get_smarter_than_we_are/transcript?language=ko
왜 최근에 빌 게이츠, 일론 머스크, 스티븐 호킹 등 많은 유명인들이 인공지능을 경계하라고 호소하는가?
Part I: The AI Revolution: The Road to Superintelligence Part II: The AI Revolution: Our Immortality or Extinction 우리는 지금 격변의 변두리에 서있다. 이런 격변은 인류의 출현과 맞먹을 만큼 의미가 중대하다. - Vernor Vinge 당신이 그래프상에서 이 지점에 서있는다면 어떤 느낌이겠는가? 이상의 모든 것은 머지않아 이뤄지게 된다. 이상 이 글의 1편은 끝입니다.
https://coolspeed.wordpress.com/2016/01/03/the_ai_revolution_1_korean/?fbclid=IwAR02_gvDnUn5M31RLdauziR2tRX-eXYa-KN_e4mB4O6LWhVyes_2fZbNuW4
Threshold driven development
Gradually, then Suddenly: Upon the Threshold
Small improvements can lead to big changes
https://www.oneusefulthing.org/p/gradually-then-suddenly-upon-the
Software 1.0, Software 2.0, Software 3.0
Software 1.0 is built with code, while Software 2.0 is built with weights. Traditional Software 1.0 can automate everything that can be specified. AI can automate everything that can be verified. Software 3.0 uses prompts to enable LLMs as programmable neural networks. We can add one analogy on this: LLM is a new operating system that can be accessible through CLI, prompt.
Partial autonomy app such as Cursor.so integrate llm next to traditional interface. Application specific GUI with AIs under the hood with autonomy slider. You can tune the amount of autonomy to give up. Perplexity AI can be also explained in same way. AIs are doing the generation and human is doing verification. However, reading is boring and time-consuming while GUI is a highway to your brain for auditing system and visual representation. Conclusively, we need to on the lease AI agents to make it more successful.
Andrej Karpathy: Software Is Changing (Again)
Andrej Karpathy's keynote on June 17, 2025 at AI Startup School in San Francisco. Slides provided by Andrej: https://drive.google.com/file/d/1a0h1mkwfmV2PlekxDN8isMrDA5evc4wW/view?usp=sharing
Chapters:
00:00 - Intro
01:25 - Software evolution: From 1.0 to 3.0
04:40 - Programming in English: Rise of Software 3.0
06:10 - LLMs as utilities, fabs, and operating systems
11:04 - The new LLM OS and historical computing analogies
14:39 - Psychology of LLMs: People spirits and cognitive quirks
18:22 - Designing LLM apps with partial autonomy
23:40 - The importance of human-AI collaboration loops
26:00 - Lessons from Tesla Autopilot & autonomy sliders
27:52 - The Iron Man analogy: Augmentation vs. agents
29:06 - Vibe Coding: Everyone is now a programmer
33:39 - Building for agents: Future-ready digital infrastructure
38:14 - Summary: We’re in the 1960s of LLMs — time to build
Drawing on his work at Stanford, OpenAI, and Tesla, Andrej sees a shift underway. Software is changing, again. We’ve entered the era of “Software 3.0,” where natural language becomes the new programming interface and models do the rest.
He explores what this shift means for developers, users, and the design of software itself— that we're not just using new tools, but building a new kind of computer.
More content from Andrej: https://www.youtube.com/@AndrejKarpathy
Thoughts (From Andrej Karpathy!)
0:49 - Imo fair to say that software is changing quite fundamentally again. LLMs are a new kind of computer, and you program them *in English*. Hence I think they are well deserving of a major version upgrade in terms of software.
6:06 - LLMs have properties of utilities, of fabs, and of operating systems → New LLM OS, fabbed by labs, and distributed like utilities (for now). Many historical analogies apply - imo we are computing circa ~1960s.
14:39 - LLM psychology: LLMs = "people spirits", stochastic simulations of people, where the simulator is an autoregressive Transformer. Since they are trained on human data, they have a kind of emergent psychology, and are simultaneously superhuman in some ways, but also fallible in many others. Given this, how do we productively work with them hand in hand?
Switching gears to opportunities...
18:16 - LLMs are "people spirits" → can build partially autonomous products.
29:05 - LLMs are programmed in English → make software highly accessible! (yes, vibe coding)
33:36 - LLMs are new primary consumer/manipulator of digital information (adding to GUIs/humans and APIs/programs) → Build for agents!
Some of the links:
- Software 2.0 blog post from 2017 https://karpathy.medium.com/software-2-0-a64152b37c35
- How LLMs flip the script on technology diffusion https://karpathy.bearblog.dev/power-to-the-people/
- Vibe coding MenuGen (retrospective) https://karpathy.bearblog.dev/vibe-coding-menugen/
Apply to Y Combinator: https://ycombinator.com/apply
Work at a startup: https://workatastartup.com
https://www.youtube.com/watch?v=LCEmiRjPEtQ
