Software 1.0: Write an algorithm that has the right behavior. @karpathy’s Software 2.0: Optimize differentiable blob to have correct behavior. medium.com/@karpathy/softwar… Software 3.0: Figure out the right prompt to make your meta-learning language model have the right behavior? :P

Software 2.0

I sometimes see people refer to neural networks as just “another tool in your machine learning toolbox”. They have some pros and cons, they…

karpathy.medium.com
8
62
6
322
Love the idea for Software 3.0 😂. Programming moving from curating datasets to curating prompts to make the meta learner "get" the task it's supposed to be doing. LOL 🤣👌
2
9
1
131
Replying to @karpathy @ch402
😂👍

Jun 19, 2020 · 1:24 AM UTC

9
87
20
431
Replying to @karpathy @ch402
I actually did spend about an hour playing around with the OpenAI GPT-3 API over the weekend trying to get the davinci model to recommend me the most interesting movies (e.g. asking it for more rare movies, etc). Little did I know I was 3.0 programming.
1
4
1
84
I guess the ultimate Autopilot is giving a big multimodal GPT-10 the DMV handbook in the prompt concatenated with the last 10 seconds of sensor data and asking it very nicely to follow that 🤔
5
8
2
124
more replies
Replying to @karpathy @ch402
Thanks for the work you and your team is doing. It is magical using the autopilot system. 👍
1
2
Replying to @karpathy @ch402
Andrej I am just wondering how much computing power is used on The FSD computer with everything
1
Replying to @karpathy @ch402
Andrej, can you hire me as a remote dataset labeler for AutoPilot please? 😀
Replying to @karpathy @ch402
When can we expect FSD coast-to-coast run?
Replying to @karpathy @ch402
@SaveToNotion #tweet #meme
1
Replying to @karpathy @ch402
Wasn't ready for the design the prompt 🤣
Replying to @karpathy @ch402
this is actually funny 😂
Replying to @karpathy @ilyasut @ch402
Software 4.0: sit back and relax
4