The hottest new programming language is English A tweet thread by Andrei Karpathy • This tweet went wide, thought I'd post some of the recent supporting articles that inspired it.– One GPT-3 paper showed that LLMs perform in-context learning, and can be "programmed" inside the prompt with input:output examples to perform diverse tasks.
 • These two [1] , [2] are good examples that the prompt can further program the "solution strategy", and with a good enough design of it, a lot more complex multi-step reasoning tasks become possible.
• These two articles/papers [1], [2] bit more technical but TLDR good prompts include the desired/aspiring performance. GPTs don't "want" to succeed. They want to imitate. You want to succeed, and you have to ask for it.
• Building A Virtual Machine inside ChatGPT (link). Here we start getting into specifics of "programming" in English. Take a look at the rules and input/output specifications declared in English, conditioning the GPT into a particular kind of role. Read in full.
• "ChatGPT in an iOS Shortcut — Worlds Smartest HomeKit Voice Assistant" (link). This voice assistant is significantly more capable and personalized than your regular Siri/Alexa/etc., and it was programmed in English.
• "GPT is all you need for the backend" (link). – Tired: use an LLM to help you write a backend– Wired: LLM is the backend– Inspiring project from a recent Scale hackathon. The LLM backend takes state as JSON blob and modifies it based on... English description.
• The prompt allegedly used by Bing chat, potentially spilled by a prompt injection attack (link) important point for our purposes is that the identity is constructed and programmed in English, by laying out who it is, what it knows/doesn't know, and how to act.
• These examples illustrate how prompts 1: matter and 2: are not trivial, and why today it makes sense to be a "prompt engineer" (e.g. @goodside). I also like to think of this role as a kind of LLM psychologist. • Pulling in one more relevant tweet of mine from a while ago. GPTs run natural language programs by completing the document → link to that tweet