What is ChatGPT doing... and Why does it work

Stephen Wolfram https://writings.stephenwolfram.com/2023/02/what-is-chatgpt-doing-and-why-does-it-work/

Adding one word at a time --> ChatGPT is always fundamentally trying to do is to produce a “reasonable continuation” of whatever text it’s got so far = “what one might expect someone to write after seeing what people have written on billions of webpages, etc.” --> At each step, GPT is getting a list of words with probabilities. Question: which should it use ?