Chapter 12: Inference - Generating New Text

What You'll Build A sampling loop that generates new names from the trained model. Chapter 11 (the trained model). After training, the parameters are frozen. We start with the BOS token, feed it through the model, get a probability distribution over next tokens, sample one, feed it back in, and re