When you type into a chat interface like ChatGPT or Claude.ai, a large language model is generating some text to respond to you.

So in this lesson we start to explore generating text, and have some fun with a simple AI that tries to generate Shakespeare and part of a Sherlock Holmes story. We see how even simple tables of counts (probabilities) can start to generate plausible-sounding text.

We can also use this approach to start to demystify hallucination, which is a big topic with Large Language Models right now.