Module 1
How LLMs work
Explain what an LLM is, what it can do and where it goes wrong.
- Tokens, context window and next-word prediction
- Transformer idea: attention
- Encoder, decoder and encoder-decoder models, such as BERT, GPT and T5
- Hallucinations and other limits
Practice: Experiment with one model and log where it fails
