LLMs & how they actually work
Build a correct mental model before jumping into frameworks. Understand the path from text to tokens, embeddings, transformer computation, logits and generated tokens.
Learn
- Tokens, tokenization and context windows
- Embeddings and positional information
- Attention and transformer blocks
- Pretraining, instruction tuning and alignment
- Inference, temperature, top-p and decoding
- Hallucination, tool use and limitations
Build
- Tokenization explorer in Python
- Simple next-token prediction demo
- Prompt playground with controlled parameters
- Small CLI chat application
Finish with
- One-page LLM architecture notes
- Five common LLM failure modes
- GitHub README with diagrams
- Short explanation you can give in an interview
A one-hour technical overview covering inference, training, fine-tuning, tool use, multimodality and LLM security.