Large Language Model Fundamentals
Topics in Large Language Model Fundamentals
- Introduction to LLMs
- Transformer Architecture
- Tokens and Tokenization
- Embeddings
- Attention Mechanism
- Pretraining and Fine-Tuning
- Instruction Tuning
- RLHF Fundamentals
- Open-Source vs Closed-Source Models
- LLM Inference Architecture
- Context Windows and Memory
- LLM APIs and Model Serving