AI/ML Security Course

Large Language Model Fundamentals

Topics in Large Language Model Fundamentals

  1. Introduction to LLMs
  2. Transformer Architecture
  3. Tokens and Tokenization
  4. Embeddings
  5. Attention Mechanism
  6. Pretraining and Fine-Tuning
  7. Instruction Tuning
  8. RLHF Fundamentals
  9. Open-Source vs Closed-Source Models
  10. LLM Inference Architecture
  11. Context Windows and Memory
  12. LLM APIs and Model Serving