Back to directory

Large Language Model Notebooks Course

A free, in-progress hands-on course of Jupyter notebooks that is the unofficial companion repository to a book on applying large language models, covering techniques, projects and enterprise-scale solutions.

Large Language Model Notebooks Course

Large Language Model Notebooks Course is a practical, hands-on course about large language models and their applications, delivered as Jupyter notebooks and posted incrementally as lessons are completed. It is the unofficial repository for a book on applying and implementing strategies for large language models, and its notebooks are updated with new examples and chapters beyond what the book itself contains.

The course has three sections: techniques and libraries, which covers chatbots, code generation, the OpenAI API, Hugging Face, vector databases, LangChain, fine-tuning, PEFT, soft-prompt tuning, LoRA, QLoRA, model evaluation and knowledge distillation through small worked examples; projects, which builds larger examples and discusses their design trade-offs and related LLMOps concerns; and enterprise solutions, which looks at how large language models fit into broader systems for organizations with thousands of employees.

It uses models from OpenAI and the Hugging Face library.

More in Tutorials

See all 478
  • BootLife

    github.com

    Conway's Game of Life implemented to run directly from a 512-byte x86 boot sector in assembly, using VGA memory itself as the simulation grid.

  • A technical blog post deriving the Y combinator as a composition of combinator birds in an array language, and examining how eager evaluation changes fixed-point recursion compared with the usual lazy telling.

  • System Design Atlas

    atlas-sysdes.vercel.app

    A free reference of worked system design problems with interactive architecture diagrams, covering ranked designs such as a feed, a chat app, a URL shortener, and a rate limiter, plus pages on the technologies behind them.