Back to directory

Machine Learning Systems

A four-volume textbook and curriculum from Harvard's CS249r course on engineering machine learning systems, paired with hands-on labs, a from-scratch framework, hardware kits and a simulator.

Machine Learning Systems

Machine Learning Systems is a Harvard CS249r textbook and curriculum on building efficient, reliable and safe intelligent systems, covering foundations, scaling, agentic AI and physical AI across four volumes, with a print edition planned from MIT Press.

The repository combines the textbook with several companion tools: TinyTorch, a machine learning framework students build themselves from scratch; interactive labs that reason about infrastructure trade-offs using MLSys·im, a modeling engine for infrastructure that is otherwise hard to access; hardware kits for hands-on deployment constraints; and StaffML for checking understanding, alongside an AI-guided reading and quiz layer called Socratiq.

It is written mainly in Python and includes materials for instructors, such as slides and an instructor hub.

More in Tutorials

See all 478
  • BootLife

    github.com

    Conway's Game of Life implemented to run directly from a 512-byte x86 boot sector in assembly, using VGA memory itself as the simulation grid.

  • A technical blog post deriving the Y combinator as a composition of combinator birds in an array language, and examining how eager evaluation changes fixed-point recursion compared with the usual lazy telling.

  • System Design Atlas

    atlas-sysdes.vercel.app

    A free reference of worked system design problems with interactive architecture diagrams, covering ranked designs such as a feed, a chat app, a URL shortener, and a rate limiter, plus pages on the technologies behind them.