Natural Language Processing: Neural Networks and Large Language Models
A book on neural networks and large language models for natural language processing, covering machine learning foundations through pre-training, generation, prompting, alignment, inference and reasoning.
This is a book on neural networks and large language models in NLP, intended for anyone interested in NLP and deep learning, written by Tong Xiao and Jingbo Zhu. It is organized into three parts: preliminaries covering machine learning and neural network foundations, basic models such as word vectors, recurrent and convolutional sequence models, sequence-to-sequence models and transformers, and a part on large language models covering pre-training, generative models, prompting, alignment, inference and reasoning.
Chapters are available as individual PDFs alongside a complete combined PDF, and some material is drawn from the authors' earlier published articles with added new content. The book has also been translated into Chinese, Japanese, French, German, Italian and Portuguese using LLMs, with translations kept in a companion repository.