Back to directory

Simple Transformers

A Python library, built on Hugging Face Transformers, that trains and evaluates a range of NLP models in as little as three lines of code, covering classification, question answering, retrieval and generation tasks.

Simple Transformers

Simple Transformers wraps the Hugging Face Transformers library so a model can be initialized, trained and evaluated in three lines of code. Supported tasks include dense information retrieval, large-language-model training and fine-tuning, encoder model training, sequence and token classification such as named-entity recognition, question answering, language generation, T5 and other sequence-to-sequence tasks, multimodal classification, and conversational AI.

Every task-specific model follows the same pattern: initialize it, train it with a training call, evaluate it, and generate predictions on new data, with task-specific configuration options documented separately for each model type. It integrates with Weights & Biases for optional experiment tracking and visualization during training.

More in Models

See all 405
  • mini-AGI

    github.com

    A continual learning language model that trains from scratch on a single 8 GB VRAM GPU, assembling its own architecture and adapting its size to the hardware and data available rather than shipping as a fixed pretrained model.

  • An open-source contrastive-embedding pipeline that maps technical CVE vulnerability descriptions to formal cybersecurity compliance controls in NIST SP 800-53 and CMMC, published with its model generation, fine-tuning and evaluation code.

  • peekaboolean

    github.com

    A small vision-language model, fine-tuned with LoRA on a 500-million-parameter backbone, that answers typed multiple-choice, ordinal-score and yes/no questions about an image with calibrated probabilities, in about 400 milliseconds on a laptop.