MLX-VLM

A package for running inference and fine-tuning Vision Language Models, including omni models with audio and video support, on Apple Silicon Macs using MLX.

Visit website github.com

MLX-VLM supports many vision-language and OCR-focused models, including DeepSeek-OCR, DOTS-OCR, ERNIE 4.5 VL, GLM-OCR, Phi-4, MiniCPM, PaddleOCR-VL, Gemma 4 and LLaVA-OneVision, with a command-line interface for inference, thinking-budget control, speculative decoding, a Gradio chat UI, a FastAPI server, continuous batching, automatic prefix caching, KV cache quantization and multi-image chat.

It ships an agent-skills bundle under skills/ for common MLX-VLM workflows, covering usage, conversion, development and support, which loads into coding agents such as Claude Code, Codex or Gemini so the agent follows the project's conventions instead of guessing.

It installs with pip install mlx-vlm, with an optional [ui] extra for the Gradio interface; it is written in Python and licensed under MIT.

More in Models

See all 405

mini-AGI
github.com
A continual learning language model that trains from scratch on a single 8 GB VRAM GPU, assembling its own architecture and adapting its size to the hardware and data available rather than shipping as a fixed pretrained model.
- Models
Applied Inference Lab: Compliance Control Embedding Stack
github.com
An open-source contrastive-embedding pipeline that maps technical CVE vulnerability descriptions to formal cybersecurity compliance controls in NIST SP 800-53 and CMMC, published with its model generation, fine-tuning and evaluation code.
- Models
- Security
peekaboolean
github.com
A small vision-language model, fine-tuned with LoRA on a 500-million-parameter backbone, that answers typed multiple-choice, ordinal-score and yes/no questions about an image with calibrated probabilities, in about 400 milliseconds on a laptop.
- Models
- Inference

More in Models

mini-AGI

Applied Inference Lab: Compliance Control Embedding Stack

peekaboolean

Cookies