Back to directory

mlx-dspark

mlx-dspark runs DeepSeek's DSpark and z-lab's DFlash speculative-decoding drafters natively on Apple Silicon via MLX, giving lossless decoding speedups of up to about 4x for supported consumer-size models.

mlx-dspark

mlx-dspark is a native Apple Silicon MLX implementation of two EAGLE-family speculative-decoding drafters: DeepSeek's DSpark, a semi-autoregressive method originally used to accelerate DeepSeek-V4, and z-lab's DFlash, a block-diffusion method. Both are lossless, since the target model verifies every drafted token, so output matches normal decoding exactly; it does not run DeepSeek-V4 itself, but consumer-size target models such as Gemma-4, Qwen3, Muse-Glimmer, Nemotron, LFM2.5, Ornith-1.0 and Bonsai-27B that have published DSpark or DFlash drafters.

It can be run from the CLI, from Python, or as an OpenAI-compatible API server for tools such as LM Studio, and can drive Claude Code with a model running locally on a Mac. It reports measured speedups per model and per workload (chat, code, math) on an M4 Pro, using a benchmark command with a configurable number of trials.

More in Inference

See all 770
  • OpenDecision

    deepanwadhwa.github.io

    An open-source Python package that answers typed questions about application state or documents using a local natural-language-inference model, returning structured choice, score, yes/no or evidence-relation values instead of free text.

  • Lifeboat

    iterate.ai

    A local inference server that puts an OpenAI- and Anthropic-compatible API in front of open-weight language models running on hardware you control, from a laptop to a GPU cluster.

  • Claude S40

    github.com

    An unofficial Claude chat client for 2007-era Nokia Series 40 phones, built as a Java ME app plus a small Go relay server, with web search, reading mode and saved chats.