Back to directory

SpawnDev.ILGPU.ML

A C# library that implements neural network inference and training as GPU compute kernels for .NET, running the same code on WebGPU, CUDA, OpenCL, WebGL, WebAssembly, and CPU, including inside a browser via Blazor WebAssembly.

SpawnDev.ILGPU.ML

SpawnDev.ILGPU.ML implements neural network inference and training natively in C#, compiled via SpawnDev.ILGPU to run as compute shaders on WebGPU, CUDA, OpenCL, WebGL, WebAssembly, or CPU, without depending on ONNX Runtime, JavaScript, or native binaries. The same code runs in a browser through Blazor WebAssembly and on desktop.

It loads models in ONNX, TFLite, GGUF, and other formats across any of the supported backends, and includes demos for classification, style transfer, depth estimation, object detection, pose estimation, background removal, text generation, and an on-device LLM chat interface. Training can also run directly on the browser's GPU without a server or Python.

The project publishes a status document distinguishing verified, end-to-end-tested demos from work-in-progress ones, and is under active development with an API still stabilizing.

More in Inference

See all 770
  • OpenDecision

    deepanwadhwa.github.io

    An open-source Python package that answers typed questions about application state or documents using a local natural-language-inference model, returning structured choice, score, yes/no or evidence-relation values instead of free text.

  • Lifeboat

    iterate.ai

    A local inference server that puts an OpenAI- and Anthropic-compatible API in front of open-weight language models running on hardware you control, from a laptop to a GPU cluster.

  • Claude S40

    github.com

    An unofficial Claude chat client for 2007-era Nokia Series 40 phones, built as a Java ME app plus a small Go relay server, with web search, reading mode and saved chats.