Back to directory

SpatialLM

A 3D large language model that turns point-cloud data from monocular video, RGBD images or LiDAR into structured indoor scene descriptions, including walls, doors, windows and labeled object bounding boxes.

Visit website (opens in a new tab)manycore-research.github.io
SpatialLM

SpatialLM is a 3D large language model that processes point-cloud data and produces structured 3D scene understanding, identifying architectural elements such as walls, doors and windows along with oriented bounding boxes for objects and their semantic categories. Unlike methods that need specialized capture equipment, it accepts point clouds from monocular video, RGBD images or LiDAR.

The multimodal architecture is intended to bridge unstructured 3D geometric data and structured 3D representations for uses such as embodied robotics, autonomous navigation and other 3D scene-analysis tasks. Released models include SpatialLM-Llama-1B and SpatialLM-Qwen-0.5B variants, and inference is tested with Python, PyTorch and CUDA.

More in Models

See all 405
  • mini-AGI

    github.com

    A continual learning language model that trains from scratch on a single 8 GB VRAM GPU, assembling its own architecture and adapting its size to the hardware and data available rather than shipping as a fixed pretrained model.

  • An open-source contrastive-embedding pipeline that maps technical CVE vulnerability descriptions to formal cybersecurity compliance controls in NIST SP 800-53 and CMMC, published with its model generation, fine-tuning and evaluation code.

  • peekaboolean

    github.com

    A small vision-language model, fine-tuned with LoRA on a 500-million-parameter backbone, that answers typed multiple-choice, ordinal-score and yes/no questions about an image with calibrated probabilities, in about 400 milliseconds on a laptop.