Back to directory

LensVLM

A 9-billion-parameter vision-language model, released with its evaluation code, that scans compressed page images and selectively expands only the relevant ones to their uncompressed form using learned tools, for answering questions over long documents.

LensVLM

LensVLM is a vision-language model that handles long documents by keeping every page compressed by default and expanding only the pages it judges relevant to a question, via a learned tool-calling loop. Given a set of page images and a question, it identifies which pages carry the answer, reads their text through a page-reading tool, and produces a multi-turn trajectory that connects the evidence across pages.

The repository includes scripts to prepare evaluation data from Hugging Face datasets at several compression ratios, run the model on a custom document, and evaluate its answers against an LLM judge served through any OpenAI-compatible endpoint. It is released as Python code with a requirements file for installation.

More in Models

See all 405
  • mini-AGI

    github.com

    A continual learning language model that trains from scratch on a single 8 GB VRAM GPU, assembling its own architecture and adapting its size to the hardware and data available rather than shipping as a fixed pretrained model.

  • An open-source contrastive-embedding pipeline that maps technical CVE vulnerability descriptions to formal cybersecurity compliance controls in NIST SP 800-53 and CMMC, published with its model generation, fine-tuning and evaluation code.

  • peekaboolean

    github.com

    A small vision-language model, fine-tuned with LoRA on a 500-million-parameter backbone, that answers typed multiple-choice, ordinal-score and yes/no questions about an image with calibrated probabilities, in about 400 milliseconds on a laptop.