Flink Connector Lance

An Apache Flink connector for the Lance columnar data format that provides source and sink support, Flink SQL and Table API integration, KNN vector search, and index building for Lance vector datasets.

Visit website github.com

flink-connector-lance is a high-performance Apache Flink connector for Lance, a columnar data format built for machine learning workloads and vector search, integrating Flink's stream and batch processing with Lance's vector storage.

It provides full read and write support for Lance datasets through both the DataStream API and native Flink SQL DDL and DML, KNN vector search with L2, cosine and dot-product metrics, IVF_PQ, IVF_HNSW and IVF_FLAT index building, checkpoint-based exactly-once semantics, predicate pushdown for optimized reads, and a Lance catalog for metadata management.

Built with Java, distributed as a Maven dependency; requires Java 8 or higher and Apache Flink 1.16.x. Apache-2.0 licensed.

More in Databases

See all 294

SQLBraid
clickin.github.io
A SQL-first data-access toolkit for TypeScript that keeps ordinary SQL visible in tagged template literals, binds interpolated values safely by default, supports readable conditional SQL directives, and lets a schema validate the returned rows.
- Libraries
- Databases
QQL - SQL for Qdrant and vector search
qql.veristamp.in
A SQL-style query language and toolchain for the Qdrant vector database, covering dense, sparse and hybrid search, filtering and multitenancy, with the same grammar running from a CLI, Python, Node.js, Rust, WebAssembly and an in-process edge engine.
- Databases
Fast Knowledge
github.com
A self-hosted, Java-based knowledge base for small and mid-sized organizations, turning internal documents into a searchable, question-answerable and audit-exportable knowledge asset with hybrid retrieval and Docker deployment.
- RAG
- Databases

More in Databases

SQLBraid

QQL - SQL for Qdrant and vector search

Fast Knowledge

Cookies