Data engineering

A Python static-site generator for interactive data apps that bundles compute, data access, and UI into a single offline-capable HTML file using Pyodide, DuckDB, Pandas, and Plotly.

• Web frameworks
• Data engineering

An agentic large language model for autonomous data science that plans, analyzes, models, visualizes and writes analyst-grade reports over structured, semi-structured and unstructured data sources without human intervention.

• Data engineering

A tool for interactively visualizing large embeddings and their metadata, letting a user cross-filter, search and explore data structure at scale.

• RAG
• Data engineering

An archived, open-source, cloud-native machine learning and large-model AI platform covering the full MLOps pipeline, from notebook development to distributed training and inference serving.

• Models
• Data engineering

A collaboration tool that lets AI engineers and domain experts build and label high-quality datasets for text classification, LLM and multimodal projects.

• Models
• Data engineering

A high-performance data engine for AI and multimodal workloads that processes images, audio, video and structured data at scale, with built-in operations for running LLM prompts and generating embeddings.

• Data engineering

A conversational data analysis system that turns natural-language questions into SQL using a large language model and retrieval-augmented generation.

• Databases
• Data engineering

An LLM-driven platform that extracts structured JSON from unstructured documents such as PDFs, scans and images, deployable as an API or an ETL pipeline.

• RAG
• Data engineering

A Kubernetes-native orchestration platform for reliably running ML pipelines, models and AI agents at scale, defined entirely in Python.

• Data engineering
• Containers

A visual, low-code system for generating, cleaning and preparing high-quality training data for large language models from noisy sources such as PDFs and low-quality QA pairs.

• Data engineering

An event-streaming platform that ingests database changes, event streams and webhooks, computes incrementally, and serves fresh, queryable results at low latency, replacing a CDC-plus-Kafka-plus-stream-processor stack with one system.

• Databases
• Data engineering

A polyglot document-intelligence engine that extracts text, tables, metadata and structured data from more than 100 file formats and code from hundreds of programming languages, with OCR, transcription and 15 language bindings.

• RAG
• Data engineering

An open-source, Rust-built data warehouse unifying large-scale analytics, vector search and full-text search with sandboxed Python UDFs for running agent logic through SQL.

• Databases
• Data engineering

A distributed, high-performance data-integration tool that synchronizes large volumes of data across more than 160 connectors, including batch, streaming, CDC and multimodal (video, image, binary) data.

• Data engineering

A Python framework for production-ready data engineering and data science pipelines, applying software engineering practices to make them reproducible, maintainable and modular.

• Data engineering

Developer-first, graph-native infrastructure that turns fragmented enterprise data into a queryable context graph and knowledge graph, with deterministic reasoning and end-to-end decision provenance.

• Agent memory
• Data engineering

An application for building datasets to fine-tune, retrieval-augment and evaluate large language models, with document parsing, text splitting, question generation and data cleaning built in.

• Models
• Data engineering

An open platform that builds a unified metadata knowledge graph across an organization's data, connecting lineage, ownership, quality, glossaries and data contracts so both people and AI agents can discover, trust and use data correctly.

• Data engineering

An open-source AI Development Environment that turns a code editor into a place to build, debug and deploy LLM and machine learning pipelines, running on a multithreaded C++ engine with any model, tool or framework.

• Models
• Data engineering

An open-source, MPP real-time analytics and search database that runs fast SQL queries, accelerates queries over lakehouse table formats, and combines structured, text and vector search in one SQL engine.

• Databases
• Data engineering

An open-source generative BI engine that gives AI coding agents a governed semantic layer, so natural-language questions become correct SQL and shareable dashboards across more than 20 data sources.

• Databases
• Data engineering

An open-source agentic AI assistant that connects to databases, spreadsheets and knowledge bases, writes SQL and code from natural language questions, and turns the results into charts, dashboards and reports.

• Databases
• Data engineering

A lightweight Python library for loading ready-to-use public datasets in one line and for efficiently pre-processing them alongside your own local data.

• Data engineering

Ray is a unified Python framework for scaling AI and general compute workloads from a laptop to a cluster, pairing a distributed runtime core with a set of AI libraries.

• Models
• Data engineering