Back to directory

Apache SeaTunnel

A distributed, high-performance data-integration tool that synchronizes large volumes of data across more than 160 connectors, including batch, streaming, CDC and multimodal (video, image, binary) data.

Apache SeaTunnel

Apache SeaTunnel is a distributed, high-performance data-integration tool for synchronizing large volumes of data daily. It supports a wide range of synchronization methods, including real-time, change-data-capture and full-database synchronization, and integrates data from hundreds of evolving sources.

Beyond structured and unstructured text, it can integrate multimodal data such as video, images and binary files. It offers more than 160 connectors that can be adapted for both batch and streaming use, a distributed snapshot algorithm for data consistency, JDBC multiplexing and log parsing for efficient multi-table and database synchronization, and detailed real-time monitoring with data-quality checks to prevent loss or duplication.

A job can run on SeaTunnel's own Zeta engine, or on Flink or Spark. It is written in Java and released under the Apache-2.0 license.

More in Data engineering

See all 98
  • ppgrid

    mrzk.io

    An open-source tool that turns tens of millions of point-data rows into a smooth, adaptive-resolution raster in seconds, using a push-pull mipmap approximation of inverse distance weighting that stays fast as the dataset grows.

  • Scope Lineage

    github.com

    An offline static analyzer that turns Spark and Hive SQL into structured, versioned column-lineage and diagnostics files, so AI agents and knowledge bases can reason from addressable, checkable facts instead of guessing from raw SQL.

  • A pair of Colab notebooks demonstrating a retrieval-augmented generation workflow for extracting structured datasets from scientific paper abstracts, applied here to hydrogen-storage properties of metal alloys and hydrides.