Vector
A high-performance observability data pipeline that collects, transforms and routes logs, metrics and traces to any combination of vendors.
Vector is a high-performance, end-to-end observability data pipeline that collects, transforms and routes logs and metrics, with tracing support described as forthcoming, to any combination of vendors a team chooses today or wants to switch to later. It is built in Rust with reliability as its primary design goal, and can be deployed as an agent running close to a data source or as an aggregator collecting from multiple agents, making it a complete pipeline on its own.
The project reports it is downloaded over 100,000 times a day, that its largest user processes more than 500 terabytes daily, and that it is maintained by Datadog's community open source engineering team with contributions from a wide community. It is used to reduce observability costs, move between vendors without disrupting existing pipelines, enrich data before it reaches a destination, and consolidate multiple agents into one, and its documentation site covers sources, transforms, sinks, installation and a quickstart guide.