Plumb

Plumb is an interactive Go library for building and managing real-time ETL pipelines: Processes, Channels, and a REST API for monitoring.

Plumb delivers scalable ETL pipelines built on a network of Go Processes and Channels. It functions as an interactive pipeline manager, allowing operators to grow or shrink processing queues and replicate stages on demand. The core strength is its real-time observability: Plumb exposes a dedicated REST API, enabling immediate interaction with and monitoring of all pipeline objects for dynamic control and performance tuning.

https://github.com/nsmith5/plumb