v0.0.4

What's Changed

🚀 Features

• Sources:
  • Add HTTP Server source with basic authentication support.
  • Add Redis source for subscribing to channels or lists.
  • Add File source supporting tail and read_one modes.
  • Add SQL source generic implementation.
• Sinks:
  • Add Notify sink supporting Webhook, Telegram, and Email notifications.
  • Add Redis sink for publishing to channels or lists.
  • Add HTTP Client sink with robust authentication and field mapping.
  • Add SQLite sink.
• Transforms:
  • Add Window transform for time-based or count-based aggregation.
• Configuration:
  • Support environment variable expansion in configuration files.
  • Add configurable metrics export interval.

🔄 Refactoring

• Directory Structure: Moved and reorganized examples into the configs/ directory; crypto_redis_pg is now a primary example.
• Notify System: Removed Redis dependency for silencing alerts; implemented a lightweight file-based silence mechanism.
• Engine: Enhanced modularity and improved system sink reliability (loop prevention).
• Testing: Consolidated tests and improved TestHarness for better integration testing.

📚 Documentation

• Added comprehensive bilingual documentation (English & Chinese).
• Updated design documents and project implementation status.

Full Changelog: v0.0.3...v0.0.4

v0.0.3

What's Changed

🚀 Features

• Engine: Implement fail-fast and auto-shutdown mechanisms (ae42563)
• Transform: Implement multi-step transform pipeline with optimized JSONPath (fdb421e)
• Transform: Enhance filter and remap capabilities (5c1b93d)
• Sink: Add jsonl, tsv, csv formats for FileSink and text format for ConsoleSink (9c23e5b)
• Config: Add internal sink target validation (f40269d)
• Config: Add pipeline graph visualization and improve config loading (3eb3d49)
• Examples: Add DLQ handling example and documentation (8da3f18)
• Examples: Finalize internal channels and crypto example (f7a21b3)

🧩 Chores & Tests

• Update lint ignore rules and remove unused example (8d418f6)
• Add validation tests and fix clippy warnings (7fd7c56)

Full Changelog: v0.0.2...v0.0.3

v0.0.2

Highlights

• Add a CLI binary for running Pipeflow from the command line.
• Implement the engine execution loop and end-to-end (E2E) support.
• Add a file sink with JSONL output.

Improvements

• Simplify the core pipeline and clean up the project architecture.
• Restructure configuration for better maintainability.

Examples & Tests

• Add example topologies (HTTP -> console/file, mixed topology).
• Add E2E tests covering HTTP pipelines.

Docs & Tooling

• Update README and design documentation.
• Add project tooling (Makefile) and Markdown lint configuration.

Full Changelog: v0.0.1...v0.0.2

v0.0.1

Full Changelog: https://github.com/telepair/pipeflow/commits/v0.0.1