Implement Cap'n Proto RPC for Connector Communication

[valdo404]

Cap'n Proto RPC Implementation for Connector Communication

Description

Implement Cap'n Proto as the RPC mechanism for communication between Franzoxide components, replacing the current gRPC implementation. Cap'n Proto offers better performance, zero-copy capabilities, and a more Rust-friendly implementation.

Tasks

• Define Cap'n Proto schema for all connector interfaces
• Implement server-side RPC handlers for the control plane
• Implement client-side RPC for connectors
• Add support for both UNIX socket and TCP transport
• Implement bidirectional streaming for efficient data transfer
• Add authentication and encryption for secure communication
• Implement proper error handling and retry mechanisms
• Create comprehensive tests for RPC communication
• Benchmark performance against the current gRPC implementation

Technical Details

• Use capnp-rpc crate for Rust implementation
• Implement zero-copy data transfer where possible
• Ensure backward compatibility during transition
• Add comprehensive tests for different communication scenarios
• Implement proper error handling and timeout mechanisms

Acceptance Criteria

• All connector communication works correctly over Cap'n Proto
• Performance exceeds the current gRPC implementation
• Memory usage is reduced compared to gRPC
• All tests pass including failure scenarios
• Documentation is complete and accurate

Priority

High

Complexity

Medium

Release Target

v0.3.0