Changelog
- 7b7578f Add NotifySplitsFinished API
- 9ca8769 Add SourceSplitter Start/Close methods
- 4b80112 Add more context to source runner error
- 4abc754 Add test helper to get assignments
- 8b8507a Adjust checkpointing contract to include SourceSplitter
- 7f0a188 Close dkv databases in test
- 8fc2a1c Combine SourceSplitter
StartandLoadCheckpoint - 454d3e1 Fix panic possible when closing ReadSourceChannel
- 7ec91de Have Kinesis client return shard type
- a367402 Improve test error
- a662825 Keep track of lastSeenShardID for Kinesis splitter
- 38874e8 Keep track of the HashKeyRanges of assigned shards
- 095883a Make AssignSplits only adds new splits
- ca0caa5 Make all split discovery async
- 896c0a4 Make stateUpdates a more general purpose queue
- de747eb Mark shards finished when read to end
- f62eb39 Pin reduction-protocol to head
- 955b34e Process parent shards before children
- 2f9524c Remove client wrapper and add test-only wrapper
- 1c09765 Repurpose checkpoint events chan for job errors
- 8cbde70 Split SR startup into deploy & assign splits
- cde1f9c Uniformly assign kinesis shards to runners
- bf7ed45 Use latest reduction-go version
See the documentation at reduction.dev/docs.