Skip to content

Commit 02ac357

Browse files
authored
Update README.md
1 parent 980e3b5 commit 02ac357

1 file changed

Lines changed: 2 additions & 6 deletions

File tree

README.md

Lines changed: 2 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -70,16 +70,12 @@ _(Instructions to be added)_
7070
- This design assumes a "happy path". In a distributed system, any network call can fail and any message can be delivered more than once.
7171
- A flood of traffic to Manager Service can lead to massive scalability issues, especially with large files, in which the service is designed to stream one file at a time.
7272
- How the heck can I even debug this asynchronous architecture?
73-
- Google managed services are not 100% SLA.
73+
- Google managed services are not 100% SLA. (obviously)
7474
- Services can access GCS and Pub/Sub with no known rate limits, quotas.
7575

7676
## Todo
77-
- Write unit tests and integration tests for manager and worker services.
78-
- Containerize services with Docker.
79-
- Use Kubernetes (GKE) to manage, scale, and orchestrate the services.
80-
- Build Continuous Integration (CI) pipeline with Github Actions.
81-
- Build Continuous Deployment (CD) pipeline with ArgoCD.
8277
- Integrate Google Cloud Operations Suite for monitoring, logging, and tracing.
78+
- Build Continuous Deployment (CD) pipeline with ArgoCD.
8379
- Implement retries logic at streaming data, sending/receiving messages to/from Message Queue, etc.
8480
- Create a budget plan to estimate the cost of running this system on Google Cloud Platform (GCP).
8581
- Split file (>= 50GB) in chunks for parallel compression. **Requires architecture redesign**

0 commit comments

Comments
 (0)