Skip to content

GCP implementation #41

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
EricPyZhou wants to merge 25 commits into
base: master
Choose a base branch
from
Open

GCP implementation #41

EricPyZhou wants to merge 25 commits into from

Conversation

@EricPyZhou
Copy link

@EricPyZhou EricPyZhou commented Oct 5, 2023

For all work with comments, please refer to all code up until 74ee26b2fae5e2d68993beca846eb22871730bf6 (inclusive)

The feature request was originally proposed as a GSOC project. In this PR, the following components are added:

  1. datastore (Firestore in Datastore mode) as system storage
  2. cloud storage as user storage
  3. cloud functions for four functions (writer, distributor, watch, heartbeat(not yet))

Ubuntu added 25 commits August 6, 2023 21:14
create node workflow
5816fa2
workflow draft done w/o watch and client
b3ec051
fix distributor queue
bc5afc2
set data and delete node draft version
baeec8d
gcp watch draft
facf31a
add watch impl abstract methods
dc4af43
distributor create node watch impl
62eda2e
gcp watch
1b5a4de
watch notification and epoch counter update
55e3585
delete archived test cases
74ee26b
remove unwanted print and comments
29f388a
add distributor queue name as a env var
064f00d
serverless config for gcp deployment
132a7e1
add init process to gcp
eff0463
add plugin serverless-google-cloudfunctions install to install.py
e49b2db
fadd project and database argument to class, the GCP deployment now p…
e756cc2 
…ass the node.py test
add datastore database name as a property of config
b385767
improve the naming of the user storage bucket
021b616
add bucket-name into config, let user make sure its name is globally …
e6b5f08 
…unique
add deregister user logic in system storage
1ee20a9
use session_id+req_id as the timestamp in writer-event
5f4e290
add error handling of broken pipe error and timestamp format
cfb9ab7
cold start time optimization
5ddcdf4
upload source code zip files concurrently
d25fd2e
optimize cold start time
18c5bfd
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@EricPyZhou