Skip to content

Flwr integration taskrunner #2

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
kminhta wants to merge 113 commits into
base: develop
Choose a base branch
from
Open

Flwr integration taskrunner #2

kminhta wants to merge 113 commits into from

Conversation

@kminhta
Copy link
Owner

@kminhta kminhta commented Dec 7, 2024

No description provided.

kminhta and others added 30 commits October 21, 2024 06:36
@kminhta
initial flwr integration commit
f528cee 
Signed-off-by: kta-intel <kevin.ta@intel.com>
@kminhta
further enabling work
f0c41b8 
Signed-off-by: kta-intel <kevin.ta@intel.com>
@kminhta
additional updates
aa08b5e 
Signed-off-by: kta-intel <kevin.ta@intel.com>
@kminhta
updates
e0b1103 
Signed-off-by: kta-intel <kevin.ta@intel.com>
@kminhta
enable supernode process configuration to pull number of partitions a…
6a815b7 
…nd partition id from data.yaml

Signed-off-by: kta-intel <kevin.ta@intel.com>
@kminhta
Merge branch 'develop' into flwr-integration-taskrunner
be6927a
@kminhta
Merge branch 'develop' into flwr-integration-taskrunner
6bc91e2
@kminhta
update for flwr-nightly
a40dc48 
Signed-off-by: kta-intel <kevin.ta@intel.com>
@kminhta
update to flwr 1.14
3a0e01e 
Signed-off-by: kta-intel <kevin.ta@intel.com>
@kminhta
enable runner to automatically set different client ports
49ef2eb 
Signed-off-by: kta-intel <kevin.ta@intel.com>
@kminhta
add queue-based processing to avoid communication cancellation throug…
f529fe2 
…h atomic connection wrapper

Signed-off-by: kta-intel <kevin.ta@intel.com>
@kminhta
add todo
ffe7b47 
Signed-off-by: kta-intel <kevin.ta@intel.com>
@kminhta
add FLEX component
a7ebd91 
Signed-off-by: kta-intel <kevin.ta@intel.com>
@kminhta
move local grpc server to FLEX
ebf9552 
Signed-off-by: kta-intel <kevin.ta@intel.com>
@kminhta
change fim to flex
8020a2f 
Signed-off-by: kta-intel <kevin.ta@intel.com>
@kminhta
add method to flex base class for acquiring local grpc client
700b21b 
Signed-off-by: kta-intel <kevin.ta@intel.com>
@kminhta
move message conversion out of openfl client methods
5995fcf 
Signed-off-by: kta-intel <kevin.ta@intel.com>
@kminhta
add flwr run to FLEX, add FLEXAssigner
37893a7 
Signed-off-by: kta-intel <kevin.ta@intel.com>
@kminhta
remove some TODOs and commented out code
48475fd 
Signed-off-by: kta-intel <kevin.ta@intel.com>
@kminhta
click path for data.yaml set to true
2c72feb 
Signed-off-by: kta-intel <kevin.ta@intel.com>
@kminhta
add requirements
83e6c80 
Signed-off-by: kta-intel <kevin.ta@intel.com>
@kminhta
make importing flwr components conditioned on existing lib
07f2db7 
Signed-off-by: kta-intel <kevin.ta@intel.com>
@kminhta
enable send local task results in order to gracefully terminate
da975e5 
Signed-off-by: kta-intel <kevin.ta@intel.com>
@kminhta
fix superlink shutdown
d2d6907 
Signed-off-by: kta-intel <kevin.ta@intel.com>
@kminhta
gracefully terminate agg processes
18aed1f 
Signed-off-by: kta-intel <kevin.ta@intel.com>
@kminhta
graceful shutdown at collaborators
e290e31 
Signed-off-by: kta-intel <kevin.ta@intel.com>
@kminhta
add automatic shutdown to taskrunner
bb000f4 
Signed-off-by: kta-intel <kevin.ta@intel.com>
@kminhta
remove flower readme, add --insecure as default
81dfdda 
Signed-off-by: kta-intel <kevin.ta@intel.com>
@kminhta
add readme
961982e 
Signed-off-by: kta-intel <kevin.ta@intel.com>
@kminhta
modify plan and update readme
ba02e9c 
Signed-off-by: kta-intel <kevin.ta@intel.com>
kminhta and others added 30 commits February 13, 2025 11:29
@kminhta
remove auto shutdown
d9c9913 
Signed-off-by: kta-intel <kevin.ta@intel.com>
@kminhta
adding additional failsafes
160ab8a 
Signed-off-by: kta-intel <kevin.ta@intel.com>
@kminhta
logic to save out model
04d173c 
Signed-off-by: kta-intel <kevin.ta@intel.com>
@kminhta
stable commit. TODO: fix docstrings. NotImplemented: callbacks
6a558c7 
Signed-off-by: kta-intel <kevin.ta@intel.com>
@kminhta
stable commit 2.0: switched order of stop to kill serverapp first
306f7ff 
Signed-off-by: kta-intel <kevin.ta@intel.com>
@kminhta
stable commit 3.0: new self attribute for serverapp
32e96d0 
Signed-off-by: kta-intel <kevin.ta@intel.com>
@kminhta
stable commit 4.0: adding flower taskrunner and dataloader to init
7c413f1 
Signed-off-by: kta-intel <kevin.ta@intel.com>
@kminhta
keep openfl_client at the collaborator
676c273 
Signed-off-by: kta-intel <kevin.ta@intel.com>
@kminhta
move serverapp callback out
7dc9de0 
Signed-off-by: kta-intel <kevin.ta@intel.com>
@kminhta
attempts to decouple lgs from task runner - still WIP
70b02a8 
Signed-off-by: kta-intel <kevin.ta@intel.com>
@kminhta
add connector utils
9265d21 
Signed-off-by: kta-intel <kevin.ta@intel.com>
@kminhta
more seamless separate of base class and extensibility of sub class
54cb629 
Signed-off-by: kta-intel <kevin.ta@intel.com>
@kminhta
run local grpc server on separate ports
806c0f8 
Signed-off-by: kta-intel <kevin.ta@intel.com>
@kminhta
add flower app installation and fab installation to task runner
1a4bb4b 
Signed-off-by: kta-intel <kevin.ta@intel.com>
@kminhta
update dataloader to accept datapath
27866fc 
Signed-off-by: kta-intel <kevin.ta@intel.com>
@kminhta
move installation back to requirements.txt
95bc634 
Signed-off-by: kta-intel <kevin.ta@intel.com>
@kminhta
add initialize_tensorkey_for_functions method with pass
1a34378 
Signed-off-by: kta-intel <kevin.ta@intel.com>
@kminhta
debug
b32054b 
Signed-off-by: kta-intel <kevin.ta@intel.com>
@kminhta
update data loader
092c55d 
Signed-off-by: kta-intel <kevin.ta@intel.com>
@kminhta
fix defaults
0525520 
Signed-off-by: kta-intel <kevin.ta@intel.com>
@kminhta
clean up save function
40b58e4 
Signed-off-by: kta-intel <kevin.ta@intel.com>
@kminhta
udpate README.md
7f25dd0 
Signed-off-by: kta-intel <kevin.ta@intel.com>
@kminhta
pass local_server_port key from yaml to taksrunner
1253150 
Signed-off-by: kta-intel <kevin.ta@intel.com>
@kminhta
remove atomic connection by default
5188b3c 
Signed-off-by: kta-intel <kevin.ta@intel.com>
@kminhta
Merge branch 'develop' into flwr-integration-taskrunner
f98189f
@kminhta
updates
d99d62f 
Signed-off-by: kta-intel <kevin.ta@intel.com>
@kminhta
more changes
1f3de0a 
Signed-off-by: kta-intel <kevin.ta@intel.com>
@kminhta
Merge branch 'develop' into flwr-integration-taskrunner
422af90
@kminhta
fix headers
4cba60a 
Signed-off-by: kta-intel <kevin.ta@intel.com>
@kminhta
add .workspace
fb26660 
Signed-off-by: kta-intel <kevin.ta@intel.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@kminhta