-
Notifications
You must be signed in to change notification settings - Fork 8
Ping without reconfig #11
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Open
janhampe
wants to merge
271
commits into
microsoft:main
Choose a base branch
from
janhampe:ping_without_reconfig
base: main
Could not load branches
Branch not found: {{ refName }}
Loading
Could not load tags
Nothing to show
Loading
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
Open
Changes from all commits
Commits
Show all changes
271 commits
Select commit
Hold shift + click to select a range
955d4ec
Update ideas.md
Blizzzard1234 f97fc20
Correcting spelling mistake (enc -> env)
Blizzzard1234 f3ae2f4
Reorganizing some tings and added the actual run commands
Blizzzard1234 f615859
added logging for errors to run_3a.py. Also uploading my results for …
Blizzzard1234 5be2bb7
Add endpoint_rest.log
Blizzzard1234 40516b0
Update installing.md
Blizzzard1234 077bcc5
Update installing.md
Blizzzard1234 5cd44f5
Executed run_3a on vislor
Blizzzard1234 94b3e7d
Delete empty directory
Blizzzard1234 a1b71a5
Delete experiments/results/fig-3a-date-2024-11-05-time-22-38-08 direc…
Blizzzard1234 e37adba
Delete experiments/results/fig-3a-date-2024-11-05-time-22-40-26 direc…
Blizzzard1234 8be5e44
Delete experiments/results/fig-3a-date-2024-11-05-time-22-54-06 direc…
Blizzzard1234 17452b4
Renaming folders and getting rid of errored data
Blizzzard1234 3c7f561
Update ideas.md
janhampe e114711
Added results/ and modified run_4.py to work
b80bc25
Merge branch 'dev' of github.com:SirZayers/Nimble into dev
3e9eb83
Added pycache to gitignore
f7269b0
Updated .gitignore and changed shell.nix
abab99f
chore: add lua libraries install script
sherifhussien 3a86f41
Adding logging and config.py
invalid-email-address 677f115
added cargo and rust to shell.nix so we dont have to install it every…
MatheiANo adec8fe
added wrk2 to shell.nix
MatheiANo 7954a07
test
2145241
test2
69a7b27
added instructions on how to compile hadoop-nimble, still working on …
MatheiANo 7a28d1a
add results of 3a vislor
ivanovahr e254902
Update init.sh
Blizzzard1234 8b6d8bb
Update shell.nix
Blizzzard1234 e1efe54
Update shell.nix for Azurite
Blizzzard1234 33821e5
Modifying code to accept Azurite tables instead of azure. Setum ain c…
invalid-email-address 5dbaa0a
Merge branch 'dev' of https://github.com/SirZayers/Nimble into dev
invalid-email-address 8dbc406
Modifying code to accept Azurite tables instead of azure. Setup ain c…
invalid-email-address 24503b4
Added WRK2
invalid-email-address 793b464
Added WRK2
invalid-email-address 89fa5ce
Update shell.nix
Blizzzard1234 f966983
Update shell.nix
Blizzzard1234 adb97fe
Update shell.nix
Blizzzard1234 2e632f7
Still desperatly trying to run azurite
Blizzzard1234 75e2bee
Merge branch 'dev' of https://github.com/SirZayers/Nimble into dev
invalid-email-address 49a153b
Still desperatly trying to run azurite
invalid-email-address 56ca34c
I will shoot my computer if this azurite stuff does not work (Also, c…
Blizzzard1234 d1e1655
Fixed some errors I made earlier
invalid-email-address 26486a1
Added several more tests for run_4
Blizzzard1234 f3edd06
added instructions for installing and running hadoop-nimble. Instruct…
MatheiANo f0178c4
added instructions for installing hadoop-upstream
MatheiANo 36a66e6
added first results for hadoop-nimble-memory NNT-Benchmark
MatheiANo 676c3a1
added script to run NNT Benchmark for hadoop
MatheiANo d3727fc
added guide to run NNT Benchmark
MatheiANo 08c1071
I think I finally got the stupid uuid to work
Blizzzard1234 6de3020
Another try at the stupid azurite stuff
invalid-email-address a110cd9
Merge branch 'dev' of https://github.com/SirZayers/Nimble into dev
invalid-email-address c63966f
Using a custom Azurite account because I dont know the standard defua…
Blizzzard1234 e35025a
It works, now to try with a bigger workload
invalid-email-address bb2c2cb
Finally got some meaningfull Azuriurite results
Blizzzard1234 efc2088
Merge branch 'dev' of https://github.com/SirZayers/Nimble into dev
invalid-email-address 3fbe17f
It works, now to try with a bigger workload
Blizzzard1234 e442144
Azurite data with 50000req/s§
Blizzzard1234 5f37049
configuration for sev-snp
9b25569
sev-snp instructions added
hrisiiv fe239bb
sev works
683aa0e
Tried installing open enclave
janhampe b6993c4
Merged shell.nix
janhampe 33eec08
Finished the guide for all of Hadoop. Good Luck with everything on Th…
MatheiANo 6dce69c
added one tip
MatheiANo 0088c3e
SEV SNP results 3a
106088f
added instructions for scripts in HiBench
MatheiANo 68e07f0
Merge branch 'dev' of https://github.com/SirZayers/Nimble into dev
f1e6476
SEV 3a results
c5ac767
hristina vislor 3a results
ivanovahr 712e331
actually pushed the SAVED file :)
MatheiANo 0313cab
Create HadoodBenchmarks.py with no Nimble
Blizzzard1234 f90b142
Update HadoodBenchmarks.py
Blizzzard1234 c22f51b
Update shell.nix
Blizzzard1234 7a11e72
Update shell.nix
Blizzzard1234 929c31a
Update shell.nix
Blizzzard1234 cccd85f
added pinging function in coordinator, not tested yet
hrisiiv 52ad500
Included nonce in pinging. Also should have included the endorser and…
invalid-email-address 213ee29
Included nonce in pinging. Also should have included the endorser and…
Blizzzard1234 7a3d9fe
Implemented ping functionality in endorser
janhampe 7f690eb
Merging functioning endorser ping functions into work-in-progress coo…
janhampe 5fec0eb
Fixed merge manually by removing all remains of dysfunctional branch
janhampe 4f8f959
Also removed sign_with_private_key() because there was no reason for …
janhampe 16e96e1
Fixing the coordinator_state.rs to work (hopefully) with the new endo…
invalid-email-address b9ae0d3
fixing coordinator so it works with the new endorser pinging
Blizzzard1234 95047a5
Added coordinator ping timeout counter
Blizzzard1234 87bbc0c
Finally fixed all the errorsgit add .git add .git add .git add .git a…
Blizzzard1234 6b8ebed
added empty cargo test to endorser_state
MatheiANo 0943101
added testing_ping.py
MatheiANo 34bb72a
added first test in endorser
MatheiANo 17637f3
fixxed
MatheiANo 3780865
fixxed
MatheiANo ebcb74c
removed warning
MatheiANo 9a62e7b
added prints in coordinator tests
MatheiANo b2e7088
added more prints
MatheiANo 4184db7
added print messages in coordinator state to debug
MatheiANo 604ab49
added some prints
MatheiANo a7fea86
"tried a test to print out the ping timeout_map"
MatheiANo ecb4091
added fatser nixshell
MatheiANo 1862a3c
added a getter for the timeout map and a possible print in a test
MatheiANo 8dd8c07
put away the dereferecing
MatheiANo 706ae55
made the timeout_map a dummy so i could test if my test and getter ar…
MatheiANo 2369aff
put the dummy in the right spot
MatheiANo 61608a5
added a sleep so to potentially wait and changed the coordinator_stat…
MatheiANo 47c954e
tried it with calling the pingAllEndorsers
MatheiANo b9a7a50
tried sth
MatheiANo ca0cc07
tried again
MatheiANo 900a840
fixxed
MatheiANo 2cd741f
finally added right type
MatheiANo ff53551
tried fixxing sth
MatheiANo c808535
added correct import
MatheiANo cfb9fe2
added kill process
MatheiANo ab9f7ca
fixxed small error
MatheiANo 3abd600
tried adding a python script that tests the autoscheduler
MatheiANo 23c0df3
corrected the path
MatheiANo d730757
fixxed path
MatheiANo 3f8addb
trying around
MatheiANo 4ae5938
maybe this could work
MatheiANo c554215
maybe fixxed
MatheiANo d3ca80d
added print in endorser
MatheiANo a2fc6e3
added debug prints
MatheiANo 4cde7e7
tried fixxing sth
MatheiANo b21a722
printed out timeout map
MatheiANo 30fd876
tried putting all the testing into one python script
MatheiANo 94836ac
added args
MatheiANo a4d1b8b
final testing script
MatheiANo cac8cae
added error piping
MatheiANo 977375c
added endorser ping failure count, segmenht about n fails & logging
Blizzzard1234 5c3a4f6
added PingAll rpc to endpoint proto.
MatheiANo b3e8611
laptop change
MatheiANo 6b0f2f4
zwischen commit to bring up to date
MatheiANo 546fc3b
added functions in endpoint and coordinator for getTimeoutMap() -- sh…
MatheiANo cfa3f99
cleanup
MatheiANo 473e0a6
added PingAllEndorsers() to the endpoint
MatheiANo e099961
fixxed cargo test errors due to forgetting protos
MatheiANo 9c83afd
added protos to coordinator aswell
MatheiANo ca59980
again fixxed few compiler issues
MatheiANo b35996d
cargo compiler again
MatheiANo b33fee2
small fix
MatheiANo 93d8a07
put the ping test to ignore
MatheiANo 541fd5b
added route to endpoint_rest with Get Req to /pingallendorsers
MatheiANo 902dc56
added proto for add endorsers
MatheiANo 20a620f
added args integration
Blizzzard1234 018d0af
Fixed error, also replaced all timeout maps with the recomended conn_map
Blizzzard1234 f842fe0
Fixed error, also replaced all timeout maps with the recomended conn_map
Blizzzard1234 f1defec
Fixed pinging to comply with borrow checker
janhampe 046534d
Added a usage state to the EndorserClient to prepare for only some of…
janhampe ab71f2f
Fixed some bugs about counting the number of dead endorsers and chang…
janhampe 4a78397
Now sets endorsers usage state to active. Only count active endorsers…
janhampe e257397
Only decrease DEAD_ENDORSERS when the reconnecting endorser is active
janhampe 7563988
Create rust_build.yml
Blizzzard1234 466be5e
Create rust_build.yml
Blizzzard1234 c6ca8f2
Create rust_build.yml
Blizzzard1234 8cc9c80
Update rust_build.yml
Blizzzard1234 2f5433a
Now github automatically compiles and builds any code pushed
Blizzzard1234 1a19658
Update rust_build.yml
Blizzzard1234 f78d8e8
added some more features, also trying to fix args, lets see if it builds
Blizzzard1234 80c75db
fixed some errors
Blizzzard1234 f9a95e5
fixed some errors
Blizzzard1234 847f3d9
fixed some errors
Blizzzard1234 7f382fc
fixed some errors
Blizzzard1234 9209d02
fixed some errors
Blizzzard1234 f5030b5
fixed some errors
Blizzzard1234 41e5998
fixed some errors
Blizzzard1234 5b4d525
fixed some errors
Blizzzard1234 d8d267d
fixed some errors
Blizzzard1234 c8cda90
fixed some errors
Blizzzard1234 3d8b380
fixed some errors
Blizzzard1234 5c12fa5
fixed some errors
Blizzzard1234 3b3df96
fixed some errors
Blizzzard1234 2da060c
Added partial endorser quorum to replace_endorsers
janhampe 12a542e
Merge branch 'jan_dev' of github.com:SirZayers/Nimble into jan_dev
janhampe 921112c
Finished replace_endorsers. Now correct endorsers get finalized. Remo…
janhampe 6aa5b6d
Automatic replacement should work now. Fixed all compile errors. Adde…
janhampe b5e128b
Changed boolean replace to alive_endorser_percentage to make debuggin…
janhampe 3de8efd
Merged
janhampe ec44016
Added quorum_size argument and renamed some other arguments to make m…
janhampe e14777a
Merge branch 'jan_dev' into dev
janhampe 1b1ca01
updated config for run3a testing
MatheiANo a32c7e3
made ping test ignore
MatheiANo 3348fcf
added println for args debug
MatheiANo 97ca775
added debug options
MatheiANo c439970
corrected
MatheiANo 9eb6752
changed the args to debug
MatheiANo ceb2d1c
corrected the args i think
MatheiANo cd39b9f
fixxed the args, had to make the short args one character
MatheiANo 45c5d37
added debug options for alive_endorser_count
MatheiANo fe57841
maybe fixxed the dead_endorsercounter
MatheiANo eaa4490
added print for Variables/Args
MatheiANo 0d8c26c
added potential fix
MatheiANo 3cf8b24
more debug prints
MatheiANo 1809b67
see if this changes things
MatheiANo 18f2848
fixxed the alive_endorser_percentage and prints/checks frfr
MatheiANo 80d9158
fixxed again
MatheiANo 860a768
added and removed some prints
MatheiANo da5d956
debug to see when mut is effective
MatheiANo dc2205e
need to check this now
MatheiANo d649ba5
maybe this simple fix fixxes the problem
MatheiANo 193d15e
added print of the endorsers uris that are used for the new quroum
MatheiANo 6e3a2b8
updated so we could use cli args to set interval for pinging
MatheiANo 0ff25c4
added pinginterval in main.rs
MatheiANo 3f96519
fixxed ping_interval
MatheiANo 4d71be0
maybe fixxed
MatheiANo 2cfd56a
fixxed
MatheiANo fb2143b
changed para
MatheiANo 82c37c0
added results 3a tests
MatheiANo b086b10
setup for 1s intervall test
MatheiANo 14d99a4
added results for 1s interval
MatheiANo 0f6c5c5
Merge branch 'KilianBranch' into testing_dev
MatheiANo 0ffaea7
added add_endorser so no proto fail anymore
MatheiANo 096b6ba
fixxed again the build
MatheiANo c376aad
added proto class
MatheiANo f94d18a
hopefully fixxed
MatheiANo 4facf5c
fixxed??
MatheiANo 51ab93b
added adding endorsers thorugh grpc logic
MatheiANo 692c371
stashed progress for add_endorser endpoint
MatheiANo 592a2f3
updated to first draft
MatheiANo e153938
fixxed compiler errors
MatheiANo 06300e4
proto fix in lib.rs
MatheiANo 48342c5
fix: changed var name where i forgot
MatheiANo 412c9e6
fix: validate and decode endorsers URI in add_endorsers function
MatheiANo 0ece28a
fix: convert endorsers to string in add_endorsers function call
MatheiANo 99f74f5
fix: unwrap endorsers before converting to slice in add_endorsers fun…
MatheiANo ae907a7
feat: cooridnator ctrl
MatheiANo 70e0349
fix: update get_timeout_map to return Result and handle errors approp…
MatheiANo a3ac28d
fix: clean up unused variables in various functions and warnings abou…
MatheiANo f034501
feat: add testing controller script to execute and log commands for c…
MatheiANo 3562507
fix: update default coordinator hostname from 127.0.0.1 to localhost
MatheiANo aa659b5
added endpoint test, currently not working
MatheiANo 0ae74ba
updated
MatheiANo 82e521e
EVERY FUNCTION WORKS + added testing script and results
MatheiANo bdb65a1
refactor: clean up unused code and comments in coordinator state and …
MatheiANo 55d0f93
refactor: add logging for finalize state response in EndorserServiceS…
MatheiANo 4074046
docs: add missing documentation for Connection and EndpointState methods
MatheiANo af9f99d
docs: add detailed documentation for EndorserState and EndorserServic…
MatheiANo 9a24441
docs: add missing documentation for main function and endorser operat…
MatheiANo c7c6462
refactor: update comments from doc-style to single-line style in main…
MatheiANo c78cc68
docs: add missing documentation for CoordinatorServiceState methods a…
MatheiANo c8cec20
refactor: update logging setup to use current directory and improve p…
MatheiANo 1486386
added hadoop benchmarks
MatheiANo 3b4849d
feat: add benchmark results for Hadoop NN throughput operations
MatheiANo e6822e5
Update README.md
Blizzzard1234 4b34f64
Cleaned everything out that should not be in the PR
janhampe 82572b0
Refactor: Removed reconfigure functionality from coordinator and pers…
janhampe f0e9cbc
added gitattributes to normalize file endings
janhampe e21bb98
Changed all line endings to LF
janhampe b2b5b54
Reverted .gitignore changes
janhampe cff1e94
Removed personalized changes to config
janhampe 2138cf2
Removed personalized changes from run_3a.py
janhampe 43eb8c2
Removed personalized changes
janhampe 11daa65
Fixed typos
janhampe File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,2 @@ | ||
| # Make all line endings LF | ||
| * text=auto |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,39 @@ | ||
| name: Rust CI | ||
|
|
||
| on: | ||
| push: | ||
| branches: | ||
| - "*" # Trigger for all branches | ||
| pull_request: | ||
| branches: | ||
| - "*" # Trigger for all branches | ||
|
|
||
| env: | ||
| CARGO_TERM_COLOR: always | ||
|
|
||
| jobs: | ||
| build: | ||
| runs-on: ubuntu-latest | ||
|
|
||
| steps: | ||
| - name: Checkout code | ||
| uses: actions/checkout@v4 | ||
|
|
||
| - name: Install protoc | ||
| run: sudo apt-get update && sudo apt-get install -y protobuf-compiler | ||
|
|
||
| - name: Install Rust | ||
| uses: actions-rs/toolchain@v1 | ||
| with: | ||
| toolchain: stable # Use stable Rust; change if needed | ||
|
|
||
| - name: Cache Cargo | ||
| uses: actions/cache@v3 | ||
| with: | ||
| path: ~/.cargo | ||
| key: ${{ runner.os }}-cargo-${{ hashFiles('**/Cargo.lock') }} | ||
| restore-keys: | | ||
| ${{ runner.os }}-cargo- | ||
|
|
||
| - name: Build with Cargo | ||
| run: cargo build --verbose |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1,3 +1,6 @@ | ||
| # pycache | ||
| experiments/__pycache/* | ||
|
|
||
| # Generated by Cargo | ||
| # will have compiled files and executables | ||
| debug/ | ||
|
|
||
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1,13 +1,13 @@ | ||
| # Support | ||
| ## How to file issues and get help | ||
| This project uses GitHub Issues to track bugs and feature requests. Please search the existing | ||
| issues before filing new issues to avoid duplicates. For new issues, file your bug or | ||
| feature request as a new Issue. | ||
| For help and questions about using this project, please open an issue on GitHub. | ||
| ## Microsoft Support Policy | ||
| Support for this **PROJECT or PRODUCT** is limited to the resources listed above. | ||
| # Support | ||
|
|
||
| ## How to file issues and get help | ||
|
|
||
| This project uses GitHub Issues to track bugs and feature requests. Please search the existing | ||
| issues before filing new issues to avoid duplicates. For new issues, file your bug or | ||
| feature request as a new Issue. | ||
|
|
||
| For help and questions about using this project, please open an issue on GitHub. | ||
|
|
||
| ## Microsoft Support Policy | ||
|
|
||
| Support for this **PROJECT or PRODUCT** is limited to the resources listed above. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The comment contains a typo. "secounds" should be "seconds".