Skip to content

Toolchain Upgrade: CMake, Conan, GitHub Actions, and more#138

Open
hrz6976 wants to merge 65 commits intopkumod:1.2from
hrz6976:for-merge
Open

Toolchain Upgrade: CMake, Conan, GitHub Actions, and more#138
hrz6976 wants to merge 65 commits intopkumod:1.2from
hrz6976:for-merge

Conversation

@hrz6976
Copy link
Contributor

@hrz6976 hrz6976 commented Jan 13, 2024

Important

This PR is protentially breaking!
With a lot of file restructuring, includes renaming and reordering, the codebase is prone to break after merging this PR.
I'm not able to run the entire test suite, please double check the changes and make sure all tests pass before merge.

Changes in this PR

  • Migrate the build system from hundreds of lines of hard-crafted GNU Makefile to a list of tree-structured CMakefiles.txt.
  • Integrate the Conan package manager to make developers' life easier with 3rd party libraries.
  • Use ninja-build (and optionally mold) for faster compiling and linking.
  • Add GitHub Actions pipelines to 1. test on every commit; 2. draft releases; 3. build docker images; 4. upload docs to cloudflare pages.
  • Add premilary support for loongarch.

TODOs

  • Update the documentation. (will continue in online-docs branch)
  • Add a CI pipeline to automatically build and test gStore on every PR & commit to the default branch.
  • Make all tests run. Still stuck at:
    • 2 - ParserTest (Failed)
    • 4 - TransactionTest (SEGFAULT)
    • 5 - RunTransaction (Failed)
    • 6 - DebugTest (SEGFAULT)

DISCLAIMER

This PR is a part of the course project in PKU's graph data management course.

hrz6976 and others added 30 commits January 13, 2024 23:29
@hrz6976
refactor(cleanup): restructure folders
97e9a9a
@hrz6976
build: switching to cmake
3fa3fb4
@hrz6976
build: add meson build profile
083a259
@hrz6976
fix: regressions (data->fixtures) in auto refactoring
99d9cbd
@hrz6976
build: migrate toolchain to CMake and Conan
fc89d7a 
!possibly breaking, tests are required
@hrz6976
fix: compile issues
9f9df49
@hrz6976
build: add uninstall, add flags
37f4b8a
@hrz6976
chore: move artifacts to a standalone folder
fa861f9
@hrz6976
chore: restructure and cleanup
e3ee78a
@hrz6976
chore(cleanup): fix gitignore, remove unused
d3c01ee
@hrz6976
fix(build): rapidjson can't be found
f543ba8
@hrz6976
build: dockerfile for cmake
784fe67
@hrz6976
fix(docker): init script won't build db
93b9727
@fyulingi @hrz6976
Accelerate TempResult::dofilter by replacing tostring method from str…
b922a70 
…ingindex::randomaccess to kvstore::getstringbyid.
@Jeevan620 @hrz6976
update(ghttp&grpc): add param disk to monitor api
446e195
@fyulingi @hrz6976
Add limit_num (optional parameter) for do_filter.
6244c37
@SoftlySpoken @hrz6976
Pass limit num into doFilter in GeneralEvaluation
a84bf87
@hrz6976
Opt(Query): filter multiple conditions early termination
c5d5bc0
@fyulingi @hrz6976
Improve bgp plan (from dfs_strategy to bfs_strategy).
3e759e7
@fyulingi @hrz6976
Remove one line debug_output in PlanGenerator.cpp.
229b8ae
@Jeevan620 @hrz6976
update(ghttp&grpc): update userPrivilegeManage api
7913499
@Jeevan620 @hrz6976
update(APIUtil): add rwlock for system db
62b7ddb
@hrz6976
Add gzip:add json query default is gzip
5b2900f
@Jeevan620 @hrz6976
update(APIUtil): refactor some methods
28f141b
@Jeevan620 @hrz6976
update(ghttp): refactor build api
36da1dd
@Jeevan620 @hrz6976
update(grpc): refactor build api
090e8f7
@hrz6976
replace rm(ghttp.cpp):add remove_path as system rm
a978f40
@hrz6976
replace system(grpc.cpp):add remove_path replace system rm
81fae69
@hrz6976
replace rm(gdrop,gexport,ginit,shutdown):remove_path replace system rm
77caffc
@Jeevan620 @hrz6976
update parser_test script
094e296
hrz6976 added 25 commits January 14, 2024 00:33
@hrz6976
feat: + backward for stacktraces, cmake cleanup
0e91e87
@hrz6976
fix: test cases
5a5f1a5 
Some of the tests have hard-coded paths to HUGE datasets (10GB compressed), so no luck for them :(
@hrz6976
test: + ctest
85b5846
@hrz6976
feat: add binary packaging
7a96be8
@hrz6976
ci: add github actions
7b7120b
@hrz6976
ci: move locv commands to cmakelists
d09a4d8
@hrz6976
ci: fix ci build issues
579b63b 
fix(docker): dockerfile regression
fix(build): cmake coverage regression
fix(ci): tarball is missing
ci: use vars, not secrets for public info
fix: cp: ../lib/x.so is the same file
ci: prepare first
ci: build verbosely in CI
@hrz6976
fix(test): fix binary tests in CI
5c28246
@hrz6976
ci(docker): don't install the toolchain for a tar
45e093e
@hrz6976
fix(ci): failed to hash file
74894f8
@hrz6976
ci: add release pipeline
4015bb6
@hrz6976
ci: parallelize docker build
0a6d213
@hrz6976
fix(ci): test can't be triggered
d3a8c4b
@hrz6976
fix(ci): docker x64 won't build
edde887
@hrz6976
fix(ci): missing prepare
9eb26f2
@hrz6976
fix(ci): manually triggered releases
2af7539
@hrz6976
ci(docker): use gh cache backend
12bc1e5
@hrz6976
fix(ci): don't skip if release exists
7755df8
@hrz6976
docs: add badges to README
e83a8be
@hrz6976
revert(ci): merge docker pipeline
99c38f4
@hrz6976
feat(build): unify setup scripts
3753e8b
@hrz6976
chore: remove unused assets
249510c
@hrz6976
docs: fix README rendering issues
e24edff
@hrz6976
fix(test): fix test run_transaction
6ba17b4
@hrz6976
ci(docs): deploy cloudflare pages on push
fa7977a
@hrz6976 hrz6976 mentioned this pull request Jan 13, 2024
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

4 participants

@hrz6976 @fyulingi @Jeevan620 @SoftlySpoken

Comments