Introducing the Graph module#22

Open

FlorentinD wants to merge 221 commits intomasterfrom

Commits on Apr 30, 2019

Commits on May 3, 2019

added graph structure with class graph, vertex, edge; generated graph in test
pfeiffer-tim
committed
removed edge.h (edge is struct in vertex.h); fixed printing vertex infos
pfeiffer-tim
committed
added some comments...
pfeiffer-tim
committed

Commits on May 6, 2019

changed unsigned long int's to size_t
pfeiffer-tim
committed

Commits on May 13, 2019

Commits on May 14, 2019

Commits on May 16, 2019

Commits on May 17, 2019

Commits on May 18, 2019

Commits on May 20, 2019

Commits on May 21, 2019

Commits on May 23, 2019

Commits on May 24, 2019

comment stuff
pfeiffer-tim
committed

Commits on May 29, 2019

changed directory of LDBC files in test to /opt/...
pfeiffer-tim
committed

Commits on Jun 6, 2019

added ldbc.import() -> generate_vertices() + generate_edges()
pfeiffer-tim
committed

Commits on Jun 11, 2019

calculation of memory usage of graph
pfeiffer-tim
committed

Commits on Jun 12, 2019

Reworked size functions. Advise: Write custom allocator to record memory allocation sizes.
alexKrauseTUD
committed

Commits on Jun 17, 2019

updating comments and cleaning stuff
pfeiffer-tim
committed

Commits on Jun 26, 2019

new file structure; prep. for CSR format
pfeiffer-tim
committed

Commits on Jul 16, 2019

Commits on Jul 17, 2019

Commits on Jul 18, 2019

Commits on Jul 19, 2019

first woriking implementation of CSR storage format
pfeiffer-tim
committed

Commits on Jul 24, 2019

Commits on Aug 6, 2019

Commits on Aug 7, 2019

Commits on Aug 19, 2019

Importing edge-property now working...
pfeiffer-tim
committed

Commits on Aug 20, 2019

tidy-up some comments...
pfeiffer-tim
committed

Commits on Aug 21, 2019

fixed SegFaults of Edge-Properties; Finally working but slowly...
pfeiffer-tim
committed

Commits on Aug 27, 2019

Commits on Aug 28, 2019

Commits on Aug 30, 2019

social_network directory for DB Server
pfeiffer-tim
committed

Commits on Sep 2, 2019

directory of sn files - switch
pfeiffer-tim
committed

Commits on Sep 3, 2019

Commits on Sep 5, 2019

Commits on Mar 22, 2020

Check if vertex files could be found for ldbc import
Florentin Doerre
committed
Use regExp to filter valid csv files and getEntityType
Florentin Doerre
committed

Commits on Mar 23, 2020

Make entity naming consistent
Florentin Doerre
committed
Replace entity with vertexType in ldbc loader
Florentin Doerre
committed

Commits on Mar 24, 2020

Store AdjacencyLists in one map per graph
Florentin Doerre
committed
Differentiate between expected and actual vertex/edge count
Florentin Doerre
committed
Remove edgeValue_array from csr and allow multiple properties for edges
Florentin Doerre
committed
Unify vertex constructor
Florentin Doerre
committed

Commits on Mar 29, 2020

Restructure graph tests
Florentin Doerre
committed
Merge branch 'master' into graph
Florentin Doerre
committed
Throw runtime error for single edge addition for CSR graph
Florentin Doerre
committed
Extract bfs test into extra package
Florentin Doerre
committed

Commits on Mar 30, 2020

Add bfs tests for a simple graph
Florentin Doerre
committed
Upgrade cpp version to 17
Florentin Doerre
committed
Fix edge type bug and only build vertex_type_lookup once
Florentin Doerre
committed
Add vscode to gitignore
Florentin Doerre
committed
Put vertex properties into seperate container
Florentin Doerre
committed

Commits on Mar 31, 2020

Put edge properties in a seperate container
Florentin Doerre
committed
Allow properties of different types
Florentin Doerre
committed
Include static part of ldbc dataset
Florentin Doerre
committed

Commits on Apr 1, 2020

Add stub for vertex_storage benchmark
Florentin Doerre
committed

Commits on Apr 3, 2020

Add loading time and use an avg of 5 for the vertex_storage benchmark
Florentin Doerre
committed
Replace hashmap with vector of vectors for storing vertices
Florentin Doerre
committed

Commits on Apr 6, 2020

Fix a memory leak and also throw on invalid edges at CSR
Florentin Doerre
committed
Move vertex storage logic inside separate "vertices_container" class
Florentin Doerre
committed
Add link to ldbc schema
Florentin Doerre
committed

Commits on Apr 7, 2020

Add variant of vertices container using arrays instead of vectors
Florentin Doerre
committed
Use std::optional in ldbc_importer
Florentin Doerre
committed
Correct get_size() functions
Florentin Doerre
committed

Commits on Apr 10, 2020

Choose vertices container type at construction time
Florentin Doerre
committed

Commits on Apr 11, 2020

Extend vertices container benchmark
Florentin Doerre
committed

Commits on Apr 13, 2020

Provide a default init for property data_type
Florentin Doerre
committed

Commits on Apr 14, 2020

Add NDEBUG flag in order to skip asserts in release mode
Florentin Doerre
committed

Commits on May 12, 2020

Fix bfs test as it did not include static part of the graph
Florentin Doerre
committed
Use free instead of delete[]
Florentin Doerre
committed
Add method stub for graph compression
Florentin Doerre
committed
Use uncompressed columns in the CSR format
Florentin Doerre
committed
Delete redundant vertices container classes
Florentin Doerre
committed
Use unique Pointers for csr columns
Florentin Doerre
committed
Move vertex id gen inside of vertices container
Florentin Doerre
committed
Add memory usage to vertices container benchmark
Florentin Doerre
committed
Init compression of csr columns
Florentin Doerre
committed
Add valid flag for vertices and edges
Florentin Doerre
committed
Reserve pointers to vertex arrays
Florentin Doerre
committed
Add EdgesContainer similar to VerticesContainer
Florentin Doerre
committed
Use EdgesContainer in graph formats
Florentin Doerre
committed
WIP edges_container_benchmark
Florentin Doerre
committed
Align vertices_container naming
Florentin Doerre
committed
Fix edge ids by allowing explicit id
Florentin Doerre
committed
Add minor improvements
Florentin Doerre
committed
Try out DELTA and FOR compression for CSR format
Florentin Doerre
committed
WIP Introduce a template free column_base class
Florentin Doerre
committed
Use column_base in CSR
Florentin Doerre
committed
Fix simple graph test
Florentin Doerre
committed
Enable CSR to work on compressed columns
Florentin Doerre
committed
Prepare adjacency list format for compression
Florentin Doerre
committed
Convert adjacency vectors into colums aka finalize
Florentin Doerre
committed
Assert correct out_degrees after compression
Florentin Doerre
committed
Add virtual deconstructor to `column_base`
Florentin Doerre
committed
Implement `compress` for AdjacencyList format
Florentin Doerre
committed
Use a pointer to map for the adj-lists
Florentin Doerre
committed
Delete intermediate columns in morph_graph_col
Florentin Doerre
committed
Delete temporary colums in CSR and refactor duplicate get_edge_ids code
Florentin Doerre
committed
Comment and rename minor things
Florentin Doerre
committed
Remove relative imports
Florentin Doerre
committed
Morph adj-list map now in-place and add logging
Florentin Doerre
committed
Use "morph" instead of "compress"
Florentin Doerre
committed
Add edges container benchmark
Florentin Doerre
committed
Add debug flag
Florentin Doerre
committed
Add compression ratios to CSR statistics
Florentin Doerre
committed
Restrict compressed adj_list by minimum size
Florentin Doerre
committed
Solve issue for building in release mode
Florentin Doerre
committed
Move ldbc importer to dedicated sub-folder
Florentin Doerre
committed
Rename graph_compr_format to str function
Florentin Doerre
committed
Add functions returning column compr. ratios
Florentin Doerre
committed
Extract common functions into a graph benchmark helper
Florentin Doerre
committed
Add graph compression benchmarks
Florentin Doerre
committed

Commits on May 14, 2020

Format graph files
Florentin Doerre
committed

Commits on May 17, 2020

Fix compile errors
Florentin Doerre
committed
Define ldbc resource dir via cmake
Florentin Doerre
committed
Fix debug mode by re-adding the DEBUG flag
Florentin Doerre
committed

Commits on May 18, 2020

Fix benchmark helper
Florentin Doerre
committed
Reduce use of min_compr_degree in adj_list format
Florentin Doerre
committed
Make min_compression_degree non-static
Florentin Doerre
committed

Commits on May 19, 2020

Generate edge ids at graph-scope and remove duplicate code
Florentin Doerre
committed

Commits on May 25, 2020

Add dynamic_vbp as a graph compression format
Florentin Doerre
committed
Correct column-ratio by not counting empty adjacency lists
Florentin Doerre
committed
Set min-compr-degree based on blocksize of compression format
Florentin Doerre
committed
Benchmark full_iterate for adj-list graph
Florentin Doerre
committed
Fix compression benchmark output
Florentin Doerre
committed

Commits on May 29, 2020

Replace hard coded block-sizes
Florentin Doerre
committed
Use format blocksize as min_compr_degree by default
Florentin Doerre
committed

Commits on May 31, 2020

Start with `morph_saving_offsets`
Florentin Doerre
committed
Check if SSE was defined
Florentin Doerre
committed

Commits on Jun 1, 2020

Implement `morph_saving_offsets`
Florentin Doerre
committed

Commits on Jun 2, 2020

Set reasonable LDBC_DIR default value
Florentin Doerre
committed
Remove one evil `const`
Florentin Doerre
committed
Add template free column_with_blockoffsets_base
Florentin Doerre
committed
Put morph_graph_col into seperate header
Florentin Doerre
committed
WIP add template free morph_saving_offsets to use for csr columns
Florentin Doerre
committed

Commits on Jun 5, 2020

Improve morph_saving_offsets_test
Florentin Doerre
committed
Add test for morphing column blocks and fix bug regarding last block
Florentin Doerre
committed
Fix offset last block if it is uncompressed
Florentin Doerre
committed

Commits on Jun 8, 2020

Fix bug decompressing column_with_blockoffsets at once
Florentin Doerre
committed

Commits on Jun 9, 2020

Add decompress_column_block function
Florentin Doerre
committed
Use decompress_column_block in csr format
Florentin Doerre
committed
Cache decompressed column block
Florentin Doerre
committed
Cache edgeId_column in CSR + bug fix for getting edge-ids
Florentin Doerre
committed

Commits on Jun 12, 2020

Add instructions for LDBC_DIR flag
Florentin Doerre
committed
Fix delete error in AdjacencyList format and correct size_of_graph func
Florentin Doerre
committed
Assert offsets in csr make sense
Florentin Doerre
committed
Fix title of benchmark
Florentin Doerre
committed
Move degree measurement into a seperate operator and use shared ptr
Florentin Doerre
committed
Do not save graph in BFS class as volatile graphs dont work then
Florentin Doerre
committed

Commits on Jun 14, 2020

Add bfs benchmark
Florentin Doerre
committed
Add naive page rank
Florentin Doerre
committed
Add tests for page rank
Florentin Doerre
committed
Add page-rank benchmark
Florentin Doerre
committed

Commits on Jun 15, 2020

Comment more code
Florentin Doerre
committed
Fix measurement unit description in benchmark
Florentin Doerre
committed
Fix documented file names
Florentin Doerre
committed
Merge remote-tracking branch 'origin/master' into graph
Florentin Doerre
committed
Add a getting started section for the graph module
Florentin Doerre
committed

Commits on Jun 16, 2020

Comment new morph operators
Florentin Doerre
committed
Allow different compression formats for the different csr columns
Florentin Doerre
committed
Benchmark partial csr compressions
Florentin Doerre
committed

Commits on Jun 22, 2020

Allow fallback to string if data-type could not be found in schema
Florentin Doerre
committed