Skip to content

cj-zhukov/datalake-backend

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

14 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Description

A backend service that executes distributed SQL queries over Parquet data stored in AWS S3. Built with Rust, DataFusion, and Ballista, it provides an API for running analytical queries and returns results as presigned URLs for Parquet and JSON outputs. Designed to support web visualization (Leptos) with efficient server-side processing and cloud-native execution.

Architecture

Below is the high-level architecture:

Architecture Diagram

About

Distributed query backend using Rust, DataFusion, Ballista and Leptos

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors