Skip to content

shahramBarai/simple-big-data-platform

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

6 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Simple Big Data Platform

Hi, my name is Shahram Barai, first-year master's student in Computer, Communication, and Information Sciences, specializing in Computer Science: Software Systems and Technologies at Aalto University.

This repository contains assignments for the Big Data Platforms course (completed in spring 2023), where my task was to build a simple big data platform.

Architecture

The following are the pictures of the evolution of the platform architecture, starting from the first assignment and culminating in the third and final assignment.

For more information about desing and technical issues, check Assignment{number}/Reports/Assignment{number}_Report.md**

Assignment 1 (Big Data Platforms):

reports/architecture.png

Assignment 2 (Data Ingestion Pipelines):

mysimbdp_batch_data_ingestion_architecture

near_realtime_data_ingestion_architecture

Architecture 3 (Stream and Batch Processing):

assignment_3_architecture

About

This project is part of Aalto University's Big Data Platforms course (completed in spring 2023).

Resources

License

Stars

Watchers

Forks

Contributors