Skip to content

Scraping flats from Sreality.cz using scrapy framework.

Notifications You must be signed in to change notification settings

adamhosticka/Sreality-Scraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

16 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Sreality Scraper

This project is a web scraping application built using Docker, consisting of multiple services:

  • PostgreSQL Database: Stores scraped flat data.
  • Scrapy Framework Scraper: Scrapes flat listings from Sreality.cz.
  • Flask API Server: Provides an API to display the scraped flat data.

Prerequisites

  • Docker must be installed on your system.

Getting Started

  1. Clone the project repository:
git clone https://github.com/adamhosticka/Sreality-Scraper.git
cd Sreality-Scraper
  1. Build and run the project:
docker-compose up --build

This command will build the Docker images and start the services.

  1. Access the Flask API server:

Once the services are up and running, you can access the Flask API server at http://localhost:8080. This is where the scraped flat data will be displayed.

Usage

  • Scraping Flats: The Scrapy scraper service will automatically start scraping flat listings from Sreality.cz. api. The scraped data will be stored in the PostgreSQL database.

  • Accessing Scraped Data: The Flask API server provides endpoints to access the scraped flat data. You can make HTTP requests to retrieve the flat data as per your requirements.

About

Scraping flats from Sreality.cz using scrapy framework.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published