Skip to content

PkmnTCG WebScraper is a Python Webscraper that updates a Firbase DB with new Pokemon Card data scrapped from the official Pokemon website

Notifications You must be signed in to change notification settings

rendlny/PkmnTCG_WebScraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

20 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Pokemon TCG WebScraper

This program grabs pages from the official Pokemon Card Database Webpage and runs through each cards grabbing data to be added to the database. This code is designed to be run as a cron job, once or twice a month to fetch the latest card releases from Pokemon.

Setup

Dependencies

This project has a requirements.txt file to allow you to easily install the dependencies.

pip install -r requirements.txt

The following packages will be installed:

  • pycryptodome
  • pyrebase
  • beautifulsoup4
  • python-dotenv
  • mypy
  • pycodestyle
  • pylint

Usage

Run start.py to start the webscraper

py start.py

Static tests

Details Scraped

  • Url to card image
  • Card name
  • Stage
  • HP
  • Type
  • Attack:
    • Energy Cost
    • Attack Name
    • Attack Description
    • Attack Damage
  • Weakness
  • Resistance
  • Retreat Cost
  • Illustrator
  • Card Number

Card Set & Subset numbers must be set in the code & it will run through that subset

Other Features

  • run through all sets
  • check for new sets
  • separate cards by type (Pokemon, Trainer, Energy)

About

PkmnTCG WebScraper is a Python Webscraper that updates a Firbase DB with new Pokemon Card data scrapped from the official Pokemon website

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages