32datasources is a Python service that continuously gathers data from your 32auctions listing, stores the latest snapshot in auction_items.json, and exposes a live control panel with manual overrides. This works in conjunction with the 32dashboards project, but can run standalone if you just need a JSON file.
- Service that collects item metadata and total raised value on a configurable cadence.
- Control panel (served on port 8081) with:
- Real-time log stream
- Live status including last refresh, manual adjustment, and next refresh countdown
- Buttons to pause/resume the refresh loop or trigger an immediate refresh
- Manual adjustment field to tweak the reported total
- Text filter to exclude items from the JSON file
- Install dependencies:
pip install -r requirements.txt
- Launch the service:
python3 scrape_auction.py
- Open the control panel in a browser at http://localhost:8081/.
Data is written to auction_items.json in the project root so other processes can consume it.
The JSON file contains:
- Time of the last refresh
- URL of the auction
- Total number of items
- Total amount raised
- A list of all items, including:
- Item title
- Picture URL
- Price
- Remaining (if applicable, otherwise null)
- Value (if applicable, otherwise null)
- Number of bids (if applicable, otherwise null)
- A auth token is required to grab the total raised
- Runs great in docker:
docker build -t 32datasources . docker run --rm -p 8081:8081 --name 32datasources 32datasources