Various Web Scraping projects I've worked on over the years. These projects showcase different techniques, tools, and applications of web scraping.
| 🚀 Project | 📝 Description |
|---|---|
| LLM API Cost Calculator | A Streamlit app that scrapes real-time pricing data for LLM APIs, to compare costs across different providers. |
| YouTube Video Data Fetcher | A tool that fetches and analyzes YouTube video metadata in bulk. Features caching, concurrent processing, and data visualization for personal playlist management. |
| Extract Summit Local Chapter India | Materials from a web scraping talk I presented at the Zyte Extract Summit local chapter in India. |
| Wolf 359 Script Downloader | Downloads episode scripts from the official Wolf 359 radio drama website, with features for combining episodes and converting to markdown format. |
| Extract Summit Contest 2024 | A contest to create a crawler to extract product information from multiple layouts using Zyte API for AI-driven layout handling. |
| Learn Scrapy | A project focused on learning and implementing Scrapy, a powerful web scraping framework for Python. |
| Nimble LLM Web Scraping Challenge | A challenge project combining web scraping techniques with Large Language Models (LLMs). |
| Web Scraping Bootcamp | A comprehensive bootcamp-style project covering various aspects of web scraping. |
| Enrolled Udemy Courses Exporter | A tool to export and list all enrolled courses from Udemy, demonstrating practical application of web scraping. |
| Trending YouTube Videos Scraper | A scraper designed to extract information about trending videos on YouTube. |
| Web Scraping Projects | A collection of various web scraping projects, showcasing different techniques and use cases. |