A fast, structured solution for gathering real-time listings and advertisement data from Kijiji. This crawler helps users collect accurate product details, pricing, seller information, and search results at scale. Ideal for researchers, analysts, and automation workflows needing reliable Kijiji data.
Created by Bitbash, built to showcase our approach to Scraping and Automation!
If you are looking for kijiji-crawler you've just found your team — Let’s Chat. 👆👆
The Kijiji Crawler retrieves structured information from search pages and advertisement listings across the Kijiji platform. It solves the challenge of manually tracking or extracting classified ads by automating the entire process and producing clean, machine-readable results. This tool is suitable for data analysts, e-commerce researchers, resellers, and developers building market intelligence systems.
- Automates the collection of Kijiji listings without manual browsing.
- Extracts detailed advertisement data including title, price, images, and descriptions.
- Supports both search pages and direct advertisement URLs.
- Designed for users needing scalable and consistent marketplace insights.
- Helps power dashboards, analytics tools, and competitive market tracking.
| Feature | Description |
|---|---|
| Search Page Scraping | Extracts structured results from Kijiji search pages with pagination support. |
| Advertisement Extraction | Retrieves title, price, description, images, and seller info for any listing URL. |
| Configurable Page Depth | Control how many pages to crawl using maxPagesToSearch. |
| Optional Ad Collection | Automatically scrape all ads found within search results. |
| Proxy Support | Choose between custom proxies or built-in proxy settings. |
| Debug Mode | Enables verbose logs for troubleshooting and testing. |
| Field Name | Field Description |
|---|---|
| dataType | Identifies whether the record is a search result or an advertisement. |
| title | Title of the listing or advertisement. |
| price | Numeric price value associated with the item or service. |
| description | Full text description of the advertisement. |
| url | Direct URL of the listing. |
| imageUrl | Primary image of the listing (search results). |
| images | Full list of image URLs for advertisement pages. |
| seller | Structured seller information including name and profile link. |
| pagination | Info about current page, total pages, and next/prev URLs (search results). |
| total | Number of listings available within the search results. |
| results | Array of advertisements returned from search pages. |
{
"dataType": "search",
"pagination": {
"page": 1,
"pages": 6,
"urls": {
"first": "https://www.kijiji.ca/b-motorcycles/ville-de-montreal/kawasaki/k0c30l1700281?sort=dateDesc&radius=150.0#",
"last": "https://www.kijiji.ca/b-motorcycles/ville-de-montreal/kawasaki/page-6/k0c30l1700281?radius=150.0&sort=dateDesc",
"next": "https://www.kijiji.ca/b-motorcycles/ville-de-montreal/kawasaki/page-2/k0c30l1700281?radius=150.0&sort=dateDesc"
}
},
"total": 240,
"results": [
{
"dataType": "advertisement",
"title": "Kawasaki KLX 300 2024",
"price": 8200.00,
"description": "Salut je vends mon Kawasaki KLX 300 2024...",
"url": "https://www.kijiji.ca/v-street-cruisers-choppers/ville-de-montreal/kawasaki-klx-300-2024/1687932219",
"imageUrl": "https://media.kijiji.ca/api/v1/ca-prod-fsbo-ads/images/41/418e60f7-a37d-413d-b787-85131f9c2eb2?rule=kijijica-200-jpg"
}
]
}
{
"dataType": "advertisement",
"title": "Kawasaki KLX 300 2024",
"url": "https://www.kijiji.ca/v-moto-chopper/ville-de-montreal/kawasaki-klx-300-2024/1687932219",
"price": 8200.00,
"description": "Salut je vends mon Kawasaki KLX 300 2024...",
"seller": {
"name": "Boby Desrosiers",
"url": "https://www.kijiji.ca/o-profile/31892218/listings/1"
},
"images": [
"https://media.kijiji.ca/api/v1/ca-prod-fsbo-ads/images/41/418e60f7-a37d-413d-b787-85131f9c2eb2?rule=kijijica-640-jpg"
]
}
Kijiji Crawler/
├── src/
│ ├── runner.py
│ ├── extractors/
│ │ ├── kijiji_parser.py
│ │ └── pagination_utils.py
│ ├── outputs/
│ │ └── exporters.py
│ └── config/
│ └── settings.example.json
├── data/
│ ├── inputs.sample.json
│ └── sample_output.json
├── requirements.txt
└── README.md
- Market researchers use it to gather real-time pricing and item availability, enabling accurate market trend analysis.
- E-commerce sellers use it to monitor competitor listings, helping optimize pricing and inventory strategies.
- Developers integrate it into automation pipelines to power dashboards, alerts, and analytics systems.
- Lead generators collect seller info and advertisements to build enriched outreach lists.
- Data analysts use it for building datasets used in machine learning and research projects.
Q1: Can this crawler handle both search and advertisement URLs? Yes, it automatically detects URL types and extracts the appropriate data format.
Q2: How many pages can be scraped from a search URL?
You control this using maxPagesToSearch. The default is 5, but you can increase or decrease it as needed.
Q3: What if I only want detailed advertisement data?
Set fetchAdsFromSearch to true to fetch individual ad details from search result pages.
Q4: Can I use custom proxies? Yes, the crawler accepts a custom proxy configuration or can run without one.
Primary Metric: Processes an average of 30–50 advertisement listings per minute depending on network conditions and page complexity.
Reliability Metric: Maintains a consistent 98% success rate across large batches of URLs, even with paginated searches.
Efficiency Metric: Optimized to reduce duplicate requests, improving throughput by up to 40% during multi-page crawls.
Quality Metric: Delivers clean, structured data with high completeness — typically capturing over 95% of available ad attributes.
"Bitbash is a top-tier automation partner, innovative, reliable, and dedicated to delivering real results every time." Nathan Pennington
|
"Bitbash delivers outstanding quality, speed, and professionalism, truly a team you can rely on." Eliza
|
"Exceptional results, clear communication, and flawless delivery. Syed
|