[v0.17.4] - 2025-02-07

Disabled check url via validators, faced cases when valid url can't be validated correctly and as result not scraped

Full Changelog: v0.17.3...v0.17.4

[v0.17.3] - 2025-02-07

Changed

• Bupmped validators from 0.22.0 to 0.34.0

Full Changelog: v0.17.2...v0.17.3

v0.17.2

[v0.17.2] - 2024-11-05

Changed

• Implemented conditional caching: results are now saved to disk only if caching is enabled, optimizing storage and performance.

Removed

• Reverted resource and file type blocking functionality (block_types and block_extensions in BrowserQueryParams) due to performance concerns impacting scrapper efficiency.

---

Full Changelog: v0.17.1...v0.17.2

v0.17.1

[v0.17.1] - 2024-10-11

Added

• Added support for the status_code field in the AnyPage model to capture the HTTP status of the page.
• Introduced stealth_scripts and user_pre_scripts parameters to enable custom scripts for stealth mode and pre-page-load actions.
• Updated the use_stealth_mode function to allow selective loading of scripts.
• Added stealth.min.js to the app/scripts directory. This script was generated using npx extract-stealth-evasions based on the Puppeteer Extra Stealth Evasions repository (link).

Changed

• Enhanced the page_processing function to return the HTTP status code.
• Improved validation for custom scripts in the CommonQueryParams class.

---

Full Changelog: v0.17.0...v0.17.1

v0.17.0

Update README.md