Skip to content

Conversation

@Gallaecio
Copy link
Member

@Gallaecio Gallaecio commented Jan 22, 2025

Modernize the code base to support the latest versions of Python, so that https://github.com/scrapinghub/scrapy-frontera tests can pass (scrapinghub/scrapy-frontera#14).

I got tests to pass, but skipped all those that require running a service, as I imagine it would be non-trivial to get them to pass in GitHub Actions, and I was not sure about using https://github.com/tox-dev/tox-docker to get the services running locally. Not sure if I should try to test those manually at least, I wonder if there are any current users of those service-based features.

To do:

@Gallaecio Gallaecio requested review from VMRuiz, kmike and wRAR January 22, 2025 20:07
@kmike kmike requested a review from sibiryakov January 22, 2025 20:10
Copy link

@VMRuiz VMRuiz left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I hope you used a tool to refactor this code and didn’t rewrite it line by line! 😄

@Gallaecio
Copy link
Member Author

Gallaecio commented Jan 23, 2025

Yeah, most changes come from adding pyupgrade to pre-commit*. Reviewing separate commits may be easier here.

* I added pyupgrade for functional reasons, not for cleanup. There were old stdlib imports preventing the code from working in newer Python versions, and pyupgrade solved that automatically.

@Gallaecio
Copy link
Member Author

Closing. Will instead prepare a 0.7.2 release.

@Gallaecio Gallaecio closed this Feb 5, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Pin w3lib version as requirement (or update library to be able to use newest w3lib versions)

2 participants