Skip to content

Remove fastparquet support#624

Merged
laughingman7743 merged 1 commit intomasterfrom
feature/remove-fastparquet-support
Nov 9, 2025
Merged

Remove fastparquet support#624
laughingman7743 merged 1 commit intomasterfrom
feature/remove-fastparquet-support

Conversation

@laughingman7743
Copy link
Member

Summary

Remove fastparquet support to simplify maintenance and enable Python 3.14 support.

Motivation

  • fastparquet has not been actively maintained
  • fastparquet lacks Python 3.14 support (cramjam dependency issue)
  • PyArrow is the industry standard for Parquet operations
  • PyArrow is better maintained with broader community support
  • The "auto" engine selection already preferred PyArrow

Changes

  • ✅ Remove pyathena/fastparquet/ module
  • ✅ Remove tests/pyathena/fastparquet/ tests
  • ✅ Remove fastparquet from pyproject.toml dependencies
  • ✅ Update pyathena/pandas/result_set.py to use PyArrow only
  • ✅ Remove fastparquet test cases from pandas cursor tests
  • ✅ Remove fastparquet test table from create_table.sql.jinja2
  • ✅ Update README.rst and docs/introduction.rst

Breaking Change

⚠️ Users explicitly using engine="fastparquet" must migrate to engine="pyarrow" (the default).

Most users are unaffected because:

  • The "auto" engine selection already preferred PyArrow
  • PyArrow has been the recommended engine

Test Plan

  • CI tests pass on Python 3.10-3.13
  • All pandas cursor tests work with PyArrow only
  • Documentation is updated

🤖 Generated with Claude Code

fastparquet has not been actively maintained and lacks Python 3.14
support. PyArrow is now the standard for Parquet operations and is
better maintained with broader community support.

Changes:
- Remove pyathena/fastparquet/ module
- Remove tests/pyathena/fastparquet/ tests
- Remove fastparquet from pyproject.toml dependencies
- Update pyathena/pandas/result_set.py to use PyArrow only
- Remove fastparquet test cases from pandas cursor tests
- Remove fastparquet test table from create_table.sql.jinja2
- Update README.rst and docs/introduction.rst

BREAKING CHANGE: Users explicitly using engine="fastparquet" must
migrate to engine="pyarrow" (the default). The "auto" engine selection
already preferred PyArrow, so most users are unaffected.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
@laughingman7743 laughingman7743 mentioned this pull request Nov 9, 2025
3 tasks
@laughingman7743 laughingman7743 marked this pull request as ready for review November 9, 2025 10:31
@laughingman7743 laughingman7743 merged commit a25ea0e into master Nov 9, 2025
4 checks passed
@laughingman7743 laughingman7743 deleted the feature/remove-fastparquet-support branch November 9, 2025 10:31
@laughingman7743 laughingman7743 mentioned this pull request Nov 9, 2025
2 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant