Skip to content

Parquet 1.15.2 v2#4

Closed
ostinru wants to merge 6 commits intomainfrom
parquet-1.15.2-v2
Closed

Parquet 1.15.2 v2#4
ostinru wants to merge 6 commits intomainfrom
parquet-1.15.2-v2

Conversation

@ostinru
Copy link

@ostinru ostinru commented Feb 12, 2026

Apache Parquet

Major Parquet changes 1.12.x -> 1.15.x

  • Support LZ4_RAW codec
  • Implement vectored IO in parquet file format
  • More optimal memory usage in compression codecs

Overall Parquet compression support[1]:

  • ✅ uncompressed
  • ✅ snappy
  • ✅ zstd
  • ✅ gzip
  • 🛑 lz4 -> PXF server error : native lz4 library not available
  • ✅ lz4_raw - NEW!
  • 🛑 lzo - WONTFIX - no updates for this java dependency for 7 years[3][2]
  • 🛑 brotli - WONTFIX - not in maven central[2] and no user request

[1] https://github.com/apache/parquet-format/blob/apache-parquet-format-2.12.0/src/main/thrift/parquet.thrift#L633-L651
[2] https://www.jeronimo.dev/compression-algorithms-parquet/
[3] https://mvnrepository.com/artifact/org.anarres.lzo/lzo-hadoop

@ostinru ostinru closed this Feb 26, 2026
@ostinru ostinru deleted the parquet-1.15.2-v2 branch February 26, 2026 12:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant