Problem Description
It is currently challenging to understand the state of what parquet features are available in what versions of what software implementations
This makes it hard to have confidence in what Parquet features can be used and yet still be read by the downstream ecosystem of interest. Thus it makes it hard to use newly added features in Parquet as it is not clear what systems will be unable to read them.
We do have https://parquet.apache.org/docs/file-format/implementationstatus/ but that does not include information about versions of parquet-format nor versions of the various implementations
Places it is mentioned:
Possible Solutions:
- Version the
parquet-format documentation more carefully (so we can refer to specific releases of parquet-format)
- Add version information to the implementation status page
Problem Description
It is currently challenging to understand the state of what parquet features are available in what versions of what software implementations
This makes it hard to have confidence in what Parquet features can be used and yet still be read by the downstream ecosystem of interest. Thus it makes it hard to use newly added features in Parquet as it is not clear what systems will be unable to read them.
We do have https://parquet.apache.org/docs/file-format/implementationstatus/ but that does not include information about versions of parquet-format nor versions of the various implementations
Places it is mentioned:
Possible Solutions:
parquet-formatdocumentation more carefully (so we can refer to specific releases of parquet-format)