CHANGELOG.md

Changelog

All notable changes to this project will be documented in this file.

The format is based on Keep a Changelog and this project adheres to Semantic Versioning.

Unreleased

Added

• ...

Changed

• ...

Deprecated

• ...

Removed

• ...

Fixed

• ...

v0.5.0 - 2024-06-17

Added

• Basic support for patternProperties in GeoParquet creation
• The converter template accepts multiple input URLs
• Added parameter to explode multipolygons to polygons (explode_multipolygon, default: False)
• Converter for Belgium, Flanders (be_vlg)
• Converter for Belgium, Wallonia (be_wa)
• Converter for Finland (fi)
• Converter for France (fr)
• Converter for The Netherlands (nl and nl_crops)
• Converter for Slovenia via EuroCrops (ec_si)

Changed

• The --cache option for the convert command asks for a folder instead of a file
• The cache_file parameter in converters has been renamed to cache (requires changes in the converter templates)
• The converter template allows for more detailed source information
• The URI constant in the template was renamed to SOURCES (requires changes in the converter templates)

Fixed

• Extensions were not correctly displayed in describe and validate command
• Fixed regular expressions for email and uuid in data validation

v0.4.0 - 2024-05-10

Added

• Converter for France via EuroCrops (ec_fr)
• fiboa create-geojson: Show conversion progress
• fiboa jsonschema and fiboa validate: Support geometryTypes for geometry data type in GeoJSON
• fiboa validate:
  • Basic validation for objects, geometries and bounding boxes in GeoParquet files

Fixed

• fiboa validate-schema: The -m option is applied correctly if $schema is present in schema
• fiboa validate and fiboa validate-schema: Don't stop validation after the first file.
• fiboa validate:
  • Is more robust against invalid collections and doesn't abort if not needed
  • Check NULL values correctly in case of arrays
  • Throw an error if no files were provided
• fiboa create-geojson:
  • Handles GeoParquet bbox correctly
  • Converts numpy arrays
  • Doesn't export empty collections
• Fix recursive import

v0.3.10 - 2024-05-06

Added

• fiboa convert:
  • Added step that allows to set constant values (ADD_COLUMNS)
  • Support for reading GeoParquet files
  • Help lists all available converters
• fiboa converters: More detailed list of available converters/datasets

Changed

• fiboa convert:
  • determination_datetime is not required any longer
  • Default compression changed from brotli to zstd

v0.3.9 - 2024-05-01

Fixed

• JSON Schema and GeoJSON validation also errors when the data doesn't comply to the given formats

v0.3.8 - 2024-04-27

Added

• Converter for Thuringia, Germany (de_th)

Fixed

• Fixed GeoJSON to GeoParquet conversion of the date data type

v0.3.7 - 2024-04-25

Fixed

• Small fixes in CLI output and docs

v0.3.6 - 2024-04-24

Added

• fiboa describe: New parameters --column and --num

Changed

• fiboa create-geoparquet: Allow collection creation based on parameters and define clear priority of collection inputs

Fixed

• fiboa describe: Show all columns / don't hide data with ...
• fiboa validate: Warn more clearly if no schema is defined for a column

v0.3.5 - 2024-04-22

Added

• Converters: Allow to filter rows with pandas Series operations easily

Fixed

• Support converting to array data type

v0.3.4 - 2024-04-19

Added

• Validate GeoParquet metadata

Changed

• Load schemas for GeoParquet and STAC based on given version numbers

Fixed

• Fix missing license issue for AT converter

v0.3.3 - 2024-04-12

Changed

• Update converters for Germany to use the flik extension

Fixed

• Provide more details in data validation messages
• Fix issue with get_pyarrow_type_for_geopandas
• Fix missing schemas issue for AT converter

v0.3.2 - 2024-04-12

Added

• fiboa rename-extension to quickly replace template placeholders in new extensions

v0.3.1 - 2024-04-11

Added

• Support for enums and GeoParquet structs
• fiboa convert: Allow data of the GeoDataFrame or individual columns to be changed via custom functions

Fixed

• fiboa create-geoparquet: Handle column conversion more gracefully
• fiboa validate: Don't fail collection test if something unexpected happened
• fiboa create-geojson: Option -f doesn't need a value any longer
• fiboa convert: Fixed invalid method call

v0.3.0 - 2024-04-10

Added

• Command to validate the fiboa schemas (fiboa validate-schema)
• Command to create GeoJSON from GeoParquet (fiboa create-geojson)
• Converter for Austria (at)
• Converter for Berlin/Brandenburg, Germany (de_bb)
• Converter for Schleswig Holstein, Germany (de_sh)
• Converter for Lower Saxony, Germany (de_nds)

Changed

• Renamed fiboa create to fiboa create-geoparquet
• The --collection parameter is not needed anylonger if the collection can be read directly from the GeoJSON files (fiboa property or link with relation type collection)

Fixed

• Several minor improvements for the conversion process

v0.2.1 - 2024-04-02

Fixed

• Fixed the field boundary generation for de-nrw, which was pointing at the wrong dataset.

v0.2.0 - 2024-04-02

Added

• Converter framework (fiboa convert)
• Converter for North Rhine-Westphalia, Germany (de_nrw)

Fixed

• Validator for GeoParquet recognizes missing fields
• --json option for describe command doesn't throw error

v0.1.1 - 2024-03-27

• Add experimental data validation support for GroParquet files

v0.1.0 - 2024-03-27

• Add describe command to inspect fiboa GeoParquet files
• Add jsonschema command to create JSON Schema from fiboa schema
• Add validateion for GeoJSON

v0.0.9 - 2024-02-28

• Support string enums

v0.0.8 - 2024-02-28

• Fixed reading GeoJSON FeatureCollections

v0.0.7 - 2024-02-23

• Allow folders to be specified as input files #3

v0.0.6 - 2024-02-23

• Add -e option for create command to support extension schema mapping to local files

v0.0.5 - 2024-02-23

• Add -e option for validate command to support extension schema mapping to local files

v0.0.4 - 2024-02-23

• Adds missing dependencies

v0.0.3 - 2024-02-23

• Use extension schemas for conversion
• Correctly write the Parquet schema and columns - workaround for geopandas/geopandas#3182

v0.0.2 - 2024-02-16

• Basic validation for collection
• Minimal validation for data
• Fixed creation of GeoParquet files

v0.0.1 - 2024-02-16

• First release