Skip to content

Releases: Flowminder/FlowKit

1.34.0

15 Oct 11:59
@greenape greenape
1.34.0
be57c45

Choose a tag to compare

View all tags
1.34.0 Latest
Latest

Added

Added Google auth to flowetl.

What's Changed

  • Bump cachetools from 6.0.0 to 6.1.0 in /flowmachine by @dependabot[bot] in #7059
  • Bump brace-expansion from 1.1.11 to 1.1.12 in /flowauth/frontend by @dependabot[bot] in #7060
  • Bump jest from 29.7.0 to 30.0.0 in /flowauth/frontend by @dependabot[bot] in #7051
  • Bump pytest from 8.4.0 to 8.4.1 in /flowmachine by @dependabot[bot] in #7062
  • Bump networkx from 3.4.2 to 3.5 in /flowmachine by @dependabot[bot] in #7054
  • Bump pyzmq from 26.4.0 to 27.0.0 in /flowmachine by @dependabot[bot] in #7058
  • Bump pytest-asyncio from 0.26.0 to 1.0.0 in /flowmachine by @dependabot[bot] in #7056
  • Bump numpy from 2.2.6 to 2.3.0 in /flowmachine by @dependabot[bot] in #7057
  • Bump pytest-cov from 6.1.1 to 6.2.1 in /flowmachine by @dependabot[bot] in #7055
  • Bump requests from 2.32.3 to 2.32.4 in /flowmachine by @dependabot[bot] in #7052
  • Bump jest from 30.0.0 to 30.0.2 in /flowauth/frontend by @dependabot[bot] in #7066
  • Bump approvaltests from 14.5.0 to 14.7.1 in /flowmachine by @dependabot[bot] in #7068
  • Bump numpy from 2.3.0 to 2.3.1 in /flowmachine by @dependabot[bot] in #7070
  • Bump pbkdf2 from 3.1.1 to 3.1.3 in /flowauth/frontend by @dependabot[bot] in #7071
  • Bump prettier from 3.5.2 to 3.6.0 in /flowauth/frontend by @dependabot[bot] in #7069
  • Bump jest from 30.0.2 to 30.0.3 in /flowauth/frontend by @dependabot[bot] in #7072
  • Bump prettier from 3.6.0 to 3.6.1 in /flowauth/frontend by @dependabot[bot] in #7073
  • Bump prettier from 3.6.1 to 3.6.2 in /flowauth/frontend by @dependabot[bot] in #7075
  • Bump ipython from 9.3.0 to 9.4.0 in /flowmachine by @dependabot[bot] in #7078
  • Bump jest from 30.0.3 to 30.0.4 in /flowauth/frontend by @dependabot[bot] in #7079
  • Bump pandas from 2.3.0 to 2.3.1 in /flowmachine by @dependabot[bot] in #7080
  • Bump python-rapidjson from 1.20 to 1.21 in /flowmachine by @dependabot[bot] in #7082
  • Bump approvaltests from 14.7.1 to 15.0.0 in /flowmachine by @dependabot[bot] in #7083
  • Bump pytest-asyncio from 1.0.0 to 1.1.0 in /flowmachine by @dependabot[bot] in #7085
  • Bump on-headers and compression in /flowauth/frontend by @dependabot[bot] in #7086
  • Bump pyarrow from 19.0.1 to 21.0.0 in /flowdb/testdata/synthetic_data by @dependabot[bot] in #7087
  • Bump form-data in /flowauth/frontend by @dependabot[bot] in #7089
  • Bump ipykernel from 6.29.5 to 6.30.0 in /flowmachine by @dependabot[bot] in #7090
  • Bump numpy from 2.3.1 to 2.3.2 in /flowmachine by @dependabot[bot] in #7092
  • Bump sqlalchemy from 2.0.39 to 2.0.42 in /flowdb/testdata/synthetic_data by @dependabot[bot] in #7097
  • Bump pandas from 2.2.3 to 2.3.1 in /flowdb/testdata/synthetic_data by @dependabot[bot] in #7081
  • Bump pyzmq from 27.0.0 to 27.0.1 in /flowmachine by @dependabot[bot] in #7099
  • Bump sqlalchemy from 2.0.41 to 2.0.42 in /flowmachine by @dependabot[bot] in #7098
  • Bump ipykernel from 6.30.0 to 6.30.1 in /flowmachine by @dependabot[bot] in #7101
  • Bump redis from 6.2.0 to 6.3.0 in /flowmachine by @dependabot[bot] in #7102
  • Bump tmp from 0.2.3 to 0.2.4 in /flowauth/frontend by @dependabot[bot] in #7103
  • Bump jest from 30.0.4 to 30.0.5 in /flowauth/frontend by @dependabot[bot] in #7091
  • Bump redis from 6.3.0 to 6.4.0 in /flowmachine by @dependabot[bot] in #7105
  • Bump sqlalchemy from 2.0.42 to 2.0.43 in /flowmachine by @dependabot[bot] in #7107
  • Bump approvaltests from 15.0.0 to 15.1.0 in /flowmachine by @dependabot[bot] in #7106
  • Bump approvaltests from 15.1.0 to 15.1.1 in /flowmachine by @dependabot[bot] in #7110
  • Bump actions/checkout from 4 to 5 by @dependabot[bot] in #7111
  • Bump sha.js from 2.4.11 to 2.4.12 in /flowauth/frontend by @dependabot[bot] in #7114
  • Bump cipher-base from 1.0.4 to 1.0.6 in /flowauth/frontend by @dependabot[bot] in #7115
  • Bump pyzmq from 27.0.1 to 27.0.2 in /flowmachine by @dependabot[bot] in #7116
  • Bump approvaltests from 15.1.1 to 15.2.1 in /flowmachine by @dependabot[bot] in #7112
  • Bump pandas from 2.3.1 to 2.3.2 in /flowmachine by @dependabot[bot] in #7117
  • Bump jest from 30.0.5 to 30.1.1 in /flowauth/frontend by @dependabot[bot] in #7120
  • Bump ipython from 9.4.0 to 9.5.0 in /flowmachine by @dependabot[bot] in #7122
  • Bump cachetools from 6.1.0 to 6.2.0 in /flowmachine by @dependabot[bot] in #7119
  • Bump jest from 30.1.1 to 30.1.3 in /flowauth/frontend by @dependabot[bot] in #7125
  • Bump pyzmq from 27.0.2 to 27.1.0 in /flowmachine by @dependabot[bot] in #7129
  • Bump pytest-cov from 6.2.1 to 6.3.0 in /flowmachine by @dependabot[bot] in #7128
  • Bump pytest-cov from 6.3.0 to 7.0.0 in /flowmachine by @dependabot[bot] in #7131
  • Bump approvaltests from 15.2.1 to 15.3.2 in /flowmachine by @dependabot[bot] in #7124
  • Bump pytest-asyncio from 1.1.0 to 1.2.0 in /flowmachine by @dependabot[bot] in #7134
  • Bump numpy from 2.3.2 to 2.3.3 in /flowmachine by @dependabot[bot] in #7132
  • Bump pyyaml from 6.0.2 to 6.0.3 in /flowmachine by @dependabot[bot] in #7141
  • Bump jest from 30.1.3 to 30.2.0 in /flowauth/frontend by @dependabot[bot] in #7143
  • Switch to bitnamilegacy for redis image by @greenape in #7148
  • Bump pandas from 2.3.2 to 2.3.3 in /flowmachine by @dependabot[bot] in #7146
  • Bump ipython from 9.5.0 to 9.6.0 in /flowmachine by @dependabot[bot] in #7145
  • Bump shapely from 2.1.1 to 2.1.2 in /flowmachine by @dependabot[bot] in #7140
  • Automatically re-run the slightly flakey frontend tests by @greenape in #7149
  • Bump pandas from 2.3.1 to 2.3.3 in /flowdb/testdata/synthetic_data by @dependabot[bot] in #7144
  • Bump black from 24.4.2 to 25.9.0 in /flowdb/testdata/synthetic_data by @dependabot[bot] in #7136
  • Bump sqlalchemy from 2.0.42 to 2.0.43 in /flowdb/testdata/synthetic_data by @dependabot[bot] in #7108
  • Bump structlog from 25.2.0 to 25.4.0 in /flowdb/testdata/synthetic_data by @dependabot[bot] in #7046
  • Bump psycopg2-binary from 2.9.10 to 2.9.11 in /flowmachine by @dependabot[bot] in #7154
  • Bump cachetools from 6.2.0 to 6.2.1 in /flowmachine by @dependabot[bot] in #7155
  • Bump sqlalchemy from 2.0.43 to 2.0.44 in /flowmachine by @dependabot[bot] in #7156
  • Bump github/codeql-action from 3 to 4 by @dependabot[bot] in #7157
  • Add authlib and custom webserver config to allow using google auth in flowetl by @greenape in #7159

Full Changelog: 1.33.1...1.34.0

Contributors

greenape and dependabot
Assets 2
Loading

1.33.1

14 Jul 12:20
@greenape greenape
1.33.1
e0ad77e

Choose a tag to compare

View all tags
1.33.1

Fixed

  • FlowDB cache_score function no longer throws a divide-by-zero error for empty cache tables. #7027
Loading

1.33.0

14 Jul 12:20
@greenape greenape
1.33.0
a77dbe5

Choose a tag to compare

View all tags
1.33.0

Changed

  • Flowmachine's cache cleanup service is now a separate docker container from the main server. #5911

Warning

You will need to update your FlowKit deployment to include an additional flowmachine container which sets the command to "cache-cleanup".

Removed

  • FlowETL has been updated to Airflow 2.10.5, airflow.providers.postgres.operators.postgres.PostgresOperator is deprecated in favour of airflow.providers.common.sql.operators.sql.SQLExecuteQueryOperator.
Loading

1.32.0

31 Jan 16:56
@jc-harrison jc-harrison
1.32.0
4c06510
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

Choose a tag to compare

View all tags
1.32.0

Changed

  • Modified FlowETL count_duplicates and count_duplicated QA check queries to improve performance, without changing the results. #6935
  • Columns msisdn, msisdn_counterpart, imsi and imei in the FlowDB events/interactions tables now use "C" collation. This change requires reindexing affected columns. #6941

What's Changed

Full Changelog: 1.31.0...1.32.0

Contributors

jc-harrison, mergify, and dependabot
Loading

1.31.0

31 Jan 15:56
@jc-harrison jc-harrison
1.31.0
8b3faad

Choose a tag to compare

View all tags
1.31.0

Changed

  • Mode is now available for use with categorical metrics when running joined spatial aggregates via api. #2021
  • Flowmachine now includes the version number in query ids which means cache entries are per-version. #4489

Fixed

  • Fixed dangling async tasks not being properly cancelled during server shutdown #6833
Loading

1.30.0

16 Oct 10:34
@greenape greenape
1.30.0
bf23323

Choose a tag to compare

View all tags
1.30.0

Changed

  • FlowMachine now requires python >= 3.11

Fixed

  • Direction enum not being recognised #6787

Removed

  • Removed Oracle fdw

What's Changed

Full Changelog: 1.29.0...1.30.0

Contributors

greenape and dependabot
Loading

1.29.0

15 Aug 15:14
@greenape greenape
1.29.0
3e98904

Choose a tag to compare

View all tags
1.29.0

Added

  • New flowmachine query CalendarActivity, which retrives subscribers pattern of active days
  • New flowmachine queries PerValueAggregate and RedactedPerValueAggregate, which group by the value column of another query and apply an aggregate to subscribers with that grouping.
  • New flowapi queries and flowclient functions for calendar_activity and localised_calendar_activity, which return counts of subscribers per sequence of active days, and per sequence of active days additionally grouped by the subscribers reference location
  • Added new StringStatistic enum, which enumerates valid statistics for use with postgres string types

Changed

  • HistogramAggregation has moved to flowmachine.features.nonspatial_aggregates
  • Statistic moved to flowmachine.core.statistic_types
  • TotalActivePeriodsSubscriber no longer returns an extra inactive_periods column

What's Changed

Full Changelog: 1.28.1...1.29.0

Contributors

greenape, jc-harrison, and dependabot
Loading

1.28.1

05 Jul 10:57
@greenape greenape
1.28.1
5dc1c47

Choose a tag to compare

View all tags
1.28.1

Fixed

  • Fixed 500 error when getting api spec from FlowAPI #6686

What's Changed

Full Changelog: 1.28.0...1.28.1

Contributors

greenape
Loading

1.28.0

04 Jul 15:34
@Thingus Thingus
1.28.0
24e0cb5
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

Choose a tag to compare

View all tags
1.28.0

Added

  • Added support for Parquet foreign tables using parquet_fdw

Changed

  • FlowKit test and synthetic data now uses parquet foreign tables.

Warning

The location of the parquet files in the container is /parquet_data, if you are testing with larger amounts of data you may wish to add an additional bind mount for this location.

Warning

This change is not backwards compatible with earlier releases of FlowDB, and you will need to repopulate your deployment. We recommend combining this change with the new parquet support.

  • FlowETL is now built on Airflow 2.9.2

Fixed

Removed

What's Changed

Full Changelog: 1.27.0...1.28.0

Contributors

greenape, Thingus, and dependabot
Loading

1.27.0

17 Jun 08:03
@Thingus Thingus
1.27.0
c7ef0a9
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

Choose a tag to compare

View all tags
1.27.0

Changelog

All notable changes to FlowKit will be documented in this file.

The format is based on Keep a Changelog.

1.27.0

Added

  • Added FlowDB table infrastructure.invalid_cell_info for recording cell information that could not be included in infrastructure.cell_info (including cells with null or duplicate cell IDs). #6626
  • The file name of FlowDB's automatically generated at init config file can now be specified by setting the AUTO_CONFIG_FILE_NAME environment variable. By default this is postgresql.configurator.conf.

Changed

  • FlowDB now triggers an ANALYZE on newly created cache tables to generate statistics rather than waiting for autovacuum
  • FlowDB now produces JSON formatted logs by default. Set FLOWDB_LOG_DEST=csvlog for the old default behaviour.
  • The logging destination of FlowDB can now be configured at init by setting the FLOWDB_LOG_DEST environment variable, valid options are stderr, csvlog, and jsonlog.
  • The location inside the container of FlowDB's automatically generated config file has changed to /flowdb_autoconf/$AUTO_CONFIG_FILE_NAME.

What's Changed

Full Changelog: 1.26.0...1.27.0

Contributors

greenape, jc-harrison, and dependabot
Loading