Skip to content

feat: version 2: add dbt selectors, batching and local path#202

Merged
witash merged 28 commits intomainfrom
v2
Mar 28, 2025
Merged

feat: version 2: add dbt selectors, batching and local path#202
witash merged 28 commits intomainfrom
v2

Conversation

@witash
Copy link
Copy Markdown
Contributor

@witash witash commented Feb 19, 2025

This is ready for review
It wasn't really possible to separate the issues included, so I added one big PR instead of several small ones.

It contains

  • DBT_LOCAL_PATH for running developing dbt models locally
  • Adding dbt_batch_size to pass ot dbt for batching document_metadata
  • adding DBT_SELECTOR to allow dbt to select sets of models to run
  • added manifest to dataemon to separate updating models based on DBT_SELECTOR
  • added ways to set DBT_SELECTOR to k8s templates
  • changed from different docker compose files to profiles

@witash witash changed the title V2 feat: Version 2 Mar 4, 2025
@witash witash marked this pull request as ready for review March 4, 2025 12:50
@witash witash changed the title feat: Version 2 feat: version 2: add dbt selectors, batching and local path Mar 5, 2025
Copy link
Copy Markdown
Contributor

@jkuester jkuester left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Couple random comments here! Was just digging though this along with the cht-pipeline changes....

@witash witash requested review from jkuester and mrjones-plip March 17, 2025 13:09
Copy link
Copy Markdown
Contributor

@jkuester jkuester left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🍇

Looks like something went sideways with the e2e tests, but once that is sorted this should be good to go!

@witash witash merged commit 7efa2f1 into main Mar 28, 2025
7 checks passed
@witash witash deleted the v2 branch March 28, 2025 10:17
@medic-ci
Copy link
Copy Markdown

🎉 This PR is included in version 2.0.0 🎉

The release is available on GitHub release

Your semantic-release bot 📦🚀

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants