-
Notifications
You must be signed in to change notification settings - Fork 40
Dataform
https://cloud.google.com/dataform
Dataform is a platform to manage data in BigQuery, Snowflake, Redshift, and other data warehouses. It helps data teams build data pipelines that turn raw data into new tables and views that can be used for analytics.
https://cloud.google.com/blog/products/data-analytics/welcoming-dataform-to-bigquery
Dataform does the T in ELT (Extract, Load, Transform) processes. It doesn’t extract or loads data in your warehouse but it’s very powerful to transform data already loaded in your warehouse.
https://cloud.google.com/dataform#section-2
https://cloud.google.com/dataform/docs/quickstart
https://medium.com/google-cloud/how-to-dataform-in-google-cloud-part-1-86bce30216fd
https://cuberoot31.com/building-data-pipelines-in-google-bigquery-with-dataform/