Playbook to push CK data file file into loki storage #332

myadla · 2026-01-23T15:52:44Z

Playbook "roles/telemetry_chargeback/tasks/ingest_loki_data.yml" takes up synthetic data file (json) from Cloudkitty and pushes it to loki server

Generate synthetic data and write results to a json file Push json file to log directory so that during debug file is available for review Controller/ci-framework-data/tests/feature-verification-tests Do not overwrite syth data json if it already exists Using Gemini and Cursor Closes https://issues.redhat.com/browse/OSPRH-23746

Update the synthetic data generation process to ensure that existing JSON files are not overwritten. This change allows for better debugging by preserving previous data outputs. Closes https://issues.redhat.com/browse/OSPRH-23746

ayefimov-1 · 2026-01-26T15:09:49Z

recheck with depends on set for PR #331 so that we can validate with the latest changes in my PR.

softwarefactory-project-zuul · 2026-01-26T15:10:01Z

Merge Failed.

This change or one of its cross-repo dependencies was unable to be automatically merged with the current state of its repository. Please rebase the change and upload a new patchset.
Warning:
Error merging github.com/infrawatch/feature-verification-tests for 332,09fd308902d434be445f9d2e953c1caf21b7c243

softwarefactory-project-zuul · 2026-01-26T15:10:28Z

Merge Failed.

This change or one of its cross-repo dependencies was unable to be automatically merged with the current state of its repository. Please rebase the change and upload a new patchset.
Warning:
Error merging github.com/infrawatch/feature-verification-tests for 332,d556ca0037d593e6df9544c3c04b13842882a4c8

Generate synthetic data and write results to a json file Push json file to log directory so that during debug file is available for review Controller/ci-framework-data/tests/feature-verification-tests Do not overwrite syth data json if it already exists Using Gemini and Cursor Closes https://issues.redhat.com/browse/OSPRH-23746 Update the synthetic data generation process to ensure that existing JSON files are not overwritten. This change allows for better debugging by preserving previous data outputs. Closes https://issues.redhat.com/browse/OSPRH-23746

…gest_loki

softwarefactory-project-zuul · 2026-01-27T23:26:10Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/a952612e61b743b097cfdefada704bf0

✔️ telemetry-openstack-meta-content-provider-master SUCCESS in 1h 59m 54s
✔️ functional-chargeback-tests-osp18 SUCCESS in 1h 25m 01s
❌ functional-tests-osp18 FAILURE in 1h 42m 08s

myadla · 2026-01-27T23:41:53Z

tempest tests failed.. recheck

myadla · 2026-01-27T23:42:22Z

recheck

roles/telemetry_chargeback/tasks/ingest_loki_data.yml

roles/telemetry_chargeback/defaults/main.yml

roles/telemetry_chargeback/tasks/ingest_loki_data.yml

roles/telemetry_chargeback/defaults/main.yml

roles/telemetry_chargeback/tasks/chargeback_tests.yml

Generate synthetic data and write results to a json file Push json file to log directory so that during debug file is available for review Controller/ci-framework-data/tests/feature-verification-tests Do not overwrite syth data json if it already exists Using Gemini and Cursor Closes https://issues.redhat.com/browse/OSPRH-23746 Update the synthetic data generation process to ensure that existing JSON files are not overwritten. This change allows for better debugging by preserving previous data outputs. Closes https://issues.redhat.com/browse/OSPRH-23746

…gest_loki

vyzigold

I started to review. This quite confusing to review. I see this includes content from #331 and also it seems there are duplicated files inside this PR (see my other comment, the files roles/telemetry_chargeback/files/loki_data_templ.j2 and roles/telemetry_chageback/template/loki_data_templ.j2 is another example).

So it seems to me like this is still very much in progress. I can continue a review after some cleanup.

roles/telemetry_chargeback/defaults/main.yml

Generate synthetic data and write results to a json file Push json file to log directory so that during debug file is available for review Controller/ci-framework-data/tests/feature-verification-tests Do not overwrite syth data json if it already exists Using Gemini and Cursor Closes https://issues.redhat.com/browse/OSPRH-23746 Update the synthetic data generation process to ensure that existing JSON files are not overwritten. This change allows for better debugging by preserving previous data outputs. Closes https://issues.redhat.com/browse/OSPRH-23746

…gest_loki

softwarefactory-project-zuul · 2026-01-29T18:57:00Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/3117a6b15d3f421d8bfd47fa5f2686ed

❌ telemetry-openstack-meta-content-provider-master FAILURE in 8m 20s
⚠️ functional-chargeback-tests-osp18 SKIPPED Skipped due to failed job telemetry-openstack-meta-content-provider-master
⚠️ functional-tests-osp18 SKIPPED Skipped due to failed job telemetry-openstack-meta-content-provider-master

roles/telemetry_chargeback/tasks/ingest_loki_data.yml

myadla · 2026-01-29T19:50:32Z

PR#331 is merged now.. I have resolved all conflicts now

myadla · 2026-01-29T19:50:36Z

recheck

softwarefactory-project-zuul · 2026-01-29T19:53:57Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/7e21966dfd684648a1f2887abf8e529a

❌ telemetry-openstack-meta-content-provider-master FAILURE in 7m 19s
⚠️ functional-chargeback-tests-osp18 SKIPPED Skipped due to failed job telemetry-openstack-meta-content-provider-master
⚠️ functional-tests-osp18 SKIPPED Skipped due to failed job telemetry-openstack-meta-content-provider-master

myadla · 2026-01-29T19:54:41Z

recheck

softwarefactory-project-zuul · 2026-01-29T20:03:29Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/0261ea1a92614640b6686abe130272d3

❌ telemetry-openstack-meta-content-provider-master FAILURE in 7m 35s
⚠️ functional-chargeback-tests-osp18 SKIPPED Skipped due to failed job telemetry-openstack-meta-content-provider-master
⚠️ functional-tests-osp18 SKIPPED Skipped due to failed job telemetry-openstack-meta-content-provider-master

myadla · 2026-01-29T22:33:48Z

recheck

myadla · 2026-01-29T23:54:19Z

recheck

softwarefactory-project-zuul · 2026-01-30T00:04:35Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/2b765787c5484f9c93f18d81ae0c803d

❌ telemetry-openstack-meta-content-provider-master FAILURE in 9m 04s
⚠️ functional-chargeback-tests-osp18 SKIPPED Skipped due to failed job telemetry-openstack-meta-content-provider-master
⚠️ functional-tests-osp18 SKIPPED Skipped due to failed job telemetry-openstack-meta-content-provider-master

myadla · 2026-01-30T15:24:54Z

recheck

ayefimov-1

Checked the new tests and the results. Everything seems to be working correct. Nice job.

roles/telemetry_chargeback/defaults/main.yml

roles/telemetry_chargeback/tasks/chargeback_tests.yml

softwarefactory-project-zuul · 2026-02-02T20:36:05Z

Merge Failed.

This change or one of its cross-repo dependencies was unable to be automatically merged with the current state of its repository. Please rebase the change and upload a new patchset.
Warning:
Error merging github.com/infrawatch/feature-verification-tests for 332,68751caf74149aca9ae9c77a9b5a96f1339e3289

myadla · 2026-02-02T20:58:07Z

So many conflicts in this PR and I have added 1 more file to retreive data from loki. Please look at #334

myadla and others added 3 commits January 14, 2026 17:09

Create a playbook that pushes CK data file to loki storage

09fd308

myadla force-pushed the myadla_ingest_loki branch from cc5d1f1 to 09fd308 Compare January 23, 2026 19:55

myadla marked this pull request as ready for review January 23, 2026 22:45

myadla requested review from ayefimov-1 and elfiesmelfie January 23, 2026 22:46

myadla added 2 commits January 27, 2026 12:57

Merge remote-tracking branch 'origin/alexy_synth_data' into myadla_in…

18827d0

…gest_loki

myadla force-pushed the myadla_ingest_loki branch from d556ca0 to 18827d0 Compare January 27, 2026 21:25

ayefimov-1 requested changes Jan 28, 2026

View reviewed changes

elfiesmelfie requested changes Jan 28, 2026

View reviewed changes

roles/telemetry_chargeback/defaults/main.yml Outdated Show resolved Hide resolved

roles/telemetry_chargeback/tasks/chargeback_tests.yml Outdated Show resolved Hide resolved

myadla added 2 commits January 28, 2026 17:28

Merge remote-tracking branch 'origin/alexy_synth_data' into myadla_in…

0db4f42

…gest_loki

vyzigold requested changes Jan 29, 2026

View reviewed changes

roles/telemetry_chargeback/defaults/main.yml Show resolved Hide resolved

myadla added 2 commits January 29, 2026 09:06

Merge remote-tracking branch 'origin/alexy_synth_data' into myadla_in…

8a22a17

…gest_loki

myadla mentioned this pull request Jan 29, 2026

Add synthetic data generation test to the telemetry_chargeback role #331

Merged

ayefimov-1 self-requested a review January 29, 2026 18:17

vyzigold reviewed Jan 29, 2026

View reviewed changes

roles/telemetry_chargeback/tasks/ingest_loki_data.yml Show resolved Hide resolved

ayefimov-1 approved these changes Jan 30, 2026

View reviewed changes

roles/telemetry_chargeback/defaults/main.yml Show resolved Hide resolved

roles/telemetry_chargeback/defaults/main.yml Outdated Show resolved Hide resolved

roles/telemetry_chargeback/tasks/chargeback_tests.yml Outdated Show resolved Hide resolved

Added 2 playbooks to push and retreive ck data to/from loki

68751ca

myadla force-pushed the myadla_ingest_loki branch from e7202ed to 68751ca Compare February 2, 2026 20:35

myadla marked this pull request as draft February 2, 2026 20:36

Playbook to push CK data file file into loki storage #332

Are you sure you want to change the base?

Playbook to push CK data file file into loki storage #332

Uh oh!

Conversation

myadla commented Jan 23, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

ayefimov-1 commented Jan 26, 2026

Uh oh!

softwarefactory-project-zuul bot commented Jan 26, 2026

Uh oh!

softwarefactory-project-zuul bot commented Jan 26, 2026

Uh oh!

softwarefactory-project-zuul bot commented Jan 27, 2026

Uh oh!

myadla commented Jan 27, 2026

Uh oh!

myadla commented Jan 27, 2026

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

vyzigold left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

softwarefactory-project-zuul bot commented Jan 29, 2026

Uh oh!

Uh oh!

myadla commented Jan 29, 2026

Uh oh!

myadla commented Jan 29, 2026

Uh oh!

softwarefactory-project-zuul bot commented Jan 29, 2026

Uh oh!

myadla commented Jan 29, 2026

Uh oh!

softwarefactory-project-zuul bot commented Jan 29, 2026

Uh oh!

myadla commented Jan 29, 2026

Uh oh!

myadla commented Jan 29, 2026

Uh oh!

softwarefactory-project-zuul bot commented Jan 30, 2026

Uh oh!

myadla commented Jan 30, 2026

Uh oh!

ayefimov-1 left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

softwarefactory-project-zuul bot commented Feb 2, 2026

Uh oh!

myadla commented Feb 2, 2026

Uh oh!

Reviewers

Assignees

Labels

Milestone

Development

Uh oh!

5 participants

myadla commented Jan 23, 2026 •

edited

Loading