Skip to content

Sending traces for large workflows #184

@lukasmi93

Description

@lukasmi93

I wanted to bring to your attention an issue I reported earlier regarding the sending trace for large GitHub workflows, where tens of thousands of spans are created and not all are successfully sent to the designated endpoint. After further investigation, it turns out that the problem isn’t due to any GCP limitations. Instead, it appears to be related to the correct settings within the libraries.

To address this, I conducted some tests and modified the code of this GitHub action to better tune parameters such as maxQueueSize and maxExportBatchSize etc. for the OpenTelemetry sdk libraries. Based on my findings, I recommend that anyone experiencing similar issues should be able to adjust these parameters using environment variables.

To assist in addressing this issue, I created a sample pull request with some additional working and tested changes that could help in resolving this problem, please check PR.
Please note that this pull request was created for testing purposes only.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions