Default persisted-logs to vendor-specific object store#241
Open
mhotan wants to merge 2 commits intodocs/fluentbit-logging-permissionsfrom
Open
Default persisted-logs to vendor-specific object store#241mhotan wants to merge 2 commits intodocs/fluentbit-logging-permissionsfrom
mhotan wants to merge 2 commits intodocs/fluentbit-logging-permissionsfrom
Conversation
- Azure: Switch from AzureLogAnalytics to ObjectStore with azure_blob plugin. Fluentbit writes logs to Azure Blob Storage in the metadata container under the persisted-logs/ prefix. - GCP selfhosted: Add explicit GCPStackdriver config so GKE's built-in logging agent feeds Cloud Logging. Disable fluentbit DaemonSet since it's not needed. - Template: Make azure_blob auth conditional—only emit auth_type/shared_key when a storage account key is provided. AWS remains unchanged (already uses ObjectStore with S3). Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Azure uses AKS Container Insights to collect container logs to Azure Log Analytics natively. Disable the fluentbit DaemonSet since it's unnecessary — the AKS monitoring addon handles log collection. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
persistedLogs.sourceTypefromAzureLogAnalyticstoObjectStore. Fluentbit'sazure_blobplugin writes logs to Azure Blob Storage underpersisted-logs/prefix in the metadata container. Old AzureLogAnalytics config preserved as commented alternative.GCPStackdriverpersisted logs config with project ID. Disable fluentbit DaemonSet since GKE's built-in logging agent collects container logs to Cloud Logging automatically.azure_blobauth conditional —auth_typeandshared_keyonly rendered whenstorage.custom.stow.config.keyis set, allowing future managed identity support without config changes.Test plan
helm templatewithvalues.azure.yaml— verify fluentbit ConfigMap hasazure_bloboutput and config-overrides showssourceType: ObjectStorehelm templatewithvalues.gcp.selfhosted-intracluster.yaml— verify no fluentbit resources rendered and config-overrides showssourceType: GCPStackdriverhelm templatewithvalues.aws.yaml— verify S3 output plugin unchanged (no regression)🤖 Generated with Claude Code