Skip to content

Fix flyte-to-union prefix and add singleTenantOrgID to selfhosted DP#269

Merged
mhotan merged 7 commits intomainfrom
mike/fix-crs-rbac-and-proxy-configmap
Mar 4, 2026
Merged

Fix flyte-to-union prefix and add singleTenantOrgID to selfhosted DP#269
mhotan merged 7 commits intomainfrom
mike/fix-crs-rbac-and-proxy-configmap

Conversation

@mhotan
Copy link
Contributor

@mhotan mhotan commented Mar 4, 2026

Summary

  • Fixes flyte- to union- prefix in CRS ClusterRoleBinding (was referencing wrong ServiceAccount)
  • Adds singleTenantOrgID to selfhosted dataplane values for single-tenant deployments
  • Fixes proxy configmap to use correct service name prefix

Test plan

  • make helm-test passes (golden files regenerated)
  • Verify CRS ClusterRoleBinding references correct union- prefixed ServiceAccount
  • Verify proxy configmap uses correct service names

Rollout Plan

Bug fix — corrects misconfigured RBAC and proxy references. Safe to roll out immediately.

Rollback Plan

Revert this commit.


@mhotan mhotan force-pushed the mike/fix-crs-rbac-and-proxy-configmap branch from c280b5f to 404a2d4 Compare March 4, 2026 03:33
@mhotan mhotan changed the title Fix flyte- to union- prefix in CRS ClusterRoleBinding and proxy configmap Fix flyte-to-union prefix and add singleTenantOrgID to selfhosted DP Mar 4, 2026
@mhotan mhotan force-pushed the mike/fix-crs-rbac-and-proxy-configmap branch 3 times, most recently from a5d2b1e to 5bc7b0d Compare March 4, 2026 07:11
maxOpenConnections: 20
connMaxLifeTime: 120s
configmap:
# --- Namespace Mapping ---
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: does this maybe belong in the previous PR #226

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah confirmed it should be apart of that PR.

@mhotan mhotan force-pushed the mike/fix-crs-rbac-and-proxy-configmap branch from 5bc7b0d to d0b5db6 Compare March 4, 2026 16:26
@mhotan mhotan force-pushed the mike/run-102-consolidate-namespace-mapping branch from 6a83889 to 49a8b5b Compare March 4, 2026 16:26
mhotan and others added 4 commits March 4, 2026 08:28
The top-level `namespace_mapping` in values.yaml was dead config (no
template referenced `.Values.namespace_mapping`). Wire it as the
canonical source of truth that cascades to all dataplane services when
explicitly set:

- clusterresourcesync: falls back to `.Values.namespace_mapping` when
  `.Values.config.namespace_mapping` is not set
- nodeexecutor: auto-injects root-level `namespace_mapping` from the
  top-level value when `executor.raw_config.namespace_mapping` is not set
- propeller: falls back to top-level value when `config.namespace_config`
  is not set
- operator: falls back to top-level value for `org.namespaceTemplate`
  when `config.operator.org` is not set

Default remains empty (no template). Per-service overrides still take
precedence for backward compatibility.

towards RUN-102

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Add `namespace_mapping.template` to aws and fully-selfhosted test values
to verify the canonical value cascades correctly to all service configmaps
(clusterresourcesync, executor, propeller, operator).

Azure test values already set per-service overrides (`config.namespace_config`,
`config.operator.org`), which confirms backward compat (overrides take
precedence over the top-level value).

towards RUN-102

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
# cascades to propeller, clusterresourcesync, operator, and executor.
# For consistent namespace resolution, this MUST match the dataplane config.
#
# How it works:
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We probably don't need How it works sections

@mhotan mhotan force-pushed the mike/run-102-consolidate-namespace-mapping branch from 49a8b5b to c3b5c7d Compare March 4, 2026 16:36
@mhotan mhotan force-pushed the mike/fix-crs-rbac-and-proxy-configmap branch from d0b5db6 to 1c8ab57 Compare March 4, 2026 16:36
mhotan and others added 3 commits March 4, 2026 08:37
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Three fixes for selfhosted dataplane deployments:

1. ClusterRoleBinding `union-clustersync-resource` referenced ClusterRole
   `clustersync-resource` instead of `union-clustersync-resource`, causing
   all CRS namespace creation to fail with RBAC errors. Introduced in #260.

2. operator-proxy deployment referenced ConfigMap
   `flyte-clusterresourcesync-config` instead of
   `union-clusterresourcesync-config`, leaving the proxy stuck in
   ContainerCreating.

3. Add singleTenantOrgID to AWS and GCP selfhosted-intracluster dataplane
   values. Without this, the DP operator-proxy identity interceptor rejects
   internal requests from the CP dataproxy (401 on CreateUploadLocation).
   The CP already sets this — the DP was missing it.

NOTE: Existing deployments will need the old ClusterRoleBinding deleted
before ArgoCD can recreate it, since roleRef is immutable:
  kubectl delete clusterrolebinding union-clustersync-resource

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
@mhotan mhotan force-pushed the mike/fix-crs-rbac-and-proxy-configmap branch from 1c8ab57 to c49e3af Compare March 4, 2026 16:43
@mhotan
Copy link
Contributor Author

mhotan commented Mar 4, 2026

/aviator merge

@aviator-app
Copy link
Contributor

aviator-app bot commented Mar 4, 2026

Aviator has accepted the merge request. It will enter the queue when all of the required status checks have passed. Aviator will update the sticky status comment as the pull request moves through the queue.

@aviator-app
Copy link
Contributor

aviator-app bot commented Mar 4, 2026

The base branch (mike/run-102-consolidate-namespace-mapping) of this pull request is not configured as a base branch. Please edit the base branch of this PR if you wish to merge using Aviator.

Base automatically changed from mike/run-102-consolidate-namespace-mapping to main March 4, 2026 16:44
@aviator-app
Copy link
Contributor

aviator-app bot commented Mar 4, 2026

Current Aviator status

Aviator will automatically update this comment as the status of the PR changes.
Comment /aviator refresh to force Aviator to re-examine your PR (or learn about other /aviator commands).

This PR was merged manually (without Aviator). Merging manually can negatively impact the performance of the queue. Consider using Aviator next time.


See the real-time status of this PR on the Aviator webapp.
Use the Aviator Chrome Extension to see the status of your PR within GitHub.

@mhotan mhotan merged commit 7907c86 into main Mar 4, 2026
8 checks passed
@mhotan mhotan deleted the mike/fix-crs-rbac-and-proxy-configmap branch March 4, 2026 16:45
@mhotan mhotan mentioned this pull request Mar 4, 2026
1 task
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants