feat(evidence): add NIM support to evidence collection and restructure conformance docs#479
Merged
mchmarny merged 1 commit intoNVIDIA:mainfrom Apr 2, 2026
Conversation
…formance docs Add NIM Operator and NIM inference metrics paths to evidence collection, and update all conformance documentation to reflect NIM on EKS as the certified product. Evidence collection: - Add collect_service_metrics_nim() for NIM /v1/metrics endpoint - Add collect_operator_nim() for NIM Operator CRDs/webhooks/reconciliation - Detection priority: Dynamo > NIM Operator > Kubeflow Trainer Documentation: - Update PRODUCT.yaml platform to "NVIDIA NIM on EKS" - Update submission README and evidence index for NIM - Refresh all 9 evidence files with NIM-based conformance results (9/9 PASS)
2e5e120 to
54fb0ac
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
v1.35/nim-eks/(mirrors CNCF submission repo)Changes
Evidence collection (
pkg/evidence/scripts/collect-evidence.sh):collect_service_metrics_nim()— creates ServiceMonitor, sends inference requests, waits for Prometheus to scrape withhealth: up, captures metrics from both NIM/v1/metricsendpoint and Prometheus queriescollect_operator_nim()— validates NIM Operator deployment, CRDs (apps.nvidia.com), webhooks (namespace-based lookup), NIMService reconciliation, webhook rejection testDocumentation restructure:
evidence/+submission/tov1.35/nim-eks/structure (mirrorscncf/k8s-ai-conformance/v1.35/<product>/)v1.35/nim-gke/,v1.36/nim-eks/)PRODUCT.yaml updates:
platformName: "NVIDIA NIM on EKS"websiteUrl:developer.nvidia.com/nimrepoUrl:github.com/NVIDIA/k8s-nim-operatordocumentationUrl: NIM Helm deploy docsai_service_metricsandrobust_controllerrequirementsTest plan
health: upvia ServiceMonitorevidence/orsubmission/pathsDepends on #478