Skip to content

NeMo Agent Toolkit telemetry exporter for ClawMetry #234

@vivekchand

Description

@vivekchand

Context

NVIDIA's NeMo Agent Toolkit (which NemoClaw builds on) has a plugin-based observability system supporting Phoenix, Langfuse, W&B Weave, Datadog, and others. Building a ClawMetry exporter would let NemoClaw users send observability data directly to ClawMetry cloud without needing the sync daemon.

Opportunity

The NeMo Agent Toolkit uses an event-driven architecture with IntermediateStepManager publishing workflow events to a reactive stream. Custom telemetry exporters can be built as plugins.

Existing exporters include: Phoenix, Langfuse, W&B Weave, Catalyst, Dynatrace, Galileo, LangSmith, OpenTelemetry Collector.

ClawMetry should be on this list.

Implementation

Exporter Plugin

  • Create clawmetry-nat Python package (NeMo Agent Toolkit exporter)
  • Implement ClawMetryExporter class following NAT exporter interface
  • Map NAT workflow events to ClawMetry brain event format
  • Support both logging and tracing
  • E2E encrypt payloads before sending to ingest.clawmetry.com
  • Handle batching and retry (reuse patterns from sync.py)

Configuration

general:
  telemetry:
    tracing:
      clawmetry:
        _type: clawmetry
        api_key: cm_xxx
        node_id: my-agent
        encryption_key: my-secret-key

Integration

  • Register as NAT telemetry plugin
  • Publish to PyPI as clawmetry-nat
  • Submit PR to NeMo Agent Toolkit for official listing
  • Add to ClawMetry docs

Dashboard Support

  • Accept NAT event format on ingest API (or transform server-side)
  • Show NAT workflow traces in brain activity view
  • Display NeMo-specific metrics (guardrail triggers, model routing decisions)

Estimated Effort

  • Basic exporter: 2-3 days
  • Dashboard integration: 1-2 days
  • NAT upstream PR: 1 day

References

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions