Skip to content

Instrument Pendo Track Events#4

Open
lci-novus-dev[bot] wants to merge 1 commit intomainfrom
pendo-track-events-5fg8u
Open

Instrument Pendo Track Events#4
lci-novus-dev[bot] wants to merge 1 commit intomainfrom
pendo-track-events-5fg8u

Conversation

@lci-novus-dev
Copy link
Copy Markdown

@lci-novus-dev lci-novus-dev bot commented Mar 6, 2026

Summary

Adds Pendo Track Event instrumentation across both client-side and server-side code to capture key user interactions and system events in the PromptProof testing dashboard. Client-side events use pendo.track() for browser interactions, while server-side events use a new HTTP-based tracking utility that posts to the Pendo Track API.

Changes

  • Created src/utils/pendoTrack.ts — reusable server-side utility for sending events to the Pendo Track API via HTTP POST
  • Added test_suite_executed event in TestDashboard.tsx — fires when a user initiates a test suite run, capturing provider, model, and test count
  • Added model_configuration_changed event in TestDashboard.tsx — fires when the user changes the LLM provider or model selection
  • Added test_filter_applied event in TestFilters.tsx — fires when search, category, or difficulty filters are changed
  • Added test_suite_completed event in test-server.ts — fires after all test batches complete, with aggregate results (pass/fail counts, duration, average score)
  • Added test_suite_failed event in test-server.ts — fires when the entire test run fails due to a server error
  • Added individual_test_completed event in test-server.ts — fires when a single test case finishes evaluation successfully
  • Added individual_test_failed event in test-server.ts — fires when a single test case throws an execution error
  • Added test_authoring_loaded event in test-server.ts — fires when test files are discovered and loaded from the filesystem
  • Added metric_evaluation_completed event in evaluator/core.ts — fires after all metrics (semantic similarity, BLEU, ROUGE) are computed for a test case
  • Added llm_evaluation_completed event in evaluator/core.ts — fires after the LLM-as-judge evaluation step completes
  • Added rule_validation_completed event in evaluator/core.ts — fires after rule-based validation completes (when rules are configured)

Notes

  • Client-side events are guarded with typeof pendo !== 'undefined' checks to avoid errors if the Pendo agent is not loaded
  • Server-side events use fire-and-forget HTTP calls wrapped in try-catch to avoid breaking application flow
  • The Pendo integration key and data host are configured in the pendoTrack utility — update these if deploying to a different environment

Generated by Nova AI.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

0 participants