Initial Update to Provide to use Metrics and Logging allowing initial Dashboard Creation

[pooleycodes]

Metrics to add to platfom:

• Failed call to platform API
• Failed call to datasette
• Check Submission URL metrics of progress through the system

[pooleycodes]

Sentry improvements

Packages

• @sentry/node + @sentry/profiling-node upgraded to v10.47.0

Sentry init (sentry.js)

• Moved Sentry.init() to module top-level + added --import to all start scripts in package.json (ESM instrumentation requirement)
• Added enableLogs: true
• Added beforeSend to suppress async_handled_processing_error tagged events from becoming issues

Winston transport (logger.js)

• Added SentryTransport forwarding warn/error logs to Sentry log ingestion

URL submission metrics (submitUrlController.js)

Metric	Trigger
url_submission.begun	Every submission attempt
url_submission.validation_failure	Pre/post validation failures (failure_type attribute)
url_submission.head_request_error	HEAD request failures (reason attribute)
url_submission.async_request_failure	Can't reach async service
url_submission.accepted	Passed validation + sent to async

• All failure paths also emit logger.warn with event: url_submission_failure + submittedUrl for Sentry Logs widget

Results metrics (resultsController.js)

Metric	Trigger
url_submission.success	Async completed with no errors
url_submission.async_processing_failure	Async returned an error (error_message attribute)

Dashboard funnel

begun → accepted → success
Success rate = success / begun (formula widget)

[pooleycodes]

Also gone through all of provide production and set all errors to either only raise if escalating (Axios Errors) or resolved them.

With the policy going forward for all production environments to be addressing any unresolved errors in Sentry.