Muxer error caused by video timestamp adjustment

[khyhern]

Summary

Recording fails with muxer error after video timestamp adjustment warning is triggered.

Log

  Video timestamp adjusted. The timestamp IFrameProvider provided may not be realtime.
  AsyncGPUReadbackTransform: Buffer pool exhausted.
  failed to append sample buffer: video input, The operation could not be completed
  UniEncException: UniEnc error (MuxingError): Failed to finish audio of muxer

Fix

Disable timestamp adjustment by setting high thresholds in RealtimeEncodingOptions:

VideoLagAdjustmentThreshold = 3600.0,
AudioLagAdjustmentThreshold = 3600.0,

[khyhern]

Description

I have further investigated the MuxingError (Failed to finish audio of muxer) and found that the previously proposed workaround of disabling timestamp adjustment does not resolve the underlying issue.

Observations

• Independent of Adjustment: The error occurs even in scenarios where timestamp adjustment is not triggered.

• State Change Vulnerability: The failure is highly reproducible when calling Pause() and Resume() in rapid succession.

• Spontaneous Failure: The error has been observed during steady-state recording without any user interaction or pause/resume cycles.

Steps to Reproduce

1. Start a recording session.

2. Rapidly toggle between Pause() and Resume() states.

3. Observe the MuxingError appearing in the logs, leading to a failure to finalize the audio stream.

Environment

• Unity 6
• macOS
• InstantReplay package version: 1.4.2