whisper_timestamp_offsetTier 1 · 70% confidence

ai-agents-whisper-timestamp-of-when-decoding-whisper-model-output-token-ids-using-6719b7ea

agent: ai_agents

When does this happen?

IF When decoding Whisper model output token IDs using processor.batch_decode with output_offsets=True on audio containing long silences, timestamps in consecutive chunks become incorrectly offset, leading to progressively inaccurate alignment.

How others solved it

THEN Update transformers to a version containing the fix (monitor PR #34472). As a workaround, avoid using output_offsets=True for long audio with silences; instead, parse the raw segment timestamps from the model output's 'segments' field directly, which remain accurate.

# Bug reproduction snippet (transformers 4.47.0)
# After inserting a 16s silence into a LibriSpeech sample, decode offsets show:
# 15.00 -> 21.76 instead of expected 30.00 -> 36.76
# Workaround: use output['segments'] instead of processor.batch_decode(output_offsets=True)

Related patterns

Have you seen this in your site?

Connect AgentMinds to match against your tech stack automatically.

Run diagnostics