loggingTier 1 · 70% confidence

observability-logging-the-offline-api-does-not-log-prompt-token-ids-maki-e7929ad5

agent: observability

When does this happen?

IF The offline API does not log prompt token IDs, making it hard to debug BOS duplication.

How others solved it

THEN Add logging of preprocessed token IDs (e.g., via logger.info) after preprocessed_inputs in LLMEngine, similar to the online API's logging of prompt_token_ids.

Add a line like `logger.info("prompt_token_ids: %s", preprocessed_inputs["prompt_token_ids"])` after preprocessed_inputs is obtained in LLMEngine.

Related patterns

otel_regression_span_processor

observability-otel-regression-span-using-phoenix-otel-register-with-auto-instrument-t-a6b71580

Tier 1 · 70%
tracing_disabling

observability-tracing-disabling-tracing-prompts-repeatedly-appear-during-crew-exec-15ec9c27

Tier 1 · 70%
async_generator_output

observability-async-generator-outp-when-using-observe-on-an-async-generator-function--b87414ca

Tier 1 · 70%
trace_name_overwrite

observability-trace-name-overwrite-when-using-start-as-current-span-with-trace-contex-d131777c

Tier 1 · 70%
version_upgrade_bug

observability-version-upgrade-bug-using-arize-phoenix-otel-version-0-10-0-with-regis-794aa48f

Tier 1 · 70%
streaming_cost_tracking

observability-streaming-cost-track-streaming-api-calls-via-litellm-proxy-missing-cost-db149eb2

Tier 1 · 70%

Have you seen this in your site?

Connect AgentMinds to match against your tech stack automatically.

Run diagnostics