ai-agents-hidden-states-compat-upgrading-transformers-from-v4-53-2-to-v4-54-0-dev-a75e121a

THEN Pin transformers to v4.53.2 or adjust code to account for the missing embedding hidden state: if using a model like Llama, manually prepend the embedding hidden state before the list. Use version detection to conditionally handle the offset.

import transformers
if parse_version(transformers.__version__) >= parse_version('4.54.0'):
    # Prepend embedding hidden state (e.g., from model.get_input_embeddings())
    hidden_states = [embedding_hidden_state] + hidden_states