Skip to content

[BUG] ValueError: media_locations must be conditioned before forward pass #308

@nightrain-vampire

Description

@nightrain-vampire

Hello, when I ran code model.generate() as what example shows, I met problem like:

Traceback (most recent call last):
  File "/data/user3/causality_medical/Multi-Modality-Arena/MedicalEval/Question-answering_Score/med-flamingo/scripts/test.py", line 194, in <module>
    main()
  File "/data/user3/causality_medical/Multi-Modality-Arena/MedicalEval/Question-answering_Score/med-flamingo/scripts/test.py", line 136, in main
    generated_text = model.generate(
  File "/data/user3/miniconda3/envs/flam/lib/python3.9/site-packages/open_flamingo/src/flamingo.py", line 165, in generate
    output = self.lang_encoder.generate(
  File "/data/user3/miniconda3/envs/flam/lib/python3.9/site-packages/torch/utils/_contextlib.py", line 115, in decorate_context
    return func(*args, **kwargs)
  File "/data/user3/miniconda3/envs/flam/lib/python3.9/site-packages/transformers/generation/utils.py", line 1515, in generate
    return self.greedy_search(
  File "/data/user3/miniconda3/envs/flam/lib/python3.9/site-packages/transformers/generation/utils.py", line 2332, in greedy_search
    outputs = self(
  File "/data/user3/miniconda3/envs/flam/lib/python3.9/site-packages/torch/nn/modules/module.py", line 1501, in _call_impl
    return forward_call(*args, **kwargs)
  File "/data/user3/miniconda3/envs/flam/lib/python3.9/site-packages/accelerate/hooks.py", line 169, in new_forward
    output = module._old_forward(*args, **kwargs)
  File "/data/user3/miniconda3/envs/flam/lib/python3.9/site-packages/transformers/models/llama/modeling_llama.py", line 688, in forward
    outputs = self.model(
  File "/data/user3/miniconda3/envs/flam/lib/python3.9/site-packages/torch/nn/modules/module.py", line 1501, in _call_impl
    return forward_call(*args, **kwargs)
  File "/data/user3/miniconda3/envs/flam/lib/python3.9/site-packages/transformers/models/llama/modeling_llama.py", line 578, in forward
    layer_outputs = decoder_layer(
  File "/data/user3/miniconda3/envs/flam/lib/python3.9/site-packages/torch/nn/modules/module.py", line 1501, in _call_impl
    return forward_call(*args, **kwargs)
  File "/data/user3/miniconda3/envs/flam/lib/python3.9/site-packages/open_flamingo/src/flamingo_lm.py", line 51, in forward
    raise ValueError(
ValueError: media_locations must be conditioned before forward pass

How to set media_locations? Can anyone help me?

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions