Skip to content

Replays does not respect the order in list of messages (images/text) #1240

@im-ajaymeena

Description

@im-ajaymeena

What Happened?

Our original requests to LLM uses message order as ['image_url', 'image_url', 'text']
Image

When we use replay for the above trace -> the portkey changes the order to ['text', 'image_url', 'image_url'] (I didn't knew this until I found change in the reponse behaviour since normally we use playground/replay in pretty mode )
Image

What Should Have Happened?

Replays should respect the order of messages, since the reproducibility gets affects

Relevant Code Snippet

No response

Your Twitter/LinkedIn

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't workingtriage

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions