Duplicate the SamplingMetadata class

[maxdebayser]

We were previously reusing the GPU SamplingMetadata class but there have been incompatible changes upstream (PR vllm-project/vllm#16728)

Since it's not clear for now whether we want, should or can reuse the LogitsProcessor implementation as is, I'm making temporarily making a copy of the old versions of the files that we need for the spyre backend.

This won't affect any features for now since the vllm change was an internal refactoring without UX impact.

Follow-up issue to give a definitive solution: https://github.ibm.com/ai-foundation/aiu-app-sw-tracker/issues/804

[github-actions]

👋 Hi! Thank you for contributing to vLLM support on Spyre.
Just a reminder: Make sure that your code passes all the linting checks, otherwise your PR won't be able to be merged. To do so, first install the linting requirements, then run format.sh and commit the changes. This can be done with uv directly:

uv sync --frozen --group lint --active --inexact

Or this can be done with pip:

uv pip compile --group lint > requirements-lint.txt
pip install -r requirements-lint.txt
bash format.sh

Now you are good to go 🚀

[yannicks1]

If this is the preferred way to tackle these breaking changes upstream, then it LGTM.

[yannicks1]

duplicate lines 3-4

[joerunde]

We were previously reusing the GPU SamplingMetadata class

I don't think that class is gpu-specific though, right? It's the sampling metadata used by all in-tree platforms supported by vllm

[maxdebayser]

I don't think that class is gpu-specific though, right? It's the sampling metadata used by all in-tree platforms supported by vllm

No, for example, in the TPU it's a different class: vllm/v1/sample/tpu/metadata.py

[prashantgupta24]

Any chance we can rebase this to get merged to vllm-main-updates instead of main?

[maxdebayser]

Any chance we can rebase this to get merged to vllm-main-updates instead of main?

Sorry, I'm not sure I understand. These commits here are already in vllm-main-updates, rght?

[prashantgupta24]

Any chance we can rebase this to get merged to vllm-main-updates instead of main?

Sorry, I'm not sure I understand. These commits here are already in vllm-main-updates, rght?

You're right, I said that just in case we wanted to merge any new changes