fix test failure of speculative_generation on xpu

[sywangyi]

• Intel XPU: @IlyasMoutawwakil

fix pytest failure of following case
tests/generation/test_candidate_generator.py::TestUniversalSpeculativeDecoding::test_usd_vs_vanilla_sampling
tests/models/mistral/test_modeling_mistral.py::MistralIntegrationTest::test_speculative_generation
tests/models/qwen2/test_modeling_qwen2.py::Qwen2IntegrationTest::test_speculative_generation
tests/models/qwen3/test_modeling_qwen3.py::Qwen3IntegrationTest::test_speculative_generation
tests/models/whisper/test_modeling_whisper.py::WhisperModelIntegrationTests::test_speculative_decoding_non_distil
tests/models/whisper/test_modeling_whisper.py::WhisperModelIntegrationTests::test_speculative_decoding_distil
tests/models/sam2_video/test_modeling_sam2_video.py::Sam2VideoModelIntegrationTest::test_inference_propagate_on_streamed_video
tests/models/sam2_video/test_modeling_sam2_video.py::Sam2VideoModelIntegrationTest::test_inference_mask_generation_video_one_point_propagate_in_video_directly
tests/models/univnet/test_modeling_univnet.py::UnivNetModelIntegrationTests::test_integration

[sywangyi]

@vasqu could you help review it, thanks

[vasqu]

The conditionals are getting longer and longer. Maybe it would be nicer to split these into cuda vs xpu and have proper explanations/comments at each point?

Edit: Not sure if the change in expected outputs is good, depends if things were faulty before (which I assume was the case) it's expected and was clarified under this review

[sywangyi]

The conditionals are getting longer and longer. Maybe it would be nicer to split these into cuda vs xpu and have proper explanations/comments at each point?

Edit: Not sure if the change in expected outputs is good, depends if things were faulty before (which I assume was the case) it's expected and was clarified under this review

I split xpu out and add comment in the func

[vasqu]

Thx, lgtm let's just move this one if a bit and add a comment there

[github-actions]

[For maintainers] Suggested jobs to run (before merge)

run-slow: qwen3

[vasqu]

Thx for iterating, merging now

[HuggingFaceDocBuilderDev]

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.