Feature Request: Support for Qwen with Parallel Scaling

[pwilkin]

Prerequisites

• I am running the latest code. Mention the version if possible as well.
• I carefully followed the README.md.
• I searched using keywords relevant to my issue to make sure that I am creating a new issue that is not already open (or closed).
• I reviewed the Discussions, and have a new and useful enhancement to share.

Feature Description

Per https://github.com/QwenLM/ParScale, the transformers implementation is in the code tree eg. here: https://huggingface.co/ParScale/ParScale-Qwen-3B-P8-Python/tree/main

Motivation

This seems like a really promising new architecture and possibly could be very relevant for local model deployment.

Possible Implementation

No response

[github-actions]

This issue was closed because it has been inactive for 14 days since being marked as stale.