Add PVeRA to PEFT

[leofillioux]

Feature request

Hey!

We propose to add PVeRA to PEFT. PVeRA https://www.arxiv.org/abs/2512.07703 is a probabilistic variation of VeRA, which learns a distribution in the latent adaptation space. It improves the performance of the VeRA (71.4% vs 69.9% accuracy on the VTAB-1k benchmark), and allows to use the learned latent space for uncertainty quantification (e.g. Monte Carlo confidence interval estimation).

Your contribution

The official implementation of the paper is available https://github.com/leofillioux/pvera. I'm available to prepare a PR.

[githubnemo]

Hey @leofillioux, that sounds promising! Thanks for the offer, we'd appreciate if you could submit a PR :)

Since your work is based on VeRA it might be a good start to base your implementation on the existing one, I would implement it as its own tuner instead of modifying the existing implementation, though.

Don't hesitate to submit a rough draft PR early on to get early feedback!

[leofillioux]

Hey @githubnemo, I opened pull request #2952 concerning this issue

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

[BenjaminBossan]

not stale