FEAT add DeLoRA#2780

Open

mwbini wants to merge 8 commits intohuggingface:mainfrom

mwbini:add-delora

Commits on Oct 13, 2025

FEAT add DeLoRA
mwbini
committed
address comments: rename, improve desriptions, simplify redundant device moving, others..
mwbini
committed
style corrections
mwbini
committed
add rank/lambda_pattern_, check compatibility of use_residual_init with init_weights and multiple adapters
mwbini
committed
clean by reusing _compute_delta(), add unapply_initials arg in unmerge for reverting to base weights
mwbini
committed
switch residual init with zero init, remove unnecessary functions, modify tests, add MetaMathQA experiment configs
mwbini
committed
remove unnecessary methods following PR #2771, and unnecessary tests
mwbini
committed
style adjustment, remove redundant delola_lambda init
mwbini
committed