[BUG] Geneformer finetuning with peft does not work

[dorotat-nv]

BioNeMo Framework Version

67bc54f

Bug Description

It seems that geneformer finetuning with peft does not work according to the error msg

bionemo-framework/sub-packages/bionemo-geneformer/tests/bionemo/geneformer/test_model.py

Line 1021 in 67bc54f

@pytest.mark.skip(reason="PEFT currently broken with fusions activated.")

Steps to Reproduce

This test is skipped since peft is broken

Error Messages and Logs

Docker Image

No response

System Information

Environment Details:

• OS: [e.g., Ubuntu 20.04]
• CPU: [e.g., Intel i9-12900K]
• RAM: [e.g., 64GB]

GPU Details:

• GPU Model: [e.g., NVIDIA RTX 4090]
• GPU Memory: [e.g., 24GB]
• CUDA Version: [e.g., 12.1]
• CUDA Driver: [e.g., 525.85.05]
• cuDNN Version: [e.g., 8.9.0]

Additional Context

No response