Search results

LoRA gradients not normalized by input norm → training instability (NaN)

Status: Open.

#3073 In huggingface/peft;

· warjohn opened on Mar 1, 2026

TP support for Finetuning using LoRA and other PEFT techniques

Status: Open.

#3044 In huggingface/peft;

· quic-meetkuma opened on Feb 16, 2026

trainable_token_indices of LoraConfig not working when using more than 1 NVIDIA GPU

Status: Open.

#3043 In huggingface/peft;

· Oidlichtnwoada opened on Feb 14, 2026

Create Baseline Evaluation Based on DriveLM data off-the-shelf VLMs

Status: Open.

#3033 In huggingface/peft;

· Hamidreza3252 opened on Feb 9, 2026

LoRA + activation checkpointing breaks model compilation with torch.compile when dropout != 0

Status: Open.

#3020 In huggingface/peft;

· raliouat opened on Feb 3, 2026

layers_to_transform incorrectly matches MoE expert indices (should match layer index)

Status: Open.

#3016 In huggingface/peft;

· MichalMraz opened on Feb 1, 2026

Question about multiple LoRAs and FSDP

Status: Open.

#3012 In huggingface/peft;

· l1346792580123 opened on Jan 28, 2026

Combining adapters linearly with negative weights is broken

Status: Open.

#3004 In huggingface/peft;

· orr-hirundo opened on Jan 21, 2026

Running Lora+ T5 Gemma 2 on multi gpu results in error

Status: Open.

#3002 In huggingface/peft;

· silviiaromanato opened on Jan 19, 2026

Tutorial uses deprecated dataset (financial_phrasebank) that fails to load

Status: Open.

#2998 In huggingface/peft;

· maerory opened on Jan 16, 2026

Add EWoRA to PEFT

Status: Open.

#2970 In huggingface/peft;

· HarshKohli opened on Dec 31, 2025

Return base model state_dict with original keys

Status: Open.

#2945 In huggingface/peft;

· dvmazur opened on Dec 9, 2025