Skip to content

Add Claude Skill for PEFT/LoRA fine-tuning guidance - #43624

Closed
jeeth-kataria wants to merge 2 commits into
huggingface:mainfrom
jeeth-kataria:peft-lora-skill
Closed

Add Claude Skill for PEFT/LoRA fine-tuning guidance#43624
jeeth-kataria wants to merge 2 commits into
huggingface:mainfrom
jeeth-kataria:peft-lora-skill

Conversation

@jeeth-kataria

Copy link
Copy Markdown

What does this PR do?

Adds a Claude SKILL for PEFT (Parameter-Efficient Fine-Tuning) and LoRA guidance, complementing the transformers-api skill in #43340.

Why is this needed?

PEFT/LoRA is one of the most popular integrations with Transformers for memory-efficient fine-tuning. This skill helps Claude Code users with:

  • LoRA configuration (r, lora_alpha, target_modules)
  • QLoRA setup for consumer GPUs
  • Adapter operations (save, load, merge, multi-adapter)
  • Training integration with Trainer/SFTTrainer
  • Common troubleshooting patterns

Structure

.claude/skills/peft-lora/
├── SKILL.md # Main entry point
├── reference/areas/
│ ├── lora-basics.md # LoRA fundamentals
│ ├── qlora-quantization.md # 4-bit/8-bit training
│ ├── adapter-operations.md # Load/save/merge
│ ├── training-integration.md # Trainer & SFTTrainer
│ └── troubleshooting.md # Common errors
└── templates/
└── minimal_repro.md # Bug report template

Related PRs

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants