Skip to content
SkillCheatSheet Sign in

fine-tuning-with-trl

An AI agent skill from Orchestra-Research/AI-Research-SKILLs, scored 59 out of 100 by code.

59/ 100C

Code score by group

  • Spec16/20
  • Description7/20
  • Procedure10/15
  • Done criteria0/15
  • Resources9/10
  • Scripts5/8
  • Safety7/7
  • Upkeep5/5

It loses the most points in Done criteria (15), the group that checks whether there is a checklist and a step that verifies the work.

What the author says it does

Fine-tune LLMs using reinforcement learning with TRL - SFT for instruction tuning, DPO for preference alignment, PPO/GRPO for reward optimization, and reward model training. Use when need RLHF, align model with preferences, or train from human feedback. Works with HuggingFace Transformers.

This is the description in the skill's own SKILL.md, written by its author, not by SkillCheatSheet.

Repository
Orchestra-Research/AI-Research-SKILLs
Folder
06-post-training/trl-fine-tuning
License
MIT
GitHub stars
14,480
SKILL.md lines
456
Other files
4

Add fine-tuning-with-trl to your agent

npx skills add Orchestra-Research/AI-Research-SKILLs --skill fine-tuning-with-trl

The command uses the open skills CLI. A skill is instructions and scripts your agent will follow, so read it first: open the folder on GitHub at the commit that was scored.

More skills from Orchestra-Research/AI-Research-SKILLs

  1. pytorch-fsdp2

    Adds PyTorch FSDP2 (fully_shard) to training scripts with correct init, sharding, mixed precision/offload config, and distributed checkpointing. Use when models exceed single-GPU…

    Verified82B
  2. systems-paper-writing

    Comprehensive guide for writing systems papers targeting OSDI, SOSP, ASPLOS, NSDI, and EuroSys. Provides paragraph-level structural blueprints, writing patterns, venue-specific ch…

    Verified82B
  3. evolving-ai-agents

    Provides guidance for automatically evolving and optimizing AI agents across any domain using LLM-driven evolution algorithms. Use when building self-improving agents, optimizing…

    77B
  4. brainstorming-research-ideas

    Guides researchers through structured ideation frameworks to discover high-impact research directions. Use when exploring new problem spaces, pivoting between projects, or seeking…

    76B
  5. academic-plotting

    Generates publication-quality figures for ML papers from research context. Given a paper section or description, extracts system components and relationships to generate architect…

    74B
  6. miles-rl-training

    Provides guidance for enterprise-grade RL training using miles, a production-ready fork of slime. Use when training large MoE models with FP8/INT4, needing train-inference alignme…

    73B
  7. presenting-conference-talks

    Generates conference presentation slides (Beamer LaTeX PDF and editable PPTX) from a compiled paper with speaker notes and talk script. Use when preparing oral talks, spotlight pr…

    73B
  8. evaluating-llms-harness

    Evaluates LLMs across 60+ academic benchmarks (MMLU, HumanEval, GSM8K, TruthfulQA, HellaSwag). Use when benchmarking model quality, comparing models, reporting academic results, o…

    72B

All skills in Orchestra-Research/AI-Research-SKILLs

Scores come from a snapshot of 300 public GitHub repositories taken on 12 November 2026. Every score is the result of fixed checks run by code; no AI is involved. How scoring works.