simpo-training

21.8k
davila7davila7

Simple Preference Optimization for LLM alignment. Reference-free alternative to DPO with better performance (+6.4 points on AlpacaEval 2.0). No reference model needed, more efficient than DPO. Use for preference alignment when you want simpler, faster training than DPO/PPO.

Post-TrainingSimPOPreference Optimization+5
193 days ago

grpo-rl-training

21.8k
davila7davila7

Expert guidance for GRPO/RL fine-tuning with TRL for reasoning and task-specific model training

Post-TrainingReinforcement LearningGRPO+7
193 days ago

pufferlib

21.8k
davila7davila7

This skill should be used when working with reinforcement learning tasks including high-performance RL training, custom environment development, vectorized parallel simulation, multi-agent systems, or integration with existing RL environments (Gymnasium, PettingZoo, Atari, Procgen, etc.). Use this skill for implementing PPO training, creating PufferEnv environments, optimizing RL performance, or developing policies with CNNs/LSTMs.

193 days ago

verl-rl-training

21.8k
davila7davila7

Provides guidance for training LLMs with reinforcement learning using verl (Volcano Engine RL). Use when implementing RLHF, GRPO, PPO, or other RL algorithms for LLM post-training at scale with flexible infrastructure backends.

Reinforcement LearningRLHFGRPO+3
193 days ago

openrlhf-training

21.8k
davila7davila7

High-performance RLHF framework with Ray+vLLM acceleration. Use for PPO, GRPO, RLOO, DPO training of large models (7B-70B+). Built on Ray, vLLM, ZeRO-3. 2× faster than DeepSpeedChat with distributed architecture and GPU resource sharing.

Post-TrainingOpenRLHFRLHF+9
193 days ago

fine-tuning-with-trl

21.8k
davila7davila7

Fine-tune LLMs using reinforcement learning with TRL - SFT for instruction tuning, DPO for preference alignment, PPO/GRPO for reward optimization, and reward model training. Use when need RLHF, align model with preferences, or train from human feedback. Works with HuggingFace Transformers.

Post-TrainingTRLReinforcement Learning+8
193 days ago

stable-baselines3

21.8k
davila7davila7

Use this skill for reinforcement learning tasks including training RL agents (PPO, SAC, DQN, TD3, DDPG, A2C, etc.), creating custom Gym environments, implementing callbacks for monitoring and control, using vectorized environments for parallel training, and integrating with deep RL workflows. This skill should be used when users request RL algorithm implementation, agent training, environment design, or RL experimentation.

193 days ago

stable-baselines3

10.8k
K-Dense-AIK-Dense-AI

Production-ready reinforcement learning algorithms (PPO, SAC, DQN, TD3, DDPG, A2C) with scikit-learn-like API. Use for standard RL experiments, quick prototyping, and well-documented algorithm implementations. Best for single-agent RL with Gymnasium environments. For high-performance parallel training, multi-agent systems, or custom vectorized environments, use pufferlib instead.

193 days ago

agentdb-reinforcement-learning-training

188
aiskillstoreaiskillstore

Train AI agents using AgentDB's 9 reinforcement learning algorithms including Q-Learning, DQN, PPO, and Actor-Critic. Build self-learning agents, implement RL training loops with experience replay, and deploy optimized models to production.

193 days ago

model_finetuning

39
vuralserhat86vuralserhat86

Fine-tune LLMs using reinforcement learning with TRL - SFT for instruction tuning, DPO for preference alignment, PPO/GRPO for reward optimization, and reward model training. Use when need RLHF, align model with preferences, or train from human feedback. Works with HuggingFace Transformers.

DPOFine-TuningGRPO+34
193 days ago

reinforcement-learning

29
omer-metinomer-metin

Use when implementing RL algorithms, training agents with rewards, or aligning LLMs with human feedback - covers policy gradients, PPO, Q-learning, RLHF, and GRPOUse when ", " mentioned.

193 days ago

stable-baselines3

15
oimiragieooimiragieo

Production-ready reinforcement learning algorithms (PPO, SAC, DQN, TD3, DDPG, A2C) with scikit-learn-like API. Use for standard RL experiments, quick prototyping, and well-documented algorithm implementations. Best for single-agent RL with Gymnasium environments. For high-performance parallel training, multi-agent systems, or custom vectorized environments, use pufferlib instead.

193 days ago

cursor-edit

10
heishiaheishia

Performs actual code modifications via the Cursor CLI. It accepts analysis/plan results and delegates code edits to the cursor-agent. Use this when actual file changes are required, such as code edits, refactoring, feature additions, or bug fixes.

193 days ago

verify

10
heishiaheishia

Verify results after code changes. Use when quality checks are needed after code modifications, such as reviewing changes, running tests, checking builds, and running lint checks.

193 days ago

analyze

10
heishiaheishia

Analyze and understand a codebase. Use when analysis is needed before modifying code, such as understanding structure, analyzing dependencies, identifying patterns, and discovering issues.

193 days ago

pufferlib

9
jackspacejackspace

This skill should be used when working with reinforcement learning tasks including high-performance RL training, custom environment development, vectorized parallel simulation, multi-agent systems, or integration with existing RL environments (Gymnasium, PettingZoo, Atari, Procgen, etc.). Use this skill for implementing PPO training, creating PufferEnv environments, optimizing RL performance, or developing policies with CNNs/LSTMs.

193 days ago

Stable Baselines3(stable-baselines3)

9
jackspacejackspace

Use this skill for reinforcement learning tasks including training RL agents (PPO, SAC, DQN, TD3, DDPG, A2C, etc.), creating custom Gym environments, implementing callbacks for monitoring and control, using vectorized environments for parallel training, and integrating with deep RL workflows. This skill should be used when users request RL algorithm implementation, agent training, environment design, or RL experimentation.

193 days ago

ksim-rl

7
plurigridplurigrid

RL training library for humanoid locomotion and manipulation built on MuJoCo and JAX. Provides PPO, AMP, and custom task abstractions for sim-to-real robotics policy training.

193 days ago

reinforcement-learning

5
pluginagentmarketplacepluginagentmarketplace

Q-learning, DQN, PPO, A3C, policy gradient methods, multi-agent systems, and Gym environments. Use for training agents, game AI, robotics, or decision-making systems.

193 days ago

rltools-training

1
chuongdlbchuongdlb

Configure and run RL training with rl-tools — SAC, TD3, PPO training, hyperparameters, network architecture, composable loop steps.

trainingsactd3+1
193 days ago

isaaclab-rl-training

1
chuongdlbchuongdlb

Trains RL policies in IsaacLab using RSL-RL, RL-Games, Stable-Baselines3, or SKRL — PPO configs, checkpoints, multi-GPU, Ray tuning.

trainingpporsl-rl+1
193 days ago

stable-baselines3

1
iamseungpiliamseungpil

Production-ready reinforcement learning algorithms (PPO, SAC, DQN, TD3, DDPG, A2C) with a scikit-learn-like API. Use for standard RL experiments, quick prototyping, and well-documented algorithm implementations. Best for single-agent RL with Gymnasium environments. For high-performance parallel training, multi-agent systems, or custom vectorized environments, use pufferlib instead.

193 days ago

gpd-training-evaluation

1
chuongdlbchuongdlb

Stable-Baselines3 PPO training pipeline — environment setup, callbacks, reward thresholds, model saving, evaluation, inference loop.

trainingpposb3+1
193 days ago

stable-baselines3

reikiplanetreikiplanet

Production-ready reinforcement learning algorithms (PPO, SAC, DQN, TD3, DDPG, A2C) with a scikit-learn-like API. Use for standard RL experiments, quick prototyping, and well-documented algorithm implementations. Best for single-agent RL with Gymnasium environments. For high-performance parallel training, multi-agent systems, or custom vectorized environments, use pufferlib instead.

193 days ago