Expert guidance for GRPO/RL fine-tuning with TRL for reasoning and task-specific model training
57
67%
Does it follow best practices?
Run evals on this skill
Adds up to 20 points to the overall score
View guide
Critical
Do not install without reviewing
Fix and improve this skill with Tessl
tessl review fix ./backend/cli/skills/ml-training/grpo-rl-training/SKILL.mdSecurity
1 critical severity finding. Installing this skill is not recommended: please review these findings carefully if you do intend to do so.
Detected high-risk code patterns in the skill content — including its prompts, tool definitions, and resources — such as data exfiltration, backdoors, remote code execution, credential theft, system compromise, supply chain attacks, and obfuscation techniques.
Contains an unsafe pattern that executes model-generated code (exec) without enforcing sandboxing, enabling remote code execution and potential system compromise if untrusted completions are used.
Low
Low-risk findings.
1 low severity finding. Worth noting, but not necessarily harmful.
The skill exposes the agent to untrusted, user-generated content from public third-party sources, creating a risk of indirect prompt injection. This includes browsing arbitrary URLs, reading social media posts or forum comments, and analyzing content from unknown websites.
SKILL’s required runtime workflow loads a dataset at runtime (template `get_dataset()` uses `datasets.load_dataset('openai/gsm8k', ...)`), bringing outsider-authored free-form text (questions/answers from an external public dataset) into the LLM context via the training prompts/content fed to `GRPOTrainer`.
52845c3
If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.