SkillPublic
distributed-llm-pretraining-torchtitan
Provides PyTorch-native distributed LLM pretraining using torchtitan with 4D parallelism (FSDP2, TP, PP, CP). Use when pretraining Llama 3.1, DeepSeek V3, or custom models at scale from 8 to 512+ GPUs with Float8, torch.compile, and distributed checkpointing.
69
Quality
87%
Does it follow best practices?
Run evals on this skill
Adds up to 20 points to the overall score
Securityby
High
Do not use without reviewing
No evaluations available
This skill hasn't been evaluated yet
tessl scenario generatetessl eval run- Repository
Orchestra-Research/AI-Research-SKILLs
- Revision
773a529
Is this your skill?
If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.