Section
35 pages
Tags
RL Systems
Scheduling
Tasks
Distributed Training
Grouped-Query Attention
Megatron-LM
PyTorch
SwiGLU
Tensor Parallelism
Transformers
1
2
3
4