Categories
3 pages
Inference and Serving
Phase Separation Patterns in Modern AI Workloads
Ray mental model: tasks, actors, objects, scheduling, placement
Tensor Parallelism II: GQA Attention, One Head Group at a Time
