Synaptic Radio

Principal ML engineer focused on foundation models, agentic systems and scientific AI. I write about the math, systems and engineering judgement behind reliable ML workflows.

Home
Archives
Categories
Tags
Resume
Search
1. Dark Mode

Search

Categories

Distributed Training GPU Systems and Performance Engineering Inference and Serving Tensor Parallelism Deep-Learning Mechanisms Research Methodology Software Architecture Transformer Architecture

Tags

Megatron-LM PyTorch Tensor Parallelism Actors Book-Review Circe Distributed Systems Distributed Training Greek-Mythology Grouped-Query Attention

Tags

1 page

Distributed Systems

Ray mental model: tasks, actors, objects, scheduling, placement

© 2026 Anshuman Sahoo