Synaptic Radio

Distributed training 3

Tensor-Parallel GQA Attention, One Head Group at a Time [Jul 16, 2026] 0
Megatron Tensor Parallelism: Rebuilding a SwiGLU Feed-Forward Block Across Two Ranks [Jul 16, 2026] 0
A Restart Is Not a Resume: Testing PyTorch Checkpoints [Jul 04, 2026] 0

Multimodal learning 1

Pixels Are Not Positions: Testing 2D Coordinate Encodings Under Scale and Translation [Jul 10, 2026] 0

Book Recommendations 2026 8

Circe by Madeline Miller
Pachinko by Min Jin Lee
The Staff Engineer's Path by Tanya Reilly
Man's Search for Meaning by Viktor E. Frankl
The Thinking Machine by Stephen Witt
The Emperor of All Maladies by Siddhartha Mukherjee
Visit India with Me by Dhan Gopal Mukerji
A Mind at Play by Jimmy Soni and Rob Goodman