A Mental Model of TPUs for Performance Engineering
A visual mental model for understanding TPU architecture and how it relates to ML workloads.
Training a 360M Parameter Model with Performance Discipline
Pretraining SmolLM-360M on a single A100 GPU within a 30-hour window, focusing on feasibility analysis, throughput measurement, and hardware efficiency optimization.
Featured
Can LLM agents improve other LLM agents?
Exploring whether language model agents can enhance the performance of other LLM agents through a meta-benchmark approach.
An Interactive Guide to Rooflines
A walkthrough of the roofline model — compute vs memory bounds, arithmetic intensity, and how different kernels land on the plot — with two interactive widgets.
Recent
AI systems performance