A Mental Model of TPUs for Performance Engineering
A visual mental model for understanding TPU architecture and how it relates to ML workloads.
Posts tagged "AI systems performance"
AllAIAI Systems PerformanceAI systems performanceAI-agentsArithmetic IntensityGPUsLLMsTPUscompilerscomputationhardwarelox-interpretermathmodel-evaluationspre-trainingprogramming-languagespythonsetssoftware-engineering
Training a 360M Parameter Model with Performance Discipline
Pretraining SmolLM-360M on a single A100 GPU within a 30-hour window, focusing on feasibility analysis, throughput measurement, and hardware efficiency optimization.