#roofline-model

Profiling LLM Inference with SGLang and Torch Profiler

This blog is my attempt to learn how to profile an llm served using sglang and its in built torch profiler integration that comes out of box...