CUDA Graphs
1 article tagged with CUDA Graphs
November 17, 2026
researchTogether AI
Together AI says CUDA Graphs and PDL recover 98% of megakernel performance without custom kernels
Together AI reports that CUDA Graphs and PDL on top of default Torch Inductor kernels recover 98% of its earlier megakernel performance. With "multi-kernels" and agent loops, it claims up to 1.7x over its old megakernels, reaching over 1100 TPS for Llama 1B on H100. The work led to Together Compiler, a framework for continual AI inference optimization.