Together AI

2 articles tagged with Together AI

November 17, 2026
researchTogether AI

Together AI says CUDA Graphs and PDL recover 98% of megakernel performance without custom kernels

Together AI reports that CUDA Graphs and PDL on top of default Torch Inductor kernels recover 98% of its earlier megakernel performance. With "multi-kernels" and agent loops, it claims up to 1.7x over its old megakernels, reaching over 1100 TPS for Llama 1B on H100. The work led to Together Compiler, a framework for continual AI inference optimization.

September 29, 2026
product update

Ollama v0.35.0 Adds Decision Models API for Classification and Routing Tasks

Ollama v0.35.0 adds a new /v1/systemone endpoint for decision models, which return structured choices, probabilities, and scores instead of generated text. The release also fixes stalled MLX downloads and macOS update notification bugs.