LLM News

Every LLM release, update, and milestone.

Filtered by:sequence-modeling✕ clear
research

Pointer-CAD unifies B-Rep and command sequences for LLM-based CAD generation

Researchers present Pointer-CAD, an LLM-based framework that addresses fundamental limitations in command sequence-based CAD generation by enabling explicit geometric entity selection through pointer mechanisms. The approach reduces quantization errors and supports complex operations like chamfering and filleting that prior methods cannot handle.

2 min readvia arxiv.org
research

Researchers extend Vision Mamba sequence length 4x with separator-based pretraining

Researchers have introduced STAR (Separators for AutoRegressive pretraining), a method that extends Vision Mamba's input sequence length by 4x through strategic separator insertion between images. The STAR-B model achieved 83.5% accuracy on ImageNet-1k, demonstrating improved long-range dependency modeling in vision tasks.