Liquid AI has released two open-weight models that return yes/no, multiple-choice and scored answers in a single forward pass instead of generating tokens, with vendor-reported latency as low as 16 milliseconds on an NVIDIA Jetson edge board. The benchmarks are the company's own; independent verification is absent.
CUDA 13.1 brings green contexts to the mainstream Runtime API, letting an application reserve a fixed slice of streaming multiprocessors so a small, latency-critical job never waits behind a bulk workload. NVIDIA reports 0.007 ms versus 0.140 ms on a Blackwell GPU; all figures are vendor-reported.
Liquid AI's new 280M-parameter DSpark drafter guesses ahead so the LFM2.5-VL-3B vision model verifies instead of computing every token. All speedups are self-reported; here is how the technique works and where its gains stop.