The reporting

3 articles

Topic: edge ai

An NVIDIA Jetson Nano 2 development board, a small single-board edge AI computer, photographed against a neutral background

NEWS AI Models

Liquid AI opens up d1-3B and d1-omni-600M: small models that decide in milliseconds instead of writing tokens

Liquid AI has released two open-weight models that return yes/no, multiple-choice and scored answers in a single forward pass instead of generating tokens, with vendor-reported latency as low as 16 milliseconds on an NVIDIA Jetson edge board. The benchmarks are the company's own; independent verification is absent.

NVIDIA CEO Jensen Huang holds a desktop-class RTX Blackwell graphics card at the company's CES 2025 keynote in Las Vegas.

ANALYSIS Infrastructure

Green Contexts Go Mainstream: CUDA 13.1 Lets One App Carve a Guaranteed GPU Slice for Urgent Work

CUDA 13.1 brings green contexts to the mainstream Runtime API, letting an application reserve a fixed slice of streaming multiprocessors so a small, latency-critical job never waits behind a bulk workload. NVIDIA reports 0.007 ms versus 0.140 ms on a Blackwell GPU; all figures are vendor-reported.

An open laptop on a wooden desk beside stacked books, representing local AI inference on everyday hardware

NEWS AI Applications

A 280M-parameter sidecar makes a vision-language model up to 3.13x faster on a laptop, with no change to output

Liquid AI's new 280M-parameter DSpark drafter guesses ahead so the LFM2.5-VL-3B vision model verifies instead of computing every token. All speedups are self-reported; here is how the technique works and where its gains stop.