The reporting

2 articles

Topic: ai reliability

Reference image showing a JSON Schema validation example associated with a to-do list

EDUCATIONAL AI Explained

A Valid JSON Answer Can Still Be Wrong

Schema-constrained generation can make output easier to parse. It cannot, by itself, prove that extracted values are true or that an action is authorized.

Research illustration showing the same recorded robot trajectory receiving different progress scores under two equivalent instructions about placing a radish in a pink bowl.

ANALYSIS Robotics

RoboRMBench Exposes Wording-Sensitive Reward Scores in Robot Learning

A new preprint tests vision-language reward models on 2,390 recorded real-robot trajectories and finds that equivalent instructions can produce contradictory judgments, revealing a measurable reliability gap before physical deployment.