ANALYSIS AI Research
Grading AI Against Real Silicon: The SGAnalog Benchmark Scores Models on 273 Circuits That Actually Reached a Chip Factory
A new benchmark from two Berkeley researchers grades AI models on schematic transcription and device sizing using 273 topologically distinct open-source circuits from Tiny Tapeout manufacturing shuttles. The results reveal sharp limits in visual reasoning, and a refusal problem that has nothing to do with skill.