AI news
公司内部站点 · 页面资源保存在本地（2026-10-17 06:59 UTC）· 独立 X 采集尚未配置；互动计数仅限本站

BRIDGE ASR 2.0 tests 23 speech recognition models on long multilingual conversations

elvis

The benchmark tests 23 models. Its code-switch F1 score checks whether English words mixed into an Indic sentence stay in English; a transcription that writes "data backup" in Devanagari script scores zero.

The leaderboard can be filtered by language and by metric. Methodology and evaluation data are public on the BRIDGE ASR 2.0 page, and elvis says the team wants researchers to test the benchmark and find where it breaks.

#bridge-asr#speech-recognition#benchmarks#humynlabs

Best Taste-Bench model chooses the better direction 59.7% of the time

A paper from Microsoft and colleagues reports that the best model answers 59.7% of Taste-Bench questions correctly when choosing the better open direction in long engineering and research tasks. Forks decided by later evidence are much harder, a larger reasoning budget does not raise accuracy, and distilling a teacher’s outcome judgment improves held-out SWE-bench Pro success.