SPEARBench: A Benchmark for Naturalness Evaluation in Streaming Speech-to-Speech Language Models
By Thomas Thebaud · Paper · cs.CL
Streaming speech-to-speech language models aim to answer spoken queries directly with synthetic speech. However, standard speech and text benchmarks do not capture whether these systems behave naturally in conversations, where timing, turn-taking, prosody, interpersonal stance, l