4 papers
Building Tailored Speech Recognizers for Japanese Speaking Assessment
Yotaro Kubo, Richard Sproat, Chihiro Taguchi +1
This paper presents methods for building speech recognizers tailored for Japanese speaking assessment tasks. Specifically, we build a speech recognizer that outputs phonemic labels…
TransEvalnia: Reasoning-based Evaluation and Ranking of Translations
Richard Sproat, Tianyu Zhao, Llion Jones
We present TransEvalnia, a prompting-based translation evaluation and ranking system that uses reasoning in performing its evaluations and ranking. This system presents fine-graine…
Sudoku-Bench: Evaluating creative reasoning with Sudoku variants
Jeffrey Seely, Yuki Imajuku, Tianyu Zhao +2
Existing reasoning benchmarks for large language models (LLMs) frequently fail to capture authentic creativity, often rewarding memorization of previously observed patterns. We add…
Continuous Thought Machines
Luke Darlow, Ciaran Regan, Sebastian Risi +2
Biological brains demonstrate complex neural activity, where neural dynamics are critical to how brains process information. Most artificial neural networks ignore the complexity o…