19 papers
Cross-Lingual Exploration for Parametric Knowledge
Elisha Diskind, Itamar Trainin, Uri Shaham +3
Parametric knowledge in Large Language Models is not equally accessible across languages. As a result, standard inference techniques often struggle to surface localized facts, lead…
The Challenge and Reward of Fair Play in Narrative: A Computational Approach
Eitan Wagner, Renana Keydar, Omri Abend
Good storytelling involves surprise -- unpredictability in how the story unfolds -- and sense-making, the requirement that the story forms a coherent sequence. However, to date, th…
Express Your Doubts -- Probabilistic World Modeling Should not be Based on Token logprobs
Eitan Wagner, Omri Abend
Language modeling has shifted in recent years from a distribution over strings to prediction models with textual inputs and outputs for general-purpose tasks. This position paper h…
Position: Natural Language Should Not Fully Replace Formal Languages
Eitan Wagner, Elisha Rosensweig, Omri Abend
Recent advances in large language models and their widespread adoption have prompted claims that natural language could entirely replace formal languages, such as programming langu…
Mediocrity is the key for LLM as a Judge Anchor Selection
Shachar Don-Yehiya, Asaf Yehudai, Leshem Choshen +1
The ``LLM-as-a-judge'' paradigm has become a standard method for evaluating open-ended generation. To address the quadratic scalability costs of pairwise comparisons, popular bench…
Discrete Diffusion Models Exploit Asymmetry to Solve Lookahead Planning Tasks
Itamar Trainin, Shauli Ravfogel, Omri Abend +1
While Autoregressive (AR) Transformer-based Generative Language Models are frequently employed for lookahead tasks, recent research suggests a potential discrepancy in their abilit…