activity
20222026
most citedFast Inference from Transformers via Speculative Decoding

34 citations · 45 across the 5 of their papers we have counts for

collaborators

5 papers

cs.HC2026

Generative UI: LLMs are Effective UI Generators

Yaniv Leviathan, Dani Valevski, Matan Kalman +10

AI models excel at creating content, but typically render it with static, predefined interfaces. Specifically, the output of LLMs is often a markdown "wall of text". Generative UI…

cs.LG2025★ 1 cited

Prompt Repetition Improves Non-Reasoning LLMs

Yaniv Leviathan, Matan Kalman, Yossi Matias

When not using reasoning, repeating the input prompt improves performance for popular models (Gemini, GPT, Claude, and Deepseek) without increasing the number of generated tokens o…

cs.CL2024★ 2 cited

Selective Attention Improves Transformer

Yaniv Leviathan, Matan Kalman, Yossi Matias

Unneeded elements in the attention's context degrade performance. We introduce Selective Attention, a simple parameter-free change to the standard attention mechanism which reduces…

cs.LG2022★ 34 cited

Fast Inference from Transformers via Speculative Decoding

Yaniv Leviathan, Matan Kalman, Yossi Matias

Inference from large autoregressive models like Transformers is slow - decoding K tokens takes K serial runs of the model. In this work we introduce speculative decoding - an algor…

cs.CV2022★ 8 cited

UniTune: Text-Driven Image Editing by Fine Tuning a Diffusion Model on a Single Image

Dani Valevski, Matan Kalman, Eyal Molad +3

Text-driven image generation methods have shown impressive results recently, allowing casual users to generate high quality images by providing textual descriptions. However, simil…