2 citations · 2 across the 11 of their papers we have counts for
24 papers · 1 filter
Evolutionary Feature Engineering for Structured Data
Ege Onur Taga, Yilin Zhuang, M. Emrullah Ildiz +4
Large language models are increasingly used as open-ended search operators in evolutionary optimization. We introduce Evolutionary Feature Engineering (EFE), a framework for using…
Stochastic Sparse Attention for Memory-Bound Inference
Kyle Lee, Corentin Delacour, Kevin Callahan-Coray +5
Autoregressive decoding becomes bandwidth-limited at long contexts, as generating each token requires reading all key and value vectors from KV cache. We present Stochastic A…
Evolutionary Multi-Task Optimization for LLM-Guided Program Discovery
Halil Alperen Gozeten, Xuechen Zhang, Emrullah Ildiz +3
Recent LLM-guided evolutionary search methods have shown that iterative program mutation can discover strong algorithms, but they typically optimize each task independently, even w…
Latent Chain-of-Thought Improves Structured-Data Transformers
Carson Dudley, Samet Oymak
Chain-of-thought and more broadly test-time compute are known to augment the expressive capabilities of language models and have led to major innovations in reasoning. Motivated by…
VSPO: Vector-Steered Policy Optimization for Behavioral Control
Xuechen Zhang, Zijian Huang, Kai Yang +3
Modern language models often need to optimize a primary accuracy objective while also accommodating secondary behavioral preferences, such as verbosity, agreeableness, or the level…
Learning to Correct: Calibrated Reinforcement Learning for Multi-Attempt Chain-of-Thought
Muhammed Emrullah Ildiz, Halil Alperen Gozeten, Ege Onur Taga +1
State-of-the-art reasoning models utilize long chain-of-thought (CoT) to solve increasingly complex problems using more test-time computation. In this work, we explore a long CoT s…