9 papers
Evolutionary Feature Engineering for Structured Data
Ege Onur Taga, Yilin Zhuang, M. Emrullah Ildiz +4
Large language models are increasingly used as open-ended search operators in evolutionary optimization. We introduce Evolutionary Feature Engineering (EFE), a framework for using…
Evolutionary Multi-Task Optimization for LLM-Guided Program Discovery
Halil Alperen Gozeten, Xuechen Zhang, Emrullah Ildiz +3
Recent LLM-guided evolutionary search methods have shown that iterative program mutation can discover strong algorithms, but they typically optimize each task independently, even w…
On the Generalization Properties of Selective State-Space Models for Filtering Tasks for Unknown Systems
Alex Tang, M. Emrullah Ildiz, Batin Kurt +2
Selective State-Space Models (SSMs) such as Mamba have emerged as an alternative architecture to self-attention based transformers in sequence modeling tasks. Recent works have dem…
Learning to Correct: Calibrated Reinforcement Learning for Multi-Attempt Chain-of-Thought
Muhammed Emrullah Ildiz, Halil Alperen Gozeten, Ege Onur Taga +1
State-of-the-art reasoning models utilize long chain-of-thought (CoT) to solve increasingly complex problems using more test-time computation. In this work, we explore a long CoT s…
Retrieval Augmented Time Series Forecasting
Kutay Tire, Ege Onur Taga, Muhammed Emrullah Ildiz +1
Retrieval-augmented generation (RAG) is a central component of modern LLM systems, particularly in scenarios where up-to-date information is crucial for accurately responding to us…
Continuous Chain of Thought Enables Parallel Exploration and Reasoning
Halil Alperen Gozeten, M. Emrullah Ildiz, Xuechen Zhang +3
Modern language models generate chain-of-thought traces by autoregressively sampling tokens from a finite vocabulary. While this discrete sampling has achieved remarkable success,…