5 papers
Running Fewer Loops Removes Refusal Behaviour in Recurrent-Depth Language Models
Seyedarmin Azizi, Erfan Baghaei Potraghloo, Arya Fayyazi +2
A recurrent-depth language model reuses one block of weights several times in a row. The number of repetitions, which we call loops, is chosen when the model runs, not when it is t…
Sharpen Without Search: On-Policy Distillation of Sequence-Level Power Distribution
Erfan Baghaei Potraghloo, Seyedarmin Azizi, Arya Fayyazi +4
A language model can give a correct answer more probability than any single incorrect answer and still usually sample an incorrect one, because the incorrect answers together hold…
Fair on the Surface? Benchmarking Hidden-Output Fairness Gaps in LLM Recommenders
Chan Aristella Lu, Arya Fayyazi, Junhao Zhang +6
Fairness audits for LLM-based recommenders have largely focused on observable outputs, implicitly assuming that stable recommendations reflect stable internal processing. We challe…
Multi-Level Modeling of Large Language Model Inference Latency and Energy via Hybrid Analytical--Machine-Learning Predictors
Saeid Shokoufa, Mohammad Erfan Sadeghi, Mehdi Kamal +1
The rapid scaling of Large Language Models (LLMs) has significantly increased computational cost, energy consumption, and inference latency, making accurate estimation essential fo…
HDLFORGE: A Two-Stage Multi-Agent Framework for Efficient Verilog Code Generation with Adaptive Model Escalation
Armin Abdollahi, Saeid Shokoufa, Negin Ashrafi +2
We present HDLFORGE, a two-stage multi-agent framework for automated Verilog generation that optimizes the trade-off between generation speed and accuracy. The system uses a compac…