3 papers
cs.NE2025
GigaEvo: An Open Source Optimization Framework Powered By LLMs And Evolution Algorithms
Valentin Khrulkov, Andrey Galichin, Denis Bashkirov +5
Recent advances in LLM-guided evolutionary computation, particularly AlphaEvolve (Novikov et al., 2025; Georgiev et al., 2025), have demonstrated remarkable success in discovering…
cs.LG2025
OrtSAE: Orthogonal Sparse Autoencoders Uncover Atomic Features
Anton Korznikov, Andrey Galichin, Alexey Dontsov +3
Sparse autoencoders (SAEs) are a technique for sparse decomposition of neural network activations into human-interpretable features. However, current SAEs suffer from feature absor…
cs.CL2025
I Have Covered All the Bases Here: Interpreting Reasoning Features in Large Language Models via Sparse Autoencoders
Andrey Galichin, Alexey Dontsov, Polina Druzhinina +4
Recent LLMs like DeepSeek-R1 have demonstrated state-of-the-art performance by integrating deep thinking and complex reasoning during generation. However, the internal mechanisms b…