4 citations · 4 across the 2 of their papers we have counts for
4 papers · 1 filter
Geometric Metrics and LLMs: What They Measure and When They Work
Viacheslav Yusupov, Anna Antipina, Ameliia Alaeva +6
We present a systematic stress-test of geometric metrics for LLM evaluation. Rank-based geometric properties of internal representations have shown promise as reference-free qualit…
PersonalAI 2.0: Enhancing knowledge graph traversal/retrieval with planning mechanism for Personalized LLM Agents
Mikhail Menschikov, Matvey Iskornev, Alexander Kharitonov +8
We introduce PersonalAI 2.0 (PAI-2), a novel framework, designed to enhance large language model (LLM) based systems through integration of external knowledge graphs (KG). The prop…
PersonalAI: A Systematic Comparison of Knowledge Graph Storage and Retrieval Approaches for Personalized LLM agents
Mikhail Menschikov, Dmitry Evseev, Victoria Dochkina +5
Personalizing language models by effectively incorporating user interaction history remains a central challenge in the development of adaptive AI systems. While large language mode…
Beyond Early-Token Bias: Model-Specific and Language-Specific Position Effects in Multilingual LLMs
Mikhail Menschikov, Alexander Kharitonov, Maiia Kotyga +5
Large Language Models (LLMs) exhibit position bias systematically underweighting information based on its location in the context but how this bias varies across languages and mode…