Showing 2025Show all
2 papers · 1 filter
cs.LG2025
QKV Projections Require a Fraction of Their Memory
Malik Khalaf, Yara Shamshoum, Nitzan Hodos +2
The Multi-Head Attention mechanism is central to LLM operation, and multiple works target its compute and memory efficiency during training. While most works focus on approximating…
cs.AI2025
Large Language Models for Water Distribution Systems Modeling and Decision-Making
Yinon Goldshtein, Gal Perelman, Assaf Schuster +1
The integration of Large Language Models (LLMs) into engineering workflows presents new opportunities for making computational tools more accessible. Especially where such tools re…