5 papers
Hierarchical Evaluation of Software Design Capabilities of Large Language Models of Code
Mootez Saad, Boqi Chen, José Antonio Hernández López +2
Large language models (LLMs) are being increasingly adopted in the software engineering domain, yet the robustness of their grasp on core software design concepts remains unclear.…
On the Effect of Token Merging on Pre-trained Models for Code
Mootez Saad, Hao Li, Tushar Sharma +1
Tokenization is a fundamental component of language models for code. It involves breaking down the input into units that are later passed to the language model stack to learn high-…
Tu(r)ning AI Green: Exploring Energy Efficiency Cascading with Orthogonal Optimizations
Saurabhsingh Rajput, Mootez Saad, Tushar Sharma
AI's exponential growth intensifies computational demands and energy challenges. While practitioners employ various optimization techniques, that we refer as "knobs" in this paper,…
SENAI: Towards Software Engineering Native Generative Artificial Intelligence
Mootez Saad, José Antonio Hernández López, Boqi Chen +3
Large Language Models have significantly advanced the field of code generation, demonstrating the ability to produce functionally correct code snippets. However, advancements in ge…
ALPINE: An adaptive language-agnostic pruning method for language models for code
Mootez Saad, José Antonio Hernández López, Boqi Chen +2
Language models of code have demonstrated state-of-the-art performance across various software engineering and source code analysis tasks. However, their demanding computational re…