3 papers
cs.SE2025
When the Code Autopilot Breaks: Why LLMs Falter in Embedded Machine Learning
Roberto Morabito, Guanghan Wu
Large Language Models (LLMs) are increasingly used to automate software generation in embedded machine learning workflows, yet their outputs often fail silently or behave unpredict…
cs.LG2025
Towards Efficient Multi-LLM Inference: Characterization and Analysis of LLM Routing and Hierarchical Techniques
Adarsh Prasad Behera, Jaya Prakash Champati, Roberto Morabito +2
Recent progress in Language Models (LMs) has dramatically advanced the field of natural language processing (NLP), excelling at tasks like text generation, summarization, and quest…
cs.LG2025
Exploring the Boundaries of On-Device Inference: When Tiny Falls Short, Go Hierarchical
Adarsh Prasad Behera, Paulius Daubaris, Iñaki Bravo +4
On-device inference holds great potential for increased energy efficiency, responsiveness, and privacy in edge ML systems. However, due to less capable ML models that can be embedd…