1 citations · 1 across the 6 of their papers we have counts for
4 papers · 1 filter
RAGMark: A Comprehensive Framework for Benchmarking Retrieval-Augmented Generation Systems
Zlatan Feric, Amir Taherin, Bin Ren +3
We present RAGMark, a modular benchmarking framework for advanced Retrieval-Augmented Generation (RAG) systems targeting small-scale multi-GPU environments. RAGMark evaluates diver…
Albireo: Adaptive, Energy-Efficient Inference Framework for Video Object Detection on the Edge
Amir Taherin, José Cano, Bin Ren +2
Video object detection on edge devices runs computationally expensive detectors over long frame streams, causing high energy consumption and sustained GPU utilization. Although con…
Hydra: Phase-Aware Workload Characterization of LLM Inference across Edge SoC Generations, Backends, and Quantization Levels
Amir Taherin, Sana Taghipour Anvari, Charles Amante +9
Edge LLM deployment is shaped by more than model size and precision: inference backend, hardware platform, memory traffic, and power management all affect latency and efficiency. W…
From Retrieved Context to Runtime Control: Adaptive Compression for Edge-based RAG
Zlatan Feric, Amir Taherin, Yanzhi Wang +1
Retrieval-augmented generation (RAG) improves language-model responses by grounding generation in external passages, which comes with overhead: retrieved context lengthens the prom…