22 citations · 53 across the 25 of their papers we have counts for
11 papers · 1 filter
Enhancing Trustworthiness with Mixed Precision: Benchmarks, Opportunities, and Challenges
Guanxi Lu, Hao Mark Chen, Zhiqiang Que +2
Large language models (LLMs) have shown promising performance across various tasks. However, their autoregressive decoding process poses significant challenges for efficient deploy…
FastTTS: Accelerating Test-Time Scaling for Edge LLM Reasoning
Hao Mark Chen, Zhiwen Mo, Guanxi Lu +4
Recent advances in reasoning Large Language Models (LLMs) are driving the emergence of agentic AI systems. Edge deployment of LLM agents near end users is increasingly necessary to…
FW-Merging: Scaling Model Merging with Frank-Wolfe Optimization
Hao Mark Chen, Shell Xu Hu, Wayne Luk +2
Model merging has emerged as a promising approach for multi-task learning (MTL), offering a data-efficient alternative to conventional fine-tuning. However, with the rapid developm…
Enhancing Dropout-based Bayesian Neural Networks with Multi-Exit on FPGA
Hao Mark Chen, Liam Castelli, Martin Ferianc +4
Reliable uncertainty estimation plays a crucial role in various safety-critical applications such as medical diagnosis and autonomous driving. In recent years, Bayesian neural netw…
Hardware-Aware Neural Dropout Search for Reliable Uncertainty Prediction on FPGA
Zehuan Zhang, Hongxiang Fan, Hao Mark Chen +2
The increasing deployment of artificial intelligence (AI) for critical decision-making amplifies the necessity for trustworthy AI, where uncertainty estimation plays a pivotal role…
Hardware-Aware Parallel Prompt Decoding for Memory-Efficient Acceleration of LLM Inference
Hao Mark Chen, Wayne Luk, Ka Fai Cedric Yiu +4
The auto-regressive decoding of Large Language Models (LLMs) results in significant overheads in their hardware performance. While recent research has investigated various speculat…
SAE: Single Architecture Ensemble Neural Networks
Martin Ferianc, Hongxiang Fan, Miguel Rodrigues
Ensembles of separate neural networks (NNs) have shown superior accuracy and confidence calibration over single NN across tasks. To improve the hardware efficiency of ensembles of…
When Monte-Carlo Dropout Meets Multi-Exit: Optimizing Bayesian Neural Networks on FPGA
Hongxiang Fan, Hao Chen, Liam Castelli +4
Bayesian Neural Networks (BayesNNs) have demonstrated their capability of providing calibrated prediction for safety-critical applications such as medical imaging and autonomous dr…
Algorithm and Hardware Co-design for Reconfigurable CNN Accelerator
Hongxiang Fan, Martin Ferianc, Zhiqiang Que +4
Recent advances in algorithm-hardware co-design for deep neural networks (DNNs) have demonstrated their potential in automatically designing neural architectures and hardware desig…
Optimizing Bayesian Recurrent Neural Networks on an FPGA-based Accelerator
Martin Ferianc, Zhiqiang Que, Hongxiang Fan +2
Neural networks have demonstrated their outstanding performance in a wide range of tasks. Specifically recurrent architectures based on long-short term memory (LSTM) cells have man…
VINNAS: Variational Inference-based Neural Network Architecture Search
Martin Ferianc, Hongxiang Fan, Miguel Rodrigues
In recent years, neural architecture search (NAS) has received intensive scientific and industrial interest due to its capability of finding a neural architecture with high accurac…