8 papers
GoQuant: Geometric Orthogonal Residual Projection for Multiplier-Free Power-of-Two Transformer Quantization
Maoyang Xiang, Tao Luo, Bo Wang
The deployment of Large Language Models (LLMs) and Vision Transformers (ViTs) on edge devices is significantly constrained by memory capacity and the critical timing bottlenecks in…
DAPA: Distribution Aware Piecewise Activation Functions for On-Device Transformer Inference and Training
Maoyang Xiang, Bo Wang
Non-linear activation functions play a pivotal role in on-device inference and training, as they not only consume substantial hardware resources but also impose a significant impac…
On-Device Qwen2.5: Efficient LLM Inference with Model Compression and Hardware Acceleration
Maoyang Xiang, Ramesh Fernando, Bo Wang
Transformer-based Large Language Models (LLMs) have significantly advanced AI capabilities but pose considerable challenges for deployment on edge devices due to high computational…
How to Mitigate the Dependencies of ChatGPT-4o in Engineering Education
Maoyang Xiang, T. Hui Teo
The rapid evolution of large multimodal models (LMMs) has significantly impacted modern teaching and learning, especially in computer engineering. While LMMs offer extensive opport…
FPGA Digital Dice using Pseudo Random Number Generator
Michael Lim Kee Hian, Ten Wei Lin, Zachary Wu Xuan +3
The goal of this project is to design a digital dice that displays dice numbers in real-time. The number is generated by a pseudo-random number generator (PRNG) using XORshift algo…
Logistic Map Pseudo Random Number Generator in FPGA
Mateo Jalen Andrew Calderon, Lee Jun Lei Lucas, Syarifuddin Azhar Bin Rosli +4
This project develops a pseudo-random number generator (PRNG) using the logistic map, implemented in Verilog HDL on an FPGA and processes its output through a Central Limit Theorem…