73 citations · 495 across the 39 of their papers we have counts for
3 papers · 2 filters
MorphAtt: A Neuromorphic Accelerator for Efficient Multi-Head Attention Processing in Spiking Vision Transformers
Rachmad Vidya Wicaksana Putra, Amirhesam Jafari Rad, Muhammad Shafique
Spiking Vision Transformers (SViTs) are developed as an energy-efficient alternative to conventional ViTs for computer vision tasks at the edge. However, huge parameter counts and…
MDTransformer: A Hardware-Software Co-Design of Mode-Division Photonic Transformer Accelerator with Inverse-Designed Coherent Crossbar
Solomon Micheal Serunjogi, Rachmad Vidya Wicaksana Putra, Ayat Taha +2
Recently, photonic transformer accelerators (PTAs) have successfully achieved significant speedup and energy efficiency improvements over electronic accelerators for expediting Tra…
DxPTA: An Architecture Design Space Exploration with Optical Dataflow-guided Strategy for HW/SW Co-Design of Photonic Transformer Accelerators
Rachmad Vidya Wicaksana Putra, Solomon Micheal Serunjogi, Mahmoud Rasras +1
Transformer-based networks have emerged as prominent AI models with state-of-the-art performance, which potentially pave the way toward artificial general intelligence (AGI). Howev…