182 citations · 726 across the 43 of their papers we have counts for
5 papers · 1 filter
Integrated multi-operand optical neurons for scalable and hardware-efficient deep learning
Chenghao Feng, Jiaqi Gu, Hanqing Zhu +7
The optical neural network (ONN) is a promising hardware platform for next-generation neuromorphic computing due to its high parallelism, low latency, and low energy consumption. H…
Lightening-Transformer: A Dynamically-operated Optically-interconnected Photonic Transformer Accelerator
Hanqing Zhu, Jiaqi Gu, Hanrui Wang +7
The wide adoption and significant computing resource of attention-based transformers, e.g., Vision Transformers and large language models (LLM), have driven the demand for efficien…
M3ICRO: Machine Learning-Enabled Compact Photonic Tensor Core based on PRogrammable Multi-Operand Multimode Interference
Jiaqi Gu, Hanqing Zhu, Chenghao Feng +3
Photonic computing shows promise for transformative advancements in machine learning (ML) acceleration, offering ultra-fast speed, massive parallelism, and high energy efficiency.…
Pre-RMSNorm and Pre-CRMSNorm Transformers: Equivalent and Efficient Pre-LN Transformers
Zixuan Jiang, Jiaqi Gu, Hanqing Zhu +1
Transformers have achieved great success in machine learning applications. Normalization techniques, such as Layer Normalization (LayerNorm, LN) and Root Mean Square Normalization…
Domain Wall-Magnetic Tunnel Junction Analog Content Addressable Memory Using Current and Projected Data
Harrison Jin, Hanqing Zhu, Keren Zhu +8
With the rise in in-memory computing architectures to reduce the compute-memory bottleneck, a new bottleneck is present between analog and digital conversion. Analog content-addres…