14 papers
ForkGRPO: Efficient Exploration and Fine-Grained Credit Assignment for Diffusion Language Models
Zhaoyan Jia, Chengwei Zhou, Gourav Datta +1
Diffusion large language models (dLLMs) have advanced rapidly, yet strengthening their reasoning through reinforcement learning (RL) remains an open challenge. Any-order generation…
Hardware-Aware Learned Representation Compression for Distributed In-Sensor Vision
Chengwei Zhou, Abu Masum, Xuming Chen +7
In-sensor computing reduces the cost of transmitting high-resolution image data by performing early-stage processing near the sensor. However, the logic chip integrated with a CMOS…
A Time-Encoded Analog Photonic Interposer for Energy-EfficientIntegration of Analog Vision Sensors and Analog Accelerators
Subhradip Chakraborty, Zihan Yin, Xuming Chen +3
This work introduces a time-encoded analog photonic interposer that enables long-distance, high-fidelity transport of analog signals between spatially separated chiplets. Unlike pr…
FrequencyFormer: A Co-Designed Sensor-to-Processor Pipeline for Frequency-Domain Vision Transformer Inference
Chengwei Zhou, Ovishake Sen, Xuming Chen +5
Deploying vision transformers (ViTs) on sensor-edge systems is limited not only by on-device compute, but also by the energy and bandwidth required to transmit high-dimensional ima…
Sense Less, Infer More: Agentic Multimodal Transformers for Edge Medical Intelligence
Chengwei Zhou, Zhaoyan Jia, Haotian Yu +6
Edge-based multimodal medical monitoring requires models that balance diagnostic accuracy with severe energy constraints. Continuous acquisition of ECG, PPG, EMG, and IMU streams r…
Light-Bound Transformers: Hardware-Anchored Robustness for Silicon-Photonic Computer Vision Systems
Xuming Chen, Deniz Najafi, Chengwei Zhou +6
Deploying Vision Transformers (ViTs) on near-sensor analog accelerators demands training pipelines that are explicitly aligned with device-level noise and energy constraints. We in…
Toward Guarantees for Clinical Reasoning in Vision Language Models via Formal Verification
Vikash Singh, Debargha Ganguly, Haotian Yu +5
Vision-language models (VLMs) show promise in drafting radiology reports, yet they frequently suffer from logical inconsistencies, generating diagnostic impressions unsupported by…
RT-NeuS: Towards Real-Time Neuro-Symbolic Video Understanding via Adaptive Temporal Verification
Shawn Liang, Sahil Shah, Chengwei Zhou +5
Long-form video question answering (LVQA) requires answering natural-language queries about videos spanning minutes to hours, demanding temporal reasoning across thousands of frame…
Rethinking Vision Transformer Depth via Structural Reparameterization
Chengwei Zhou, Vipin Chaudhary, Gourav Datta
The computational overhead of Vision Transformers in practice stems fundamentally from their deep architectures, yet existing acceleration strategies have primarily targeted algori…
Learning Scalable Temporal Representations in Spiking Neural Networks Without Labels
Chengwei Zhou, Gourav Datta
Spiking neural networks (SNNs) exhibit temporal, sparse, and event-driven dynamics that make them appealing for efficient inference. However, extending these models to self-supervi…
BladderFormer: A Streaming Transformer for Real-Time Urological State Monitoring
Chengwei Zhou, Steve Majerus, Gourav Datta
Bladder pressure monitoring systems are increasingly vital in diagnosing and managing urinary tract dysfunction. Existing solutions rely heavily on hand-crafted features and shallo…
Opto-ViT: Architecting a Near-Sensor Region of Interest-Aware Vision Transformer Accelerator with Silicon Photonics
Mehrdad Morsali, Chengwei Zhou, Deniz Najafi +7
Vision Transformers (ViTs) have emerged as a powerful architecture for computer vision tasks due to their ability to model long-range dependencies and global contextual relationshi…
OASIS: Optimized Lightweight Autoencoder System for Distributed In-Sensor computing
Chengwei Zhou, Sreetama Sarkar, Yuming Li +5
In-sensor computing, which integrates computation directly within the sensor, has emerged as a promising paradigm for machine vision applications such as AR/VR and smart home syste…
A Pathway to Near Tissue Computing through Processing-in-CTIA Pixels for Biomedical Applications
Zihan Yin, Subhradip Chakraborty, Ankur Singh +3
Near-tissue computing requires sensor-level processing of high-resolution images, essential for real-time biomedical diagnostics and surgical guidance. To address this need, we int…