5 citations · 9 across the 9 of their papers we have counts for
11 papers
Fine-Tuning Vision-Language Models for Multimodal Polymer Property Prediction
An Vuong, Minh-Hao Van, Prateek Verma +2
Vision-Language Models (VLMs) have shown strong performance in tasks like visual question answering and multimodal text generation, but their effectiveness in scientific domains su…
Thinking While Listening: Simple Test Time Scaling For Audio Classification
Prateek Verma, Mert Pilanci
We propose a framework that enables neural models to "think while listening" to everyday sounds, thereby enhancing audio classification performance. Motivated by recent advances in…
A Survey of AI for Materials Science: Foundation Models, LLM Agents, Datasets, and Tools
Minh-Hao Van, Prateek Verma, Chen Zhao +1
Foundation models (FMs) are catalyzing a transformative shift in materials science (MatSci) by enabling scalable, general-purpose, and multimodal AI systems for scientific discover…
Semantic De-boosting in e-commerce Query Autocomplete
Adithya Rajan, Weiqi Tong, Greg Sharp +2
In ecommerce search, query autocomplete plays a critical role to help users in their shopping journey. Often times, query autocomplete presents users with semantically similar quer…
Large Language Models Implicitly Learn to See and Hear Just By Reading
Prateek Verma, Mert Pilanci
This paper presents a fascinating find: By training an auto-regressive LLM model on text tokens, the text model inherently develops internally an ability to understand images and a…
Whisper-GPT -- Continuous Discrete Hybrid Representation Language Models For Speech And Music
Prateek Verma
We propose WHISPER-GPT: A generative large language model (LLM) for speech and music that allows us to work with continuous audio representations and discrete tokens simultaneously…
Adaptive Large Language Models By Layerwise Attention Shortcuts
Prateek Verma, Mert Pilanci
Transformer architectures are the backbone of the modern AI revolution. However, they are based on simply stacking the same blocks in dozens of layers and processing information se…
Wavelet GPT: Wavelet Inspired Large Language Models
Prateek Verma
Large Language Models (LLMs) have ushered in a new wave of artificial intelligence advancements impacting every scientific field and discipline. We live in a world where most of th…
Towards Signal Processing In Large Language Models
Prateek Verma, Mert Pilanci
This paper introduces the idea of applying signal processing inside a Large Language Model (LLM). With the recent explosion of generative AI, our work can help bridge two fields to…
Beyond Human Vision: The Role of Large Vision Language Models in Microscope Image Analysis
Prateek Verma, Minh-Hao Van, Xintao Wu
Vision language models (VLMs) have recently emerged and gained the spotlight for their ability to comprehend the dual modality of image and textual data. VLMs such as LLaVA, ChatGP…
On Large Visual Language Models for Medical Imaging Analysis: An Empirical Study
Minh-Hao Van, Prateek Verma, Xintao Wu
Recently, large language models (LLMs) have taken the spotlight in natural language processing. Further, integrating LLMs with vision enables the users to explore emergent abilitie…