activity
20232026
most citedLanguage Is Not All You Need: Aligning Perception with Language Models

164 citations · 174 across the 6 of their papers we have counts for

collaborators

7 papers

cs.CL2026

Rubric Rewards from Item Response Theory

Milad Yazdani, Yaser Souri, Xiren Zhou +4

Many language tasks have no single answer that can be checked automatically. Rubrics provide criteria for judging responses to these tasks. For reinforcement learning, the resultin…

cs.LG2026

Consistent Diffusion Language Models

Hasan Amin, Yuan Gao, Yaser Souri +4

Diffusion language models (DLMs) are an attractive alternative to autoregressive models because they promise sublinear-time, parallel generation, yet practical gains remain elusive…

cs.LG2025

WebSTAR: Scalable Data Synthesis for Computer Use Agents with Step-Level Filtering

Yifei He, Pranit Chawla, Yaser Souri +2

Computer use agents (CUAs) can operate real-world digital interfaces but remain difficult to train due to the high cost of graphical user interface (GUI) interaction and the scarci…

cs.CL2025★ 7 cited

Phi-4-Mini Technical Report: Compact yet Powerful Multimodal Language Models via Mixture-of-LoRAs

Microsoft, :, Abdelrahman Abouelenin +73

We introduce Phi-4-Mini and Phi-4-Multimodal, compact yet highly capable language and multimodal models. Phi-4-Mini is a 3.8-billion-parameter language model trained on high-qualit…

cs.CV2023★ 1 cited

DUBLIN -- Document Understanding By Language-Image Network

Kriti Aggarwal, Aditi Khandelwal, Kumar Tanmay +7

Visual document understanding is a complex task that involves analyzing both the text and the visual elements in document images. Existing models often rely on manual feature engin…

cs.CV2023★ 2 cited

ArK: Augmented Reality with Knowledge Interactive Emergent Ability

Qiuyuan Huang, Jae Sung Park, Abhinav Gupta +8

Despite the growing adoption of mixed reality and interactive AI agents, it remains challenging for these systems to generate high quality 2D/3D scenes in unseen environments. The…

cs.CL2023★ 164 cited

Language Is Not All You Need: Aligning Perception with Language Models

Shaohan Huang, Li Dong, Wenhui Wang +15

A big convergence of language, multimodal perception, action, and world modeling is a key step toward artificial general intelligence. In this work, we introduce Kosmos-1, a Multim…