activity
20232026
most citedThe Llama 4 Herd: Architecture, Training, Evaluation, and Deployment Notes

1 citations · 1 across the 11 of their papers we have counts for

collaborators

11 papers

cs.LG2026

Prompt-Driven Exploration: Language as an Exploration Space for VLA Reinforcement Learning

Sunshine Jiang, John Marangola, David Zhang +6

Exploration is essential to RL since a policy cannot improve by repeatedly sampling the behaviors it already prefers. Standard methods inject stochasticity in the action space, but…

cs.SE2026★ 1 cited

The Llama 4 Herd: Architecture, Training, Evaluation, and Deployment Notes

Redacted by arXiv

This document consolidates publicly reported technical details about Metas Llama 4 model family. It summarizes (i) released variants (Scout and Maverick) and the broader herd conte…

cs.CL2025

Jailbreak-Zero: A Path to Pareto Optimal Red Teaming for Large Language Models

Kai Hu, Abhinav Aggarwal, Mehran Khodabandeh +6

This paper introduces Jailbreak-Zero, a novel red teaming methodology that shifts the paradigm of Large Language Model (LLM) safety evaluation from a constrained example-based appr…

cs.AI2025

GTAlign: Game-Theoretic Alignment of LLM Assistants for Social Welfare

Siqi Zhu, David Zhang, Pedro Cisneros-Velarde +1

Large Language Models (LLMs) have achieved remarkable progress in reasoning, yet sometimes produce responses that are suboptimal for users in tasks such as writing, information see…

cs.AI2025

The Challenge of Teaching Reasoning to LLMs Without RL or Distillation

Wei Du, Branislav Kisacanin, George Armstrong +22

Reasoning-capable language models achieve state-of-the-art performance in diverse complex tasks by generating long, explicit Chain-of-Thought (CoT) traces. While recent works show…

cs.CL2025

Domain Gating Ensemble Networks for AI-Generated Text Detection

Arihant Tripathi, Liam Dugan, Charis Gao +6

As state-of-the-art language models continue to improve, the need for robust detection of machine-generated text becomes increasingly critical. However, current state-of-the-art ma…

cs.LG2025

RL-finetuning LLMs from on- and off-policy data with a single algorithm

Yunhao Tang, Taco Cohen, David W. Zhang +2

We introduce a novel reinforcement learning algorithm (AGRO, for Any-Generation Reward Optimization) for fine-tuning large-language models. AGRO leverages the concept of generation…

cs.LG2025

Soft Policy Optimization: Online Off-Policy RL for Sequence Models

Taco Cohen, David W. Zhang, Kunhao Zheng +3

RL-based post-training of language models is almost exclusively done using on-policy methods such as PPO. These methods cannot learn from arbitrary sequences such as those produced…

cs.LG2024

Ada-HGNN: Adaptive Sampling for Scalable Hypergraph Neural Networks

Shuai Wang, David W. Zhang, Jia-Hong Huang +4

Hypergraphs serve as an effective model for depicting complex connections in various real-world scenarios, from social to biological networks. The development of Hypergraph Neural…

cs.CV2023

Diffusing More Objects for Semi-Supervised Domain Adaptation with Less Labeling

Leander van den Heuvel, Gertjan Burghouts, David W. Zhang +2

For object detection, it is possible to view the prediction of bounding boxes as a reverse diffusion process. Using a diffusion model, the random bounding boxes are iteratively ref…

cs.DS2023

Sorting from Crowdsourced Comparisons using Expert Verifications

Ellen Vitercik, Manolis Zampetakis, David Zhang

We introduce a novel noisy sorting model motivated by the Just Noticeable Difference (JND) model from experimental psychology. The goal of our model is to capture the low quality o…