3 citations · 5 across the 9 of their papers we have counts for
10 papers
Beyond Routing Weights: Faithful Response-Level Interpretation of Mixture-of-Experts Reward Models via Contribution Contrast
Yifan Wang, Jinyi Mu, Mayank Jobanputra +4
Reward models are central to learning from human preferences, yet identifying what drives their predictions remains challenging. Recent sparse Mixture-of-Experts (MoE) reward model…
Sparse Mixture-of-Experts Reward Models Learn Interpretable and Specialized Experts for Personalized Preference Modeling
Yifan Wang, Jinyi Mu, Mayank Jobanputra +5
Preference modeling plays a central role in reinforcement learning from human feedback (RLHF), enabling large language models (LLMs) to align with human values. However, most exist…
Can LLMs subtract numbers?
Mayank Jobanputra, Nils Philipp Walter, Maitrey Mehta +7
We present a systematic study of subtraction in large language models (LLMs). While prior benchmarks emphasize addition and multiplication, subtraction has received comparatively l…
Bridging Fairness and Explainability: Can Input-Based Explanations Promote Fairness in Hate Speech Detection?
Yifan Wang, Mayank Jobanputra, Ji-Ung Lee +3
Natural language processing (NLP) models often replicate or amplify social bias from training data, raising concerns about fairness. At the same time, their black-box nature makes…
B-cos LM: Efficiently Transforming Pre-trained Language Models for Improved Explainability
Yifan Wang, Sukrut Rao, Ji-Ung Lee +2
Post-hoc explanation methods for black-box models often struggle with faithfulness and human interpretability due to the lack of explainability in current neural architectures. Mea…
RSA-Control: A Pragmatics-Grounded Lightweight Controllable Text Generation Framework
Yifan Wang, Vera Demberg
Despite significant advancements in natural language generation, controlling language models to produce texts with desired attributes remains a formidable challenge. In this work,…
SciNews: From Scholarly Complexities to Public Narratives -- A Dataset for Scientific News Report Generation
Dongqi Liu, Yifan Wang, Jia Loy +1
Scientific news reports serve as a bridge, adeptly translating complex research articles into reports that resonate with the broader public. The automated generation of such narrat…
Incorporating Distributions of Discourse Structure for Long Document Abstractive Summarization
Dongqi Liu, Yifan Wang, Vera Demberg
For text summarization, the role of discourse structure is pivotal in discerning the core content of a text. Regrettably, prior studies on incorporating Rhetorical Structure Theory…
Unsupervised Mandarin-Cantonese Machine Translation
Megan Dare, Valentina Fajardo Diaz, Averie Ho Zoen So +2
Advancements in unsupervised machine translation have enabled the development of machine translation systems that can translate between languages for which there is not an abundanc…
Automatic Generation of German Drama Texts Using Fine Tuned GPT-2 Models
Mariam Bangura, Kristina Barabashova, Anna Karnysheva +2
This study is devoted to the automatic generation of German drama texts. We suggest an approach consisting of two key steps: fine-tuning a GPT-2 model (the outline model) to genera…