15 citations · 40 across the 9 of their papers we have counts for
4 papers · 1 filter
Fairness-Aware Structured Pruning in Transformers
Abdelrahman Zayed, Goncalo Mordido, Samira Shabanian +2
The increasing size of large language models (LLMs) has introduced challenges in their training and inference. Removing model components is perceived as a solution to tackle the la…
Successor Features for Efficient Multisubject Controlled Text Generation
Meng Cao, Mehdi Fatemi, Jackie Chi Kit Cheung +1
While large language models (LLMs) have achieved impressive performance in generating fluent and realistic text, controlling the generated text so that it exhibits properties such…
Should We Attend More or Less? Modulating Attention for Fairness
Abdelrahman Zayed, Goncalo Mordido, Samira Shabanian +1
The advances in natural language processing (NLP) pose both opportunities and challenges. While recent progress enables the development of high-performing models for a variety of t…
Systematic Rectification of Language Models via Dead-end Analysis
Meng Cao, Mehdi Fatemi, Jackie Chi Kit Cheung +1
With adversarial or otherwise normal prompts, existing large language models (LLM) can be pushed to generate toxic discourses. One way to reduce the risk of LLMs generating undesir…