40 citations · 198 across the 27 of their papers we have counts for
27 papers · 1 filter
OpenCodeReasoning: Advancing Data Distillation for Competitive Coding
Wasi Uddin Ahmad, Sean Narenthiran, Somshubra Majumdar +5
Since the advent of reasoning-based large language models, many have found great success from distilling reasoning capabilities into student models. Such techniques have significan…
On Leveraging Encoder-only Pre-trained Language Models for Effective Keyphrase Generation
Di Wu, Wasi Uddin Ahmad, Kai-Wei Chang
This study addresses the application of encoder-only Pre-trained Language Models (PLMs) in keyphrase generation (KPG) amidst the broader availability of domain-tailored encoder-onl…
Rethinking Model Selection and Decoding for Keyphrase Generation with Pre-trained Sequence-to-Sequence Models
Di Wu, Wasi Uddin Ahmad, Kai-Wei Chang
Keyphrase Generation (KPG) is a longstanding task in NLP with widespread applications. The advent of sequence-to-sequence (seq2seq) pre-trained language models (PLMs) has ushered i…
Pre-trained Language Models for Keyphrase Generation: A Thorough Empirical Study
Di Wu, Wasi Uddin Ahmad, Kai-Wei Chang
Neural models that do not rely on pre-training have excelled in the keyphrase generation task with large annotated datasets. Meanwhile, new approaches have incorporated pre-trained…
PLUE: Language Understanding Evaluation Benchmark for Privacy Policies in English
Jianfeng Chi, Wasi Uddin Ahmad, Yuan Tian +1
Privacy policies provide individuals with information about their rights and how their personal information is handled. Natural language understanding (NLU) technologies can suppor…
CoCoMIC: Code Completion By Jointly Modeling In-file and Cross-file Context
Yangruibo Ding, Zijian Wang, Wasi Uddin Ahmad +5
While pre-trained language models (LM) for code have achieved great success in code completion, they generate code conditioned only on the contents within the file, i.e., in-file c…
ContraCLM: Contrastive Learning For Causal Language Model
Nihal Jain, Dejiao Zhang, Wasi Uddin Ahmad +9
Despite exciting progress in causal language models, the expressiveness of the representations is largely limited due to poor discrimination ability. To remedy this issue, we prese…
Summarize and Generate to Back-translate: Unsupervised Translation of Programming Languages
Wasi Uddin Ahmad, Saikat Chakraborty, Baishakhi Ray +1
Back-translation is widely known for its effectiveness in neural machine translation when there is little to no parallel data. In this approach, a source-to-target model is coupled…
BanglaNLG and BanglaT5: Benchmarks and Resources for Evaluating Low-Resource Natural Language Generation in Bangla
Abhik Bhattacharjee, Tahmid Hasan, Wasi Uddin Ahmad +1
This work presents BanglaNLG, a comprehensive benchmark for evaluating natural language generation (NLG) models in Bangla, a widely spoken yet low-resource language. We aggregate s…
Retrieval Enhanced Data Augmentation for Question Answering on Privacy Policies
Md Rizwan Parvez, Jianfeng Chi, Wasi Uddin Ahmad +2
Prior studies in privacy policies frame the question answering (QA) task as identifying the most relevant text segment or a list of sentences from a policy document given a user qu…
Representation Learning for Resource-Constrained Keyphrase Generation
Di Wu, Wasi Uddin Ahmad, Sunipa Dev +1
State-of-the-art keyphrase generation methods generally depend on large annotated datasets, limiting their performance in domains with limited annotated data. To overcome this chal…
CrossSum: Beyond English-Centric Cross-Lingual Summarization for 1,500+ Language Pairs
Abhik Bhattacharjee, Tahmid Hasan, Wasi Uddin Ahmad +3
We present CrossSum, a large-scale cross-lingual summarization dataset comprising 1.68 million article-summary samples in 1,500+ language pairs. We create CrossSum by aligning para…
Syntax-augmented Multilingual BERT for Cross-lingual Transfer
Wasi Uddin Ahmad, Haoran Li, Kai-Wei Chang +1
In recent years, we have seen a colossal effort in pre-training multilingual text encoders using large-scale corpora in many languages to facilitate cross-lingual transfer learning…
CoDesc: A Large Code-Description Parallel Dataset
Masum Hasan, Tanveer Muttaqueen, Abdullah Al Ishtiaq +6
Translation between natural language and source code can help software development by enabling developers to comprehend, ideate, search, and write computer programs in natural lang…
Unified Pre-training for Program Understanding and Generation
Wasi Uddin Ahmad, Saikat Chakraborty, Baishakhi Ray +1
Code summarization and generation empower conversion between programming language (PL) and natural language (NL), while code translation avails the migration of legacy code from on…
Improving Zero-Shot Cross-Lingual Transfer Learning via Robust Training
Kuan-Hao Huang, Wasi Uddin Ahmad, Nanyun Peng +1
Pre-trained multilingual language encoders, such as multilingual BERT and XLM-R, show great potential for zero-shot cross-lingual transfer. However, these multilingual encoders do…
Text2App: A Framework for Creating Android Apps from Text Descriptions
Masum Hasan, Kazi Sajeed Mehrab, Wasi Uddin Ahmad +1
We present Text2App -- a framework that allows users to create functional Android applications from natural language specifications. The conventional method of source code generati…
BanglaBERT: Language Model Pretraining and Benchmarks for Low-Resource Language Understanding Evaluation in Bangla
Abhik Bhattacharjee, Tahmid Hasan, Wasi Uddin Ahmad +5
In this work, we introduce BanglaBERT, a BERT-based Natural Language Understanding (NLU) model pretrained in Bangla, a widely spoken yet low-resource language in the NLP literature…
Intent Classification and Slot Filling for Privacy Policies
Wasi Uddin Ahmad, Jianfeng Chi, Tu Le +3
Understanding privacy policies is crucial for users as it empowers them to learn about the information that matters to them. Sentences written in a privacy policy document explain…
Simple or Complex? Learning to Predict Readability of Bengali Texts
Susmoy Chakraborty, Mir Tafseer Nayeem, Wasi Uddin Ahmad
Determining the readability of a text is the first step to its simplification. In this paper, we present a readability analysis tool capable of analyzing text written in the Bengal…
PolicyQA: A Reading Comprehension Dataset for Privacy Policies
Wasi Uddin Ahmad, Jianfeng Chi, Yuan Tian +1
Privacy policy documents are long and verbose. A question answering (QA) system can assist users in finding the information that is relevant and important to them. Prior studies in…
GATE: Graph Attention Transformer Encoder for Cross-lingual Relation and Event Extraction
Wasi Uddin Ahmad, Nanyun Peng, Kai-Wei Chang
Recent progress in cross-lingual relation and event extraction use graph convolutional networks (GCNs) with universal dependency parses to learn language-agnostic sentence represen…
Select, Extract and Generate: Neural Keyphrase Generation with Layer-wise Coverage Attention
Wasi Uddin Ahmad, Xiao Bai, Soomin Lee +1
Natural language processing techniques have demonstrated promising results in keyphrase generation. However, one of the major challenges in \emph{neural} keyphrase generation is pr…
Cross-lingual Dependency Parsing with Unlabeled Auxiliary Languages
Wasi Uddin Ahmad, Zhisong Zhang, Xuezhe Ma +2
Cross-lingual transfer learning has become an important weapon to battle the unavailability of annotated resources for low-resource languages. One of the fundamental techniques to…