1 citations · 1 across the 4 of their papers we have counts for
4 papers
LLM Benchmark Datasets Should Be Contamination-Resistant
Ali Al-Lawati, Jason Lucas, Dongwon Lee +1
Benchmark datasets are critical for reproducible, reliable, and discriminative evaluation of LLMs. However, recent studies reveal that many benchmark datasets are included in pretr…
Moderation by Interrogation: Uncovering Concealed Intent in Agent Social Networks
Ali Al-Lawati, Nafis Tripto, Abolfazl Ansari +4
The emergence of multi-agent systems introduces novel moderation challenges that extend beyond content filtering. Agents with may contribute content tha…
Graph-based Molecular In-context Learning Grounded on Morgan Fingerprints
Ali Al-Lawati, Jason Lucas, Zhiwei Zhang +2
In-context learning (ICL) effectively conditions large language models (LLMs) for molecular tasks, such as property prediction and molecule captioning, by embedding carefully selec…
Semantic Captioning: Benchmark Dataset and Graph-Aware Few-Shot In-Context Learning for SQL2Text
Ali Al-Lawati, Jason Lucas, Prasenjit Mitra
Large Language Models (LLMs) have demonstrated remarkable performance in various NLP tasks, including semantic parsing, which translates natural language into formal code represent…