6 citations · 18 across the 11 of their papers we have counts for
12 papers
Old Ideas, Novel Problems: The Instability of LLM-Based Novelty Evaluation
Noy Sternlicht, Simra Shahid, Peter Jansen +3
AI-based ideation systems are often evaluated on the novelty of their ideas, and that judgment is increasingly delegated to large language models. Such judges are typically built a…
Literature-Grounded Novelty Assessment of Scientific Ideas
Simra Shahid, Marissa Radensky, Raymond Fok +3
Automated scientific idea generation systems have made remarkable progress, yet the automatic evaluation of idea novelty remains a critical and underexplored challenge. Manual eval…
Towards Operationalizing Right to Data Protection
Abhinav Java, Simra Shahid, Chirag Agarwal
The widespread practice of indiscriminate data scraping to fine-tune language models (LMs) raises significant legal and ethical concerns, particularly regarding compliance with dat…
CoPrompter: User-Centric Evaluation of LLM Instruction Alignment for Improved Prompt Engineering
Ishika Joshi, Simra Shahid, Shreeya Venneti +5
Ensuring large language models' (LLMs) responses align with prompt instructions is crucial for application development. Based on our formative study with industry professionals, th…
Human-LLM Compound System for Scientific Ideation through Facet Recombination and Novelty Evaluation
Marissa Radensky, Simra Shahid, Raymond Fok +3
The scientific ideation process often involves blending facets of existing papers to create new ideas. We contribute Scideator, the first human-LLM system for facet-based scientifi…
Thinking Fair and Slow: On the Efficacy of Structured Prompts for Debiasing Language Models
Shaz Furniturewala, Surgan Jandial, Abhinav Java +4
Existing debiasing techniques are typically training-based or require access to the model's internals and output distributions, so they are inaccessible to end-users looking to ada…
LEAST: "Local" text-conditioned image style transfer
Silky Singh, Surgan Jandial, Simra Shahid +1
Text-conditioned style transfer enables users to communicate their desired artistic styles through text descriptions, offering a new and expressive means of achieving stylization.…
All Should Be Equal in the Eyes of Language Models: Counterfactually Aware Fair Text Generation
Pragyan Banerjee, Abhinav Java, Surgan Jandial +4
Fairness in Language Models (LMs) remains a longstanding challenge, given the inherent biases in training data that can be perpetuated by models and affect the downstream tasks. Re…
HyHTM: Hyperbolic Geometry based Hierarchical Topic Models
Simra Shahid, Tanay Anand, Nikitha Srikanth +3
Hierarchical Topic Models (HTMs) are useful for discovering topic hierarchies in a collection of documents. However, traditional HTMs often produce hierarchies where lowerlevel top…
Devising Malware Characterstics using Transformers
Simra Shahid, Tanmay Singh, Yash Sharma +1
With the increasing number of cybersecurity threats, it becomes more difficult for researchers to skim through the security reports for malware analysis. There is a need to be able…
Suggestion Mining from Online Reviews using ULMFiT
Sarthak Anand, Debanjan Mahata, Kartik Aggarwal +6
In this paper we present our approach and the system description for Sub Task A of SemEval 2019 Task 9: Suggestion Mining from Online Reviews and Forums. Given a sentence, the task…
Identifying Offensive Posts and Targeted Offense from Twitter
Haimin Zhang, Debanjan Mahata, Simra Shahid +5
In this paper we present our approach and the system description for Sub-task A and Sub Task B of SemEval 2019 Task 6: Identifying and Categorizing Offensive Language in Social Med…