3 papers
cs.CL2025
Benchmarking LLMs on the Semantic Overlap Summarization Task
John Salvador, Naman Bansal, Mousumi Akter +3
Semantic Overlap Summarization (SOS) is a constrained multi-document summarization task, where the constraint is to capture the common/overlapping information between two alternati…
cs.CL2025
Large Language Models for IT Automation Tasks: Are We There Yet?
Md Mahadi Hassan, John Salvador, Akond Rahman +1
LLMs show promise in code generation, yet their effectiveness for IT automation tasks, particularly for tools like Ansible, remains understudied. Existing benchmarks rely primarily…
cs.CL2025
LLMs as Meta-Reviewers' Assistants: A Case Study
Eftekhar Hossain, Sanjeev Kumar Sinha, Naman Bansal +11
One of the most important yet onerous tasks in the academic peer-reviewing process is composing meta-reviews, which involves assimilating diverse opinions from multiple expert peer…