Showing cs.CLShow all
3 papers · 1 filter
cs.CL2025
Fine-Tuning Causal LLMs for Text Classification: Embedding-Based vs. Instruction-Based Approaches
Amirhossein Yousefiramandi, Ciaran Cooney
We explore efficient strategies to fine-tune decoder-only Large Language Models (LLMs) for downstream text classification under resource constraints. Two approaches are investigate…
cs.CL2025
Patent Language Model Pretraining with ModernBERT
Amirhossein Yousefiramandi, Ciaran Cooney
Transformer-based language models such as BERT have become foundational in NLP, yet their performance degrades in specialized domains like patents, which contain long, technical, a…
cs.CL2022
Unimodal and Multimodal Representation Training for Relation Extraction
Ciaran Cooney, Rachel Heyburn, Liam Madigan +3
Multimodal integration of text, layout and visual information has achieved SOTA results in visually rich document understanding (VrDU) tasks, including relation extraction (RE). Ho…