2 papers
cs.LG2025
Improving Recursive Transformers with Mixture of LoRAs
Mohammadmahdi Nouriborji, Morteza Rohanian, Omid Rohanian
Parameter sharing in recursive transformers reduces model size but collapses layer-wise expressivity. We propose Mixture of LoRAs (MoL), a lightweight conditional-computation mecha…
cs.CL2024
Rapid Biomedical Research Classification: The Pandemic PACT Advanced Categorisation Engine
Omid Rohanian, Mohammadmahdi Nouriborji, Olena Seminog +11
This paper introduces the Pandemic PACT Advanced Categorisation Engine (PPACE) along with its associated dataset. PPACE is a fine-tuned model developed to automatically classify re…