1 citations · 1 across the 3 of their papers we have counts for
4 papers
Improving Recursive Transformers with Mixture of LoRAs
Mohammadmahdi Nouriborji, Morteza Rohanian, Omid Rohanian
Parameter sharing in recursive transformers reduces model size but collapses layer-wise expressivity. We propose Mixture of LoRAs (MoL), a lightweight conditional-computation mecha…
Efficient Interleaved Speech Modeling through Knowledge Distillation
Mohammadmahdi Nouriborji, Morteza Rohanian
Current speech language models exceed the size and latency constraints of many deployment environments. We build compact, expressive speech generation models through layer-aligned…
On the Effectiveness of Compact Biomedical Transformers
Omid Rohanian, Mohammadmahdi Nouriborji, Samaneh Kouchaki +1
Language models pre-trained on biomedical corpora, such as BioBERT, have recently shown promising results on downstream biomedical tasks. Many existing pre-trained models, on the o…
Nowruz at SemEval-2022 Task 7: Tackling Cloze Tests with Transformers and Ordinal Regression
Mohammadmahdi Nouriborji, Omid Rohanian, David Clifton
This paper outlines the system using which team Nowruz participated in SemEval 2022 Task 7 Identifying Plausible Clarifications of Implicit and Underspecified Phrases for both subt…