9 citations · 17 across the 4 of their papers we have counts for
4 papers
Au-M-ol: A Unified Model for Medical Audio and Language Understanding
Meizhu Liu, Nistha Mitra, Paul Li +3
In this work, we present Au-M-ol, a novel multimodal architecture that extends Large Language Models (LLMs) with audio processing. It is designed to improve performance on clinical…
Attention over pre-trained Sentence Embeddings for Long Document Classification
Amine Abdaoui, Sourav Dutta
Despite being the current de-facto models in most NLP tasks, transformers are often limited to short sequences due to their quadratic attention complexity on the number of tokens.…
DziriBERT: a Pre-trained Language Model for the Algerian Dialect
Amine Abdaoui, Mohamed Berrimi, Mourad Oussalah +1
Pre-trained transformers are now the de facto models in Natural Language Processing given their state-of-the-art results in many tasks and languages. However, most of the current m…
Load What You Need: Smaller Versions of Multilingual BERT
Amine Abdaoui, Camille Pradel, Grégoire Sigel
Pre-trained Transformer-based models are achieving state-of-the-art results on a variety of Natural Language Processing data sets. However, the size of these models is often a draw…