5 papers
Teacher-Guided One-Shot Pruning via Context-Aware Knowledge Distillation
Md. Samiul Alim, Sharjil Khan, Amrijit Biswas +3
Unstructured pruning remains a powerful strategy for compressing deep neural networks, yet it often demands iterative train-prune-retrain cycles, resulting in significant computati…
Dynamic Temperature Scheduler for Knowledge Distillation
Sibgat Ul Islam, Jawad Ibn Ahad, Fuad Rahman +3
Knowledge Distillation (KD) trains a smaller student model using a large, pre-trained teacher model, with temperature as a key hyperparameter controlling the softness of output pro…
LegalRAG: A Hybrid RAG System for Multilingual Legal Information Retrieval
Muhammad Rafsan Kabir, Rafeed Mohammad Sultan, Fuad Rahman +4
Natural Language Processing (NLP) and computational linguistic techniques are increasingly being applied across various domains, yet their use in legal and regulatory tasks remains…
BanglaDialecto: An End-to-End AI-Powered Regional Speech Standardization
Md. Nazmus Sadat Samin, Jawad Ibn Ahad, Tanjila Ahmed Medha +4
This study focuses on recognizing Bangladeshi dialects and converting diverse Bengali accents into standardized formal Bengali speech. Dialects, often referred to as regional langu…
Empowering Meta-Analysis: Leveraging Large Language Models for Scientific Synthesis
Jawad Ibn Ahad, Rafeed Mohammad Sultan, Abraham Kaikobad +4
This study investigates the automation of meta-analysis in scientific documents using large language models (LLMs). Meta-analysis is a robust statistical method that synthesizes th…