5 papers
Polish Medical Visual Question Answering: Vision-Language Models Underutilize Visual Evidence
Jakub Pokrywka, Łukasz Grzybowski, Antoni Lasik +3
We introduce a Polish-language medical visual question answering (VQA) benchmark, built from Polish Board Certification Examination questions for licensed physicians and dentists p…
Reassessing High-Performing LLMs on Polish Medical Exams: True Competence or Bias-Driven Performance?
Antoni Lasik, Jakub Pokrywka, Åukasz Grzybowski +7
Large language models (LLMs) in medicine are mainly evaluated using multiple-choice question answering (MCQA), which can overestimate real clinical ability due to guessing strategi…
Polish-English medical knowledge transfer: A new benchmark and results
Åukasz Grzybowski, Jakub Pokrywka, MichaÅ CiesióÅka +2
Large Language Models (LLMs) have demonstrated significant potential in handling specialized tasks, including medical problem-solving. However, most studies predominantly focus on…
Optimizing Retrieval-Augmented Generation of Medical Content for Spaced Repetition Learning
Jeremi I. Kaczmarek, Jakub Pokrywka, Krzysztof Biedalak +2
Advances in Large Language Models revolutionized medical education by enabling scalable and efficient learning solutions. This paper presents a pipeline employing Retrieval-Augment…
Evaluating Transformer Models for Suicide Risk Detection on Social Media
Jakub Pokrywka, Jeremi I. Kaczmarek, Edward J. GorzelaÅczyk
The detection of suicide risk in social media is a critical task with potential life-saving implications. This paper presents a study on leveraging state-of-the-art natural languag…