3 papers
cs.CR2025
DFIR-Metric: A Benchmark Dataset for Evaluating Large Language Models in Digital Forensics and Incident Response
Bilel Cherif, Tamas Bisztray, Richard A. Dubniczky +3
Digital Forensics and Incident Response (DFIR) involves analyzing digital evidence to support legal investigations. Large Language Models (LLMs) offer new opportunities in DFIR tas…
cs.CR2025
CASTLE: Benchmarking Dataset for Static Code Analyzers and LLMs towards CWE Detection
Richard A. Dubniczky, Krisztofer Zoltán Horvát, Tamás Bisztray +3
Identifying vulnerabilities in source code is crucial, especially in critical software components. Existing methods such as static analysis, dynamic analysis, formal verification,…
cs.AI2024
Dynamic Intelligence Assessment: Benchmarking LLMs on the Road to AGI with a Focus on Model Confidence
Norbert Tihanyi, Tamas Bisztray, Richard A. Dubniczky +11
As machine intelligence evolves, the need to test and compare the problem-solving abilities of different AI models grows. However, current benchmarks are often simplistic, allowing…