559 citations · 824 across the 21 of their papers we have counts for
24 papers
Has LLM Screening Performance Stalled in Software Engineering Systematic Reviews?
Aleksi Huotala, Miikka Kuutila, Mika Mäntylä
Screening in systematic reviews (SRs) is manual and time-consuming. Prior work has explored large language models (LLMs) for automating this step, but LLMs are evolving rapidly, so…
Assessing the Construct Validity of Object-Oriented, Class-Level Code Quality Metrics
Hera Arif, Miikka Kuutila, Paul Ralph
Background: Code quality metrics are intended to measure latent properties of software source code. Although numerous code metrics have been proposed and used, their construct vali…
Understanding LLMs in Title-Abstract Screening: From Disagreements to Recommendations
Mika Mäntylä, Patricia Matsubara, Katia Romero Felizardo +5
Several studies have examined the use of large language models (LLMs) for title-abstract screening in systematic reviews (SRs), reporting mixed accuracy. However, questions of reli…
Staying or Leaving? How Job Satisfaction, Embeddedness and Antecedents Predict Turnover Intentions of Software Professionals
Miikka Kuutila, Paul Ralph, Huilian Sophie Qiu +13
Context: Voluntary turnover is common in the software industry, increasing recruitment and onboarding costs and the risk of losing organizational and tacit knowledge. Objective: Th…
The Software Infrastructure Attitude Scale (SIAS): A Questionnaire Instrument for Measuring Professionals' Attitudes Toward Technical and Sociotechnical Infrastructure
Miikka Kuutila, Paul Ralph, Huilian Sophie Qiu +19
Context: Recent software engineering (SE) research has highlighted the need for sociotechnical research, implying a demand for customized psychometric scales. Objective: We define…
AISysRev -- LLM-based Tool for Title-abstract Screening
Aleksi Huotala, Miikka Kuutila, Olli-Pekka Turtio +2
Conducting systematic reviews is laborious. In the screening or study selection phase, the number of papers can be overwhelming. Recent research has demonstrated that large languag…
SESR-Eval: Dataset for Evaluating LLMs in the Title-Abstract Screening of Systematic Reviews
Aleksi Huotala, Miikka Kuutila, Mika Mäntylä
Background: The use of large language models (LLMs) in the title-abstract screening process of systematic reviews (SRs) has shown promising results, but suffers from limited perfor…
Research Artifacts in Secondary Studies: A Systematic Mapping in Software Engineering
Aleksi Huotala, Miikka Kuutila, Mika Mäntylä
Context: Systematic reviews (SRs) summarize state-of-the-art evidence in science, including software engineering (SE). Objective: Our objective is to evaluate how SRs report resear…
User Personas Improve Social Sustainability by Encouraging Software Developers to Deprioritize Antisocial Features
Bimpe Ayoola, Miikka Kuutila, Rina R. Wehbe +1
Sustainable software development involves creating software in a manner that meets present goals without undermining our ability to meet future goals. In a software engineering con…
What Makes Programmers Laugh? Exploring the Submissions of the Subreddit r/ProgrammerHumor
Miikka Kuutila, Leevi Rantala, Junhao Li +2
Background: Humor is a fundamental part of human communication, with prior work linking positive humor in the workplace to positive outcomes, such as improved performance and job s…
Teaching Software Metrology: The Science of Measurement for Software Engineering
Paul Ralph, Miikka Kuutila, Hera Arif +1
While the methodological rigor of computing research has improved considerably in the past two decades, quantitative software engineering research is hampered by immature measures…
The Promise and Challenges of Using LLMs to Accelerate the Screening Process of Systematic Reviews
Aleksi Huotala, Miikka Kuutila, Paul Ralph +1
Systematic review (SR) is a popular research method in software engineering (SE). However, conducting an SR takes an average of 67 weeks. Thus, automating any step of the SR proces…
Revealing complexities when adult readers engage in the credibility evaluation of social media posts
Miikka Kuutila, Carita Kiili, Reijo Kupiainen +6
The present study investigates the role of source characteristics, evidence quality, crowdsourcing platform, and prior beliefs of the topic in adult readers' credibility evaluation…
Individual Differences Limit Predicting Well-being and Productivity Using Software Repositories: A Longitudinal Industrial Study
Miikka Kuutila, Mika Mäntylä, Maëlick +3
Reports of poor work well-being and fluctuating productivity in software engineering have been reported in both academic and popular sources. Understanding and predicting these iss…
Chat activity is a better predictor than chat sentiment on software developers productivity
Miikka Kuutila, Mika Mäntylä, Maëlick Claes
Recent works have proposed that software developers' positive emotion has a positive impact on software developers' productivity. In this paper we investigate two data sources: dev…
Time Pressure in Software Engineering: A Systematic Review
Miikka Kuutila, Mika Mäntylä, Umar Farooq +1
Large project overruns and overtime work have been reported in the software industry, resulting in additional expense for companies and personal issues for developers. The present…
Using Experience Sampling to link Software Repositories with Emotions and Work Well-Being
Miikka Kuutila, Mika Mäntylä, Maëlick Claes +2
Background: The experience sampling method studies everyday experiences of humans in natural environments. In psychology it has been used to study the relationships between work we…
Towards Identifying Paid Open Source Developers - A Case Study with Mozilla Developers
Maëlick Claes, Mika Mäntylä, Miikka Kuutila +1
Open source development contains contributions from both hired and volunteer software developers. Identification of this status is important when we consider the transferability of…
Do Programmers Work at Night or During the Weekend?
Maëlick Claes, Mika Mäntylä, Miikka Kuutila +1
Abnormal working hours can reduce work health, general well-being, and productivity, independent from a profession. To inform future approaches for automatic stress and overload de…
Abnormal Working Hours: Effect of Rapid Releases and Implications to Work Content
Maëlick Claes, Mika Mäntylä, Miikka Kuutila +1
During the past years, overload at work leading to psychological diseases, such as burnouts, have drawn more public attention. This paper is a preliminary step toward an analysis o…
Bootstrapping a Lexicon for Emotional Arousal in Software Engineering
Mika V. Mäntylä, Nicole Novielli, Filippo Lanubile +2
Emotional arousal increases activation and performance but may also lead to burnout in software development. We present the first version of a Software Engineering Arousal lexicon…
Reviewing Literature on Time Pressure in Software Engineering and Related Professions - Computer Assisted Interdisciplinary Literature Review
Miikka Kuutila, Mika V. Mäntylä, Maëlick Claes +1
During the past years, psychological diseases related to unhealthy work environments, such as burnouts, have drawn more and more public attention. One of the known causes of these…
The Evolution of Sentiment Analysis - A Review of Research Topics, Venues, and Top Cited Papers
Mika Viking Mäntylä, Daniel Graziotin, Miikka Kuutila
Sentiment analysis is one of the fastest growing research areas in computer science, making it challenging to keep track of all the activities in the area. We present a computer-as…
Benchmarking Web-testing - Selenium versus Watir and the Choice of Programming Language and Browser
Miikka Kuutila, Mika Mäntylä, Päivi Raulamo-Jurvanen
Context: Selenium is claimed to be the most popular software test automation tool. Past academic works have mainly neglected testing tools in favor of more methodological topics. O…