Investigating evidence-based software engineering training and adoption.

Abstract

Background: Evidence-based software engineering (EBSE) could bridge the gap between academia and industry by bringing together academic rigor and research of practical relevance. However, while Systematic Reviews (SRs) were initially introduced to support EBSE, their widespread adoption by researchers contrasts with the limited evidence about EBSE adoption in non-academic contexts. Moreover, the importance of training for embracing evidence-based practice has been recognized in other fields, yet remains relatively understudied within EBSE. Objective: This research aims to investigate how the concepts of EBSE and SRs should be taught to future software engineering (SE) practitioners and to assess EBSE’s role in supporting industry practice. Methodology: The first objective was addressed by reviewing EBSE teaching studies, proposing an EBSE course, conducting an empirical evaluation of the course’s effectiveness, and assessing its impact on the trainees’ working practices. The second objective was approached by examining attitudes toward EBSE among members of a government agency and conducting an EBSE-focused project aimed at solving practical issues within a software company. This project allowed us to assess the outcomes of Rapid Reviews (RRs) —a streamlined form of SRs— in supporting SE practices and to evaluate the EBSE framework efficacy. Given its exploratory nature, the research is grounded on qualitative methods.

Results: Our course, that formalizes EBSE teaching through a set of learning outcomes, received favorable evaluations and demonstrated a beneficial impact on student work practices. Government agency staff acknowledged the utility of EBSE, while practitioners without SE research experience found RR results valuable and reliable than other sources. Nonetheless, using EBSE necessitated a combination of professional and research skills, and limitations in SE evidence required formulating broader research questions and tailoring results to actionable recommendations. Conclusion: This thesis underscores the value of EBSE in fostering collaboration between academia, industry, and government stakeholders. It delineates strategies for teaching and adopting EBSE, while also highlighting challenges that required attention in its application.