A Framework for Minimising Java Microbenchmark Suites - A Metric-Based Approach
Ladda ner
Typ
Examensarbete för masterexamen
Master's Thesis
Master's Thesis
Program
Software engineering and technology (MPSOF), MSc
Publicerad
2024
Författare
Darin Nordqvist, Filip
Otterlind, Rasmus
Modellbyggare
Tidskriftstitel
ISSN
Volymtitel
Utgivare
Sammanfattning
Performance is an important non-functional requirement. The success of software projects is highly dependent on the adequate performance of the software. However, one fundamental problem with performance testing is that it can become immensely time-consuming to conduct. In this paper, several different code metrics were explored and used for conducting test case minimization (TCM) of Java Microbenchmark Harness (JMH) suites. The microbenchmark suites were created with a tool called ju2jmh, which creates microbenchmark suites based on already existing unit testing suites of a project. The metrics used for conducting TCM were lines of code (LOC), loop count, cyclomatic complexity, and the combination of these metrics. The results indicate that suites derived using LOC and loop count performed worse than randomly sampled suites, while suites derived from the cyclomatic metric and the combination of LOC, loop count, and cyclomatic complexity performed similar or slightly worse than randomly sampled suites. Furthermore, it is not infeasible to assume that if these metrics were refined by utilising dynamic techniques, some of them could potentially outperform randomly sampled suites consistently.
Beskrivning
Ämne/nyckelord
Performance testing , Java Michrobenchmark Harness , Test case minimisation , Artificial slowdowns , Code coverage , Computational complexity , Cyclomatic complexity , Static code analysis