No Access

Investigating the Effect of Aspect-Oriented Refactoring on the Unit Testing Effort of Classes: An Empirical Evaluation

Software Engineering Research Laboratory, Department of Mathematics and Computer Science, University of Quebec, Trois-Rivières, Quebec, Canada

E-mail Address: Mourad.Badri@uqtr.ca

Corresponding author.

Search for more papers by this author

Aymen Kout

Software Engineering Research Laboratory, Department of Mathematics and Computer Science, University of Quebec, Trois-Rivières, Quebec, Canada

E-mail Address: Aymen.Kout@uqtr.ca

Search for more papers by this author

, and

Linda Badri

Software Engineering Research Laboratory, Department of Mathematics and Computer Science, University of Quebec, Trois-Rivières, Quebec, Canada

E-mail Address: Linda.Badri@uqtr.ca

Search for more papers by this author

https://doi.org/10.1142/S0218194017500280Cited by:1 (Source: Crossref)

Abstract

This paper aims at investigating empirically the effect of aspect-oriented (AO) refactoring on the unit testability of classes in object-oriented software. The unit testability of classes has been addressed from the perspective of the unit testing effort, and particularly from the perspective of the unit test cases (TCs) construction. We investigated, in fact, different research questions: (1) the impact of AO refactoring on source code attributes (size, complexity, coupling, cohesion and inheritance), attributes that are mostly related to the unit testability of classes, (2) the impact of AO refactoring on unit test code attributes (size, assertions, invocations and data creation), attributes that are indicators of the effort involved to write the code of unit TCs, and (3) the relationships between the variations observed after AO refactoring in both source code and unit test code attributes. We used in the study different techniques: correlation analysis, statistical tests and linear regression. We performed an empirical evaluation using data collected from three well-known open source (Java) software systems (JHOTDRAW, HSQLBD and PETSTORE) that have been refactored using AO programming (AspectJ). Results suggest that: (1) overall, the effort involved in the construction of unit TCs of refactored classes has been reduced, (2) the variations of source code attributes have more impact on methods invocation between unit TCs, and finally (3) the variations of unit test code attributes are more influenced by the variation of the complexity of refactored classes compared to the other class attributes.

Keywords:

References

1. M. Fowler , Refactoring: Improving the Design of Existing Code (Addison Wesley, 1999). Google Scholar
2. D. Advani, Y. Hassoun and S. Consell, Extracting refactoring trends from open-source software and a possible solution to the ‘Related Refactoring’ conundrum, SAC, 2006. Google Scholar
3. G. Kickzales et al., Aspect oriented programming, in Proc. European Conf. Object-Oriented Programming, 1997, pp. 220–242. Google Scholar
4. M. Sarmad Ali, M. A. Babar, L. Chen and K. J. Stol , A systematic review of comparative evidence of aspect-oriented programming, Inf. Softw. Technol., 52 (2010) 1204–1216. Crossref, Web of Science, Google Scholar
5. T. Mens and T. Tourwé , A survey of software refactoring, IEEE Trans. Softw. Eng. 30 (2) (2004) 126–139. Crossref, Web of Science, Google Scholar
6. J. Hannemann and G. Kickzales , Design patterns implementation in java and aspectJ, ACM SIGPLAN Conf. Object-Oriented Programming, Systems, Languages and Applications, 2002, pp. 161–173. Google Scholar
7. M. Ceccato and P. Tonella , Measuring the effects of software aspectization, in First Workshop on Aspect Reverse Engineering, 2004. Google Scholar
8. A. Garcia, C. Sant’Anna, E. Figueiredo, U. Kulesza, C. Carlos Lucena and A. V. Staa , Modularazing design patterns with aspects: A quantitative study, in Transactions on Aspect-Oriented Software Development (Springer, 2006), pp. 36–74. Crossref, Google Scholar
9. P. Greenwood et al., On the impact of aspectual decompositions on design stability: An empirical study, in Proc. 21st European Conf. Object-Oriented Programming, 2007. Google Scholar
10. L. Madeyski and L. Szala , Impact of aspect-oriented programming on software development efficiency and design quality: An empirical study, IET Softw. 1 (5) (2007) 180–187. Crossref, Web of Science, Google Scholar
11. M. Bartsch and R. Harrison , An exploratory study of the effect of aspect-oriented programming on maintainability, Softw. Qual. J. 16 (1) (2008) 23–44. Crossref, Web of Science, Google Scholar
12. R. Coelho et al., Assessing the impact of aspects on exception flows: An exploratory study, in Proc. 22nd European Conf. Object-Oriented Programming, 2008. Google Scholar
13. E. Figueirido et al., Evolving software product lines with aspects: An empirical study on design stability, in Proc. 30th Int. Conf. Software Engineering, 2008. Google Scholar
14. K. Hoffman and P. Eugster , Towards reusable components with aspects: An empirical study on modularity and obliviousness, in Proc. 30th Int. Conf. Software Engineering, 2008. Google Scholar
15. K. Sibri and P. J. Kulkarni , Impact of aspect-oriented programming on software development quality metrics, Glob. J. Comput. Sci. Technol. 10 (7) (2010) 28–36. Google Scholar
16. A. Przybylek , An empirical assessment of the impact of aspect-oriented programming on software modularity, Fifth Int. Conf. Evaluation of Novel Approaches to Software Engineering, 2010. Google Scholar
17. M. Cinnéide, D. Boyle and I. H. Moghadam , Automated refactoring for testability, in Proc. Int. Conf. on Software Testing, Verification and Validation Workshops, 2011. Google Scholar
18. M. Mortensen, S. Ghosh and J. M. Bieman , Aspect-oriented refactoring of legacy applications: An evaluation, IEEE Trans. Softw. Eng. 38 (1) (2012) 118–140. Crossref, Web of Science, Google Scholar
19. A. S. Deepiga, S. Senthil Velan and Chitra Babu , Empirical investigation of introducing aspect-oriented programming across versions of an SOA applications, in IEEE Int. Conf. Advanced Communication Control and Computing Technologies, 2014. Google Scholar
20. J. M. S. França, C. A. R. Dos Santos, K. S. De Oliveira and M. S. Soares , An empirical evaluation of refactoring crosscutting concerns into aspects using software metrics, in 10th Int. Conf. Information Technology: New Generations, 2013. Google Scholar
21. M. Badri, A. Kout and L. Badri , On the effect of aspect-oriented refactoring on testability of classes: A case study, in IEEE Int. Conf. Computer Systems and Industrial Informatics, 2012. Google Scholar
22. M. Bruntink and A. V. Deursen , Predicting class testability using object-oriented metrics, in 4th International Workshop on Source Code Analysis and Manipulation, 2004. Google Scholar
23. M. Bruntink and A. V. Deursen , An empirical study into class testability, J. Syst. Softw. 79 (9) (2006) 1219–1232. Crossref, Web of Science, Google Scholar
24. F. Toure, M. Badri and L. Lamontagne , Towards a metrics suite for JUnit test cases, 26th Int. Conf. Software Engineering and Knowledge Engineering, 2014, pp. 115–120. Google Scholar
25. F. Toure, M. Badri and L. Lamontagne , A metrics suite for junit test code: A multiple case study on open source software, J. Softw. Eng. Res. Dev. 2 :14 2014. Crossref, Google Scholar
26. S. R. Chidamber and C. F. Kemerer , A metrics suite for OO design, IEEE Trans. Softw. Eng. 20 (6) (1994) 476–493. Crossref, Web of Science, Google Scholar
27. S. R. Chidamber, D. P. Darcy and C. F. Kemerer , Managerial use of metrics for object-oriented software: An exploratory analysis, IEEE Trans. Softw. Eng. 24 (8) (1998) 629–639. Crossref, Web of Science, Google Scholar
28. K. Hoffman and P. Eugster , Cooperative aspect-oriented programming, Sci. Comput. Program. 74 (2009) 333–354. Crossref, Web of Science, Google Scholar
29. J. Hannemann , Aspect-oriented refactoring: Classification and challenges, in Workshop on Linking Aspect Technology and Evolution and 5th Int. Conf. Aspect-Oriented Software Development, 2006. Google Scholar
30. A. Zakaria and H. Hosny , Metrics for aspect-oriented design, in Workshop on Aspect-Oriented Modeling and Int. Conf. Aspect-Oriented Software Development, 2003. Google Scholar
31. U. Kulesza, C. Sant’Anna, A. Garcia, R. Coelho, A. von Staa and C. Lucena , Quantifying the effects of aspect-oriented programming: A maintenance study, in 22nd IEEE Int. Conf. Software Maintenance, 2006. Google Scholar
32. L. Madeyski and L. Szala , Impact of aspect-oriented programming on software development efficiency and design quality: An empirical study, IET Softw. J. 1 (5) (2007) 180–187. Crossref, Web of Science, Google Scholar
33. A. Garcia, C. Sant’Anna, E. Figheiredo, U. Kulesza, C. Lucena and A. von Staa , Modularizing design patterns with aspects: A quantitative study, 4th Int. Conf. Aspect-Oriented Software Development, 2005. Google Scholar
34. C. Sant’Anna, C. Lobato and U. Kulesza , On the modularity assessment of aspect-oriented multiagent architectures: A quantitative study, Int. J. Agent-Oriented Software Engineering 2 (1) (2008) 34–61. Crossref, Google Scholar
35. A. Przybylek , Where the truth lies: AOP and its impact on software modularity, in FASE 2011, LNCS Vol. 6603, 2011, pp. 447–461. Google Scholar
36. R. Yokomori, H. Siy, N. Yoshida, M. Noro and K. Inoue , Measuring the effects of aspect-oriented refactoring on component relationships: Two case studies, in Int. Conf. Aspect-Oriented Software Development, 2011. Google Scholar
37. M. Harman , Refactoring as testability transformation, in 1st Refactoring and Testing Workshop, 2011. Google Scholar
38. R. Shatnawi and W. Li , An empirical assessment of refactoring impact on software quality using a hierarchical quality model, Int. J. Softw. Eng. Appl. 5 (4) (2011) 127–149. Google Scholar
39. M. Alshayeb, H. Al-Jamimi and M. O. Elish , Empirical taxonomy of refactoring methods for aspect-oriented programming, J. Softw. Evol. Proc., 25 (2013) 1–25. Crossref, Web of Science, Google Scholar
40. IEEE, IEEE standard glossary of software engineering terminology (IEEE CSP, NY, 1990). Google Scholar
41. ISO/IEC 9126, Software Engineering Product Quality, 1991. Google Scholar
42. N. Fenton and S. L. Pfleeger , Software Metrics: A Rigorous and Practical Approach (PWS Pub. Co., 1997). Google Scholar
43. P. L. Yeh and J. C. Lin , Software testability measurement derived from data flow analysis, in 2nd Euromicro Conf. Software Maintenance and Reengineering, 1998. Google Scholar
44. J. W. Sheppard and M. Kaufman , Formal specification of testability metrics, in IEEE P1522, IEEE AUTOTESTCON, 2001. Google Scholar
45. V. Gupta, K. K. Aggarwal and Y. Singh , A fuzzy approach for integrated measure of object-oriented software testability, J. Comput. Sci. 1 (2) (2005) 276–282. Crossref, Google Scholar
46. Y. Singh, A. Kaur and R. Malhota , Predicting testing effort using artificial neural network, in Proc. World Congress on Engineering and Computer Science, 2008. Google Scholar
47. Y. Singh and A. Saha , Predicting testability of eclipse: A case study, J. Softw. Eng. 4 (2) (2010) 122–136. Crossref, Google Scholar
48. L. Badri, M. Badri and F. Touré , Exploring empirically the relationship between lack of cohesion and testability in object-oriented systems, in Advances in Software Engineering, ed. T.-H. Kim et al., Communications in computer and information science, Vol. 117 (Springer, 2010). Crossref, Google Scholar
49. L. Badri, M. Badri and F. Touré , An empirical analysis of lack of cohesion metrics for predicting testability of classes, Int. J. Softw. Eng. Appl. 5 (2) (2011) 69–85. Google Scholar
50. M. Badri and F. Touré , Empirical analysis for investigating the effect of control flow dependencies on testability of classes, in 23rd Int. Conf. Software Engineering and Knowledge Engineering, 2011. Google Scholar
51. M. Badri and F. Touré , Evaluating the effect of control flow on the unit testing effort of classes: An empirical analysis, Adv. Softw. Eng., (2012). Crossref, Google Scholar
52. M. Badri and F. Touré , Empirical analysis of object-oriented design metrics for predicting unit testing effort of classes, J. Softw. Eng. Appl. 5 (7) (2012) 513–526. Crossref, Google Scholar
53. Y. Zhou et al., An in-depth investigation into the relationships between structural metrics and unit testability in OOS, Inf. Sci. 55 (12) (2012). Web of Science, Google Scholar
54. R. V. Binder , Design for testability in object-oriented systems, Commun. ACM 37 (1994) 87–101. Crossref, Web of Science, Google Scholar
55. M. Marin, A. Deursen and L. Moonen , Identifying aspects using fan-in analysis, in 11th Working Conf. Reverse Engineering, 2004. Google Scholar
56. A. V. Deursen, M. Marin and L. Moonen , AJHotDraw: A showcase for refactoring to aspects, in LATE Workshop at AOSD, 2005. Google Scholar
57. C. Zhang and H. A. Jacobsen , Efficiently mining crosscutting concerns through random walks, in 6th Int. Conf. Aspect-Oriented Software Development, 2007. Google Scholar
58. J. Huang, Y. Lu and J. Yang , Aspect mining using link analysis, in Fifth Int. Conf. Frontier of Computer Science and Technology, 2010. Google Scholar
59. M. Storzer, U. Eibauer and S. Schoehhmann , Aspect mining for aspect refactoring: An experience report, in Workshop TEAM’06 of ECOOP’06, 2006. Google Scholar
60. D. Shepherd, J. Palm, L. Pollock and M. Chu-Carroll , Timna: A framework for automatically combining aspect mining analyses, in 20th IEEE ACM Int. Conf. Automated Software Engineering, 2005, pp. 7–11. Google Scholar
61. W. Hines, D. C. Montgomery, D. M. Goldsman and C. Borror , Probability and Statistics in Engineering, 4th edn. (John Wiley & Sons, 2003). Google Scholar