Your browser does not support JavaScript!
http://iet.metastore.ingenta.com
1887

access icon free Automated tests for cross-platform mobile apps in multiple configurations

© The Institution of Engineering and Technology
Received 18/12/2018, Accepted 09/09/2019, Revised 27/06/2019, Published 17/09/2019

Cross-platform apps stand out by their ability to run in various operating systems (OSs), such as Android, iOS, and Windows. Such apps are developed using popular frameworks for cross-platform app development such as Apache Cordova, Xamarin, and React Native. However, the mechanisms to automate their tests are not cross-platform and do not support multiple configurations. Hence, different test scripts have to be coded for each platform, yet there is no guarantee they will work in different configurations varying, e.g. platform, OS version, and hardware available. This study proposes mechanisms to produce automated tests for cross-platform mobile apps. In order to set up the tests to execute in multiple configurations, the authors’ approach adopts two reference devices: one running Android and other iOS. As both platforms have their own user interface (UI) XML representation, they also investigated six individual expression types and two combined strategies to locate UI elements. They have developed a prototype tool called cross-platform app test script recorder (x-PATeSCO) to support the proposed approach, as well as the eight locating strategies considered. They evaluated the approach with nine cross-platform mobile apps, comparing the locating strategies in six real devices.

Inspec keywords: operating systems (computers); program testing; user interfaces; XML; mobile computing

Other keywords: cross-platform app development; different test scripts; multiple configurations; cross-platform apps; cross-platform mobile apps; automated tests; cross-platform app test script recorder

Subjects: Mobile, ubiquitous and pervasive computing; Diagnostic, testing, debugging and evaluating systems; Operating systems; User interfaces

References

    1. 1)
      • 6. W3C.: ‘Web design and applications’. Available at https://www.w3.org/standards/webdesign/, accessed 17 April 2019.
    2. 2)
      • 31. Silva, D.B., Eler, M.M., Durelli, V.H.S., et al: ‘Characterizing mobile apps from a source and test code viewpoint’, Inf. Softw. Technol., 2018, 101, pp. 32–50. Available at http://www.sciencedirect.com/science/article/pii/S0950584918300788.
    3. 3)
      • 34. Lee, S., Dolby, J., Ryu, S.: ‘Hybridroid: analysis framework for android hybrid applications’. 31st IEEE/ACM Int. Conf. on Automated Software Engineering (ASE 2016), Singapore, September 2016, pp. 250–261.
    4. 4)
      • 33. Cruz, L., Abreu, R., Lo, D.: ‘To the attention of mobile software developers: guess what, test your app!’, Empir. Softw. Eng., 2019, 24, pp. 2438–2468. Available at https://doi.org/10.1007/s10664-019-09701-0.
    5. 5)
      • 17. Li, X., Chang, N., Wang, Y., et al: ‘ATOM: automatic maintenance of GUI test scripts for evolving Mobile applications’. Proc. 10th IEEE Int. Conf. on Software Testing, Verification and Validation, (ICST 2017), Tokyo, Japan, March 2017, pp. 161–171.
    6. 6)
      • 27. Rao, G., Pachunoori, A.: ‘Optimized identification techniques using XPath’. MSU-CSE-00-2, IBM Developerworks, 2013.
    7. 7)
      • 8. Willocx, M., Vossaert, J., Naessens, V.: ‘Comparing performance parameters of mobile app development strategies’. 3rd Int. Conf. on Mobile Software Engineering and Systems (MOBILESoft), 2016, pp. 38–47. Available at http://dl.acm.org/citation.cfm?doid=2897073.2897092.
    8. 8)
      • 12. Nagappan, M., Shihab, E.: ‘Future trends in software engineering research for Mobile apps’. 2016 IEEE 23rd Int. Conf. on Software Analysis, Evolution, and Reengineering (SANER), Suita, Japan, March 2016, pp. 21–32.
    9. 9)
      • 25. Leotta, M., Clerissi, D., Ricca, F., et al: ‘Comparing the maintainability of selenium webdriver test suites employing different locators: a case study’. Proc. 2013 Int. Workshop on Joining AcadeMiA and Industry Contributions to Testing Automation, Jamaica, Lugano, Switzerland, July 2013, pp. 53–58.
    10. 10)
      • 32. Leotta, M., Stocco, A., Ricca, F., et al: ‘Robula + : an algorithm for generating robust XPath locators for web testing’, J. Softw.: Evol. Process, 2016, 28, (3), pp. 177–204. Available at https://onlinelibrary.wiley.com/doi/abs/10.1002/smr.1771.
    11. 11)
      • 23. Vilkomir, S., Amstutz, B.: ‘Using combinatorial approaches for testing mobile applications’. 2014 IEEE Seventh Int. Conf. on Software Testing, Verification and Validation Workshops, Cleveland, OH, USA, 31 March – 4 April 2014, pp. 78–83. Available at http://ieeexplore.ieee.org/lpdocs/epic03/wrapper.htm?arnumber=6825641.
    12. 12)
      • 29. Statista.: ‘Android version market share distribution among smartphone owners as of September 2017’. Available at https://www.statista.com/statistics/271774/share-of-android-platforms-on-mobile-devices-with-android-os/, accessed 17 April 2019.
    13. 13)
      • 5. IBM.: ‘Native, web or hybrid mobile-app development’. Somers, NY. Available at ftp://public.dhe.ibm.com/software/pdf/mobile-enterprise/WSW14182USEN.pdf, accessed 17 April 2019.
    14. 14)
      • 7. Xanthopoulos, S., Xinogalos, S.: ‘A comparative analysis of cross-platform development approaches for mobile applications’. ACM Proc. 6th Balkan Conf. in Informatics, BCI'13, New York, NY, USA, 2013, pp. 213–220. Available at http://doi.acm.org/10.1145/2490257.2490292.
    15. 15)
      • 4. Statista.: ‘Number of apps available in leading app stores as of march 2017’. Available at http://www.statista.com/statistics/276623/number-of-apps-available-in-leading-app-stores/, accessed 17 April 2019.
    16. 16)
      • 15. Leotta, M., Stocco, A., Ricca, F., et al: ‘Reducing web test cases aging by means of robust XPath locators’. Proc. – IEEE 25th Int. Symp. on Software Reliability Engineering Workshops, ISSREW 2014, Naples, Italy, November 2014, pp. 449–454.
    17. 17)
      • 21. W3C.: ‘XML path language (XPath) version 1.0’. Available at https://www.w3.org/TR/xpath/, accessed 17 April 2019.
    18. 18)
      • 9. Willocx, M., Vossaert, J., Naessens, V.: ‘A quantitative assessment of performance in mobile app development tools’. 2015 IEEE Int. Conf. on Mobile Services (MS), New York, NY, USA, , 27 June – 2 July 2015, pp. 454–461.
    19. 19)
      • 24. Belli, F., Budnik, C.J., White, L.: ‘Event-based modelling, analysis and testing of user interactions: approach and case study’, Softw. Test Verif. Reliab., 2006, 16, (1), pp. 3–32. Available at http://dx.doi.org/10.1002/stvr.v16:1.
    20. 20)
      • 30. Statista.: ‘Share of Apple devices by iOS version worldwide from 2016 to 2017’. Available at https://www.statista.com/statistics/565270/apple-devices-ios-version-share-worldwide/, accessed 17 April 2019.
    21. 21)
      • 22. Vilkomir, S., Marszalkowski, K., Perry, C., et al: ‘Effectiveness of multi-device testing Mobile applications’. 2nd Int. Conf. on Mobile Software Engineering and Systems (MOBILESoft), Florence, Italy, May 2015, pp. 44–47.
    22. 22)
      • 35. Wei, L., Liu, Y., Cheung, S.C.: ‘Taming android fragmentation: characterizing and detecting compatibility issues for android apps’. 31st IEEE/ACM Int. Conf. on Automated Software Engineering ASE ‘16, Singapore, September 2016, pp. 226–237.
    23. 23)
      • 14. Fazzini, M., Freitas, E.N.D.A., Choudhary, S.R., et al: ‘Barista: A technique for recording, encoding, and running platform independent android tests’. 2017 IEEE Int. Conf. on Software Testing, Verification and Validation (ICST), Tokyo, Japan, March 2017, pp. 149–160.
    24. 24)
      • 11. Joorabchi, M.E., Mesbah, A., Kruchten, P.: ‘Real challenges in Mobile app development’. IEEE Int. Symp. on Empirical Software Engineering and Measurement (ESEM 2013), Baltimore, MD, USA, October 2013, pp. 15–24.
    25. 25)
      • 18. Zein, S., Salleh, N., Grundy, J.: ‘A systematic mapping study of mobile application testing techniques’, J. Syst. Softw., 2016, 117, (C), pp. 334–356. Available at https://doi.org/10.1016/j.jss.2016.03.065.
    26. 26)
      • 19. IEEE: ‘IEEE standard glossary of software engineering terminology’, vol. 12, (IEEE, 1990). Available at http://ieeexplore.ieee.org/xpls/absall.jsp?arnumber=159342.
    27. 27)
      • 16. Leotta, M., Stocco, A., Ricca, F., et al: ‘Using multi-locators to increase the robustness of web test cases’. 2015 IEEE 8th Int. Conf. on Software Testing, Verification and Validation (ICST), Graz, Austria, April 2015, pp. 1–10.
    28. 28)
      • 2. IDC.: ‘Smartphone OS market share, 2017 Q1’. 2017. Available at https://www.idc.com/promo/smartphone-market-share/os, accessed 17 April 2019.
    29. 29)
      • 3. Gartner.: ‘Gartner says worldwide sales of smartphones grew 9 percent in first quarter of 2017’. 2017. Available at https://www.gartner.com/newsroom/id/3725117, accessed 17 April 2019.
    30. 30)
      • 10. Gronli, T.M., Ghinea, G.: ‘Meeting quality standards for mobile application development in businesses: a framework for cross-platform testing’. IEEE 49th Hawaii Int. Conf. on System Sciences (HICSS 2016), Koloa, HI, USA, January 2016, pp. 5711–5720.
    31. 31)
      • 26. Leotta, M., Clerissi, D., Ricca, F., et al: ‘Repairing selenium test cases: an industrial case study about web page element localization’. 2013 IEEE Sixth Int. Conf. on Software Testing, Verification and Validation, Luxembourg, March 2013, pp. 487–488.
    32. 32)
      • 13. Joorabchi, M.E., Ali, M., Mesbah, A.: ‘Detecting inconsistencies in multi-platform mobile apps’. IEEE 26th Int. Symp. on Software Reliability Engineering (ISSRE 2015), Washington DC, USA, November 2015, pp. 450–460.
    33. 33)
      • 28. Menegassi, A.A., Endo, A.T.: ‘x-PATeSCO and experimental package’. Available at https://github.com/andremenegassi/x-PATeSCO, accessed 17 April 2019.
    34. 34)
      • 20. W3C.: ‘Selectors level 3’. Available at https://www.w3.org/TR/2011/REC-css3-selectors-20110929/, accessed 17 April 2019.
    35. 35)
      • 1. Boushehrinejadmoradi, N., Ganapathy, V., Nagarakatte, S., et al: ‘Testing cross-platform mobile app development frameworks’. 2015 30th IEEE/ACM Int. Conf. on Automated Software Engineering (ASE), Lincoln, NE, USA, November 2015, pp. 441–451.
http://iet.metastore.ingenta.com/content/journals/10.1049/iet-sen.2018.5445
Loading

Related content

content/journals/10.1049/iet-sen.2018.5445
pub_keyword,iet_inspecKeyword,pub_concept
6
6
Loading
Print this page
This is a required field
Please enter a valid email address