http://iet.metastore.ingenta.com
1887

Automated tests for cross-platform mobile apps in multiple configurations

Automated tests for cross-platform mobile apps in multiple configurations

For access to this article, please select a purchase option:

Buy article PDF
$19.95
(plus tax if applicable)
Buy Knowledge Pack
10 articles for $120.00
(plus taxes if applicable)

IET members benefit from discounts to all IET publications and free access to E&T Magazine. If you are an IET member, log in to your account and the discounts will automatically be applied.

Learn more about IET membership 

Recommend Title Publication to library

You must fill out fields marked with: *

Librarian details
Name:*
Email:*
Your details
Name:*
Email:*
Department:*
Why are you recommending this title?
Select reason:
 
 
 
 
 
IET Software — Recommend this title to your library

Thank you

Your recommendation has been sent to your librarian.

Cross-platform apps stand out by their ability to run in various operating systems (OSs), such as Android, iOS, and Windows. Such apps are developed using popular frameworks for cross-platform app development such as Apache Cordova, Xamarin, and React Native. However, the mechanisms to automate their tests are not cross-platform and do not support multiple configurations. Hence, different test scripts have to be coded for each platform, yet there is no guarantee they will work in different configurations varying, e.g. platform, OS version, and hardware available. This study proposes mechanisms to produce automated tests for cross-platform mobile apps. In order to set up the tests to execute in multiple configurations, the authors’ approach adopts two reference devices: one running Android and other iOS. As both platforms have their own user interface (UI) XML representation, they also investigated six individual expression types and two combined strategies to locate UI elements. They have developed a prototype tool called cross-platform app test script recorder (x-PATeSCO) to support the proposed approach, as well as the eight locating strategies considered. They evaluated the approach with nine cross-platform mobile apps, comparing the locating strategies in six real devices.

References

    1. 1)
      • 1. Boushehrinejadmoradi, N., Ganapathy, V., Nagarakatte, S., et al: ‘Testing cross-platform mobile app development frameworks’. 2015 30th IEEE/ACM Int. Conf. on Automated Software Engineering (ASE), Lincoln, NE, USA, November 2015, pp. 441451.
    2. 2)
      • 2. IDC.: ‘Smartphone OS market share, 2017 Q1’. 2017. Available at https://www.idc.com/promo/smartphone-market-share/os, accessed 17 April 2019.
    3. 3)
      • 3. Gartner.: ‘Gartner says worldwide sales of smartphones grew 9 percent in first quarter of 2017’. 2017. Available at https://www.gartner.com/newsroom/id/3725117, accessed 17 April 2019.
    4. 4)
      • 4. Statista.: ‘Number of apps available in leading app stores as of march 2017’. Available at http://www.statista.com/statistics/276623/number-of-apps-available-in-leading-app-stores/, accessed 17 April 2019.
    5. 5)
      • 5. IBM.: ‘Native, web or hybrid mobile-app development’. Somers, NY. Available at ftp://public.dhe.ibm.com/software/pdf/mobile-enterprise/WSW14182USEN.pdf, accessed 17 April 2019.
    6. 6)
      • 6. W3C.: ‘Web design and applications’. Available at https://www.w3.org/standards/webdesign/, accessed 17 April 2019.
    7. 7)
      • 7. Xanthopoulos, S., Xinogalos, S.: ‘A comparative analysis of cross-platform development approaches for mobile applications’. ACM Proc. 6th Balkan Conf. in Informatics, BCI'13, New York, NY, USA, 2013, pp. 213220. Available at http://doi.acm.org/10.1145/2490257.2490292.
    8. 8)
      • 8. Willocx, M., Vossaert, J., Naessens, V.: ‘Comparing performance parameters of mobile app development strategies’. 3rd Int. Conf. on Mobile Software Engineering and Systems (MOBILESoft), 2016, pp. 3847. Available at http://dl.acm.org/citation.cfm?doid=2897073.2897092.
    9. 9)
      • 9. Willocx, M., Vossaert, J., Naessens, V.: ‘A quantitative assessment of performance in mobile app development tools’. 2015 IEEE Int. Conf. on Mobile Services (MS), New York, NY, USA, , 27 June – 2 July 2015, pp. 454461.
    10. 10)
      • 10. Gronli, T.M., Ghinea, G.: ‘Meeting quality standards for mobile application development in businesses: a framework for cross-platform testing’. IEEE 49th Hawaii Int. Conf. on System Sciences (HICSS 2016), Koloa, HI, USA, January 2016, pp. 57115720.
    11. 11)
      • 11. Joorabchi, M.E., Mesbah, A., Kruchten, P.: ‘Real challenges in Mobile app development’. IEEE Int. Symp. on Empirical Software Engineering and Measurement (ESEM 2013), Baltimore, MD, USA, October 2013, pp. 1524.
    12. 12)
      • 12. Nagappan, M., Shihab, E.: ‘Future trends in software engineering research for Mobile apps’. 2016 IEEE 23rd Int. Conf. on Software Analysis, Evolution, and Reengineering (SANER), Suita, Japan, March 2016, pp. 2132.
    13. 13)
      • 13. Joorabchi, M.E., Ali, M., Mesbah, A.: ‘Detecting inconsistencies in multi-platform mobile apps’. IEEE 26th Int. Symp. on Software Reliability Engineering (ISSRE 2015), Washington DC, USA, November 2015, pp. 450460.
    14. 14)
      • 14. Fazzini, M., Freitas, E.N.D.A., Choudhary, S.R., et al: ‘Barista: A technique for recording, encoding, and running platform independent android tests’. 2017 IEEE Int. Conf. on Software Testing, Verification and Validation (ICST), Tokyo, Japan, March 2017, pp. 149160.
    15. 15)
      • 15. Leotta, M., Stocco, A., Ricca, F., et al: ‘Reducing web test cases aging by means of robust XPath locators’. Proc. – IEEE 25th Int. Symp. on Software Reliability Engineering Workshops, ISSREW 2014, Naples, Italy, November 2014, pp. 449454.
    16. 16)
      • 16. Leotta, M., Stocco, A., Ricca, F., et al: ‘Using multi-locators to increase the robustness of web test cases’. 2015 IEEE 8th Int. Conf. on Software Testing, Verification and Validation (ICST), Graz, Austria, April 2015, pp. 110.
    17. 17)
      • 17. Li, X., Chang, N., Wang, Y., et al: ‘ATOM: automatic maintenance of GUI test scripts for evolving Mobile applications’. Proc. 10th IEEE Int. Conf. on Software Testing, Verification and Validation, (ICST 2017), Tokyo, Japan, March 2017, pp. 161171.
    18. 18)
      • 18. Zein, S., Salleh, N., Grundy, J.: ‘A systematic mapping study of mobile application testing techniques’, J. Syst. Softw., 2016, 117, (C), pp. 334356. Available at https://doi.org/10.1016/j.jss.2016.03.065.
    19. 19)
      • 19. IEEE: ‘IEEE standard glossary of software engineering terminology’, vol. 12, (IEEE, 1990). Available at http://ieeexplore.ieee.org/xpls/absall.jsp?arnumber=159342.
    20. 20)
      • 20. W3C.: ‘Selectors level 3’. Available at https://www.w3.org/TR/2011/REC-css3-selectors-20110929/, accessed 17 April 2019.
    21. 21)
      • 21. W3C.: ‘XML path language (XPath) version 1.0’. Available at https://www.w3.org/TR/xpath/, accessed 17 April 2019.
    22. 22)
      • 22. Vilkomir, S., Marszalkowski, K., Perry, C., et al: ‘Effectiveness of multi-device testing Mobile applications’. 2nd Int. Conf. on Mobile Software Engineering and Systems (MOBILESoft), Florence, Italy, May 2015, pp. 4447.
    23. 23)
      • 23. Vilkomir, S., Amstutz, B.: ‘Using combinatorial approaches for testing mobile applications’. 2014 IEEE Seventh Int. Conf. on Software Testing, Verification and Validation Workshops, Cleveland, OH, USA, 31 March – 4 April 2014, pp. 7883. Available at http://ieeexplore.ieee.org/lpdocs/epic03/wrapper.htm?arnumber=6825641.
    24. 24)
      • 24. Belli, F., Budnik, C.J., White, L.: ‘Event-based modelling, analysis and testing of user interactions: approach and case study’, Softw. Test Verif. Reliab., 2006, 16, (1), pp. 332. Available at http://dx.doi.org/10.1002/stvr.v16:1.
    25. 25)
      • 25. Leotta, M., Clerissi, D., Ricca, F., et al: ‘Comparing the maintainability of selenium webdriver test suites employing different locators: a case study’. Proc. 2013 Int. Workshop on Joining AcadeMiA and Industry Contributions to Testing Automation, Jamaica, Lugano, Switzerland, July 2013, pp. 5358.
    26. 26)
      • 26. Leotta, M., Clerissi, D., Ricca, F., et al: ‘Repairing selenium test cases: an industrial case study about web page element localization’. 2013 IEEE Sixth Int. Conf. on Software Testing, Verification and Validation, Luxembourg, March 2013, pp. 487488.
    27. 27)
      • 27. Rao, G., Pachunoori, A.: ‘Optimized identification techniques using XPath’. MSU-CSE-00-2, IBM Developerworks, 2013.
    28. 28)
      • 28. Menegassi, A.A., Endo, A.T.: ‘x-PATeSCO and experimental package’. Available at https://github.com/andremenegassi/x-PATeSCO, accessed 17 April 2019.
    29. 29)
      • 29. Statista.: ‘Android version market share distribution among smartphone owners as of September 2017’. Available at https://www.statista.com/statistics/271774/share-of-android-platforms-on-mobile-devices-with-android-os/, accessed 17 April 2019.
    30. 30)
      • 30. Statista.: ‘Share of Apple devices by iOS version worldwide from 2016 to 2017’. Available at https://www.statista.com/statistics/565270/apple-devices-ios-version-share-worldwide/, accessed 17 April 2019.
    31. 31)
      • 31. Silva, D.B., Eler, M.M., Durelli, V.H.S., et al: ‘Characterizing mobile apps from a source and test code viewpoint’, Inf. Softw. Technol., 2018, 101, pp. 3250. Available at http://www.sciencedirect.com/science/article/pii/S0950584918300788.
    32. 32)
      • 32. Leotta, M., Stocco, A., Ricca, F., et al: ‘Robula + : an algorithm for generating robust XPath locators for web testing’, J. Softw.: Evol. Process, 2016, 28, (3), pp. 177204. Available at https://onlinelibrary.wiley.com/doi/abs/10.1002/smr.1771.
    33. 33)
      • 33. Cruz, L., Abreu, R., Lo, D.: ‘To the attention of mobile software developers: guess what, test your app!’, Empir. Softw. Eng., 2019, 24, pp. 24382468. Available at https://doi.org/10.1007/s10664-019-09701-0.
    34. 34)
      • 34. Lee, S., Dolby, J., Ryu, S.: ‘Hybridroid: analysis framework for android hybrid applications’. 31st IEEE/ACM Int. Conf. on Automated Software Engineering (ASE 2016), Singapore, September 2016, pp. 250261.
    35. 35)
      • 35. Wei, L., Liu, Y., Cheung, S.C.: ‘Taming android fragmentation: characterizing and detecting compatibility issues for android apps’. 31st IEEE/ACM Int. Conf. on Automated Software Engineering ASE ‘16, Singapore, September 2016, pp. 226237.
http://iet.metastore.ingenta.com/content/journals/10.1049/iet-sen.2018.5445
Loading

Related content

content/journals/10.1049/iet-sen.2018.5445
pub_keyword,iet_inspecKeyword,pub_concept
6
6
Loading
This is a required field
Please enter a valid email address