Comparing GUI Automation Testing Tools for Dynamic Web Applications


  • Samer Al-Zain
  • Derar Eleyan Faculty of Information Technology Birzeit University PO.Box 14 Ramallah Palestine
  • Yousef Hassouneh


Web application, GUI, Software testing, Agile testing


Automating software testing helps agile teams to release production-ready software as often as needed. There are so many automation testing tools with record/playback features available for test teams to automate functional tests against web applications. However, choosing the right tool can be vital to project success. This paper presents a survey on automation testing tools for web applications. These tools have been chosen from both open-source, namely Selenium and Sahi, and from commercial tools such as TestComplete and Microsoft Visual Studio 2010. These tools were compared based on the effectiveness of recorder/playback tools, handling of page waits, cross browser compatibility, technical support, and the number of different techniques available to programmatically locate elements on web pages. Results show that free and simple tools can be more powerful and time saving, compared to commercially sophisticated and expensive tools. This paper also summarizes best practices and guidelines when adopting automated GUI functional tests against web applications, drawing a road-map for test engineers to follow.

Author Biography

Derar Eleyan, Faculty of Information Technology Birzeit University PO.Box 14 Ramallah Palestine

Assistant Professor Information Systems, Faculty of IT


Afroz, S., Rani E. &Priyadarshini, N. (2011) “Web Application – A Study on Comparing Software Testing Toolsâ€, International Journal of Computer Science and Telecommunications, 2(3).

Business Internet Group of San Francisco (2003) The BIG-SF Report on Government Web ApplicationIntegrity. Available at: 9 May 2011).

Business Internet Group of San Francisco (2003) The Black Friday Report on Web Application Integrity. Available at: (Accessed: 9 May 2011).

Brooks, P., Robinson, B., and Memon, A. M.(2009) “An initial characterization of industrial graphical user interface systems,†in ICST 2009: Proceedings of the 2nd IEEE International Conference on Software Testing, Verification and Validation. Washington, DC, USA: IEEE Computer Society, 2009.

Xun Yuan, Myra, B. Cohen, Atif M Memon, (2011) “GUI Interaction Testing: Incorporating Event Contextâ€, IEEE Transaction on Software Engineering, 37(4): 559-574.

Sommerville, I. (2004) Software Engineering, England: Addison Wesley.

Crispin, L. & Gregory, J. (2009) Agile Testing: A Practical Guide for Testers and Agile Teams, Boston: Addison Wesley.

Wikipedia (2012) Web Applications.Available at: (Accessed: 5 May 2012).

SmartBear Software (2011) Testing Dynamic Web Pages.Available at:

(Accessed 16 April 2011). (2012) Learn HTML [Online]. Available at: (Accessed: 14 March 2012).

West, J. (2012) “Automated Testing in Agile Environmentsâ€, [Online]. Available at: (Accessed: 10 May 2012).

Levinson, J. (2011) “Software Testing With Visual Studio 2010â€, Boston: Pearson, Inc.

Tyto Software Ltd (2012) Sahi[online]. Available at: (Accessed 6 May 2012).

Riley, M. (2010) DevProConnections. Available at: (Accessed 15 April 2011).

SmartBear Software (2011) Top Reasons to Try TestComplete, [Online]. Available at: (Accessed: 12 May 2011).

Microsoft (2012) Understanding Web Tests [Online]. Available at: (Accessed 2 March 2012).

Selenium IDE (2012) Introduction to Selenium IDE [Online]. Available at: (Accessed 3 March 2012). (2012) Open Source Web Testing Tools in Java[Online]. Available at: (Accessed 17 March 2012).

SmartBear Software (2011) Testing Dynamic Web Pages. Available at:

(Accessed 16 April 2011).

Stack Overflow (2012) Stack Overflow is a programming Q & A site that’s free. Available at: (Accessed 16 January 2012).

Zain, S., Elyan, D. (2012) ‘Automated User Interface Testing for Web Applications, and TestComplete’, CUBE 2012: International IT Conference and Exhibition. Pune, India 3-5 September. ACM, pp. 350-354.




How to Cite

Al-Zain, S., Eleyan, D., & Hassouneh, Y. (2013). Comparing GUI Automation Testing Tools for Dynamic Web Applications. Asian Journal of Computer and Information Systems, 1(2). Retrieved from