According to the 2022 State of UI/UX Testing Report by Applitools, most organizations’ current testing techniques are unable to meet the quality engineering demands for their digital products and services. Claimed to be the first ever industry report on user interface (UI) and user experience (UX) testing, it report identifies critical factors that inhibit the scalability of modern UI/UX testing, and shows that while the demand for techniques like frontend testing is increasing rapidly, only 30% of respondents are actively testing for an application’s ease-of-use and visual correctness on each new deployment to production.
The report said that 38% of companies are deploying changes to production daily. This results in a significant increase in the amount of test coverage required in a shorter amount of time and expands coverage gaps. An even greater percentage of Applitools customers, nearly 2x than non-customers, deployed daily due to the confidence and coverage that they get from Applitools Visual AI.
Most organizations automated less than half of their testing despite test coverage for every device being critical. Also, more than 40% of test suites take more than an hour to run, creating a bottleneck for software delivery. However, respondents from companies that are using Applitools Ultrafast Test Cloud reported an average of 4x faster execution times.
Across the industry, companies are seeing less than 50% test coverage and test suites that take more than an hour to run. However, based on survey data, Applitools customers report 75% test coverage on average and test suite execution takes less than 15-20 minutes on average (or 4x faster than non-customers using traditional methods).
Another challenge reported by nearly 70% of respondents is that the UI is constantly changing across applications and device types causing constant test maintenance and stability issues for engineering teams.
Nearly 80% of survey respondents reported their team is responsible for testing two or more web applications. Surprisingly, more than 50% of respondents are responsible for testing five apps or more with at least five localized languages.
The report surveyed testers, developers, QA managers and UI/UX designers from nearly 1,000 companies.