Skip to main content

World Quality Report 2016 – 2017 Launch Highlights

I had the opportunity to attend the launch of the 8th annual World Quality Report 2016 -2017 (WQR) authored by Capgemini and Sogeti, in collaboration with HPE. You can download a complimentary copy of the WQR here 

This annual undertaking by the three companies is a global survey of 1600 participants consisting of 44 questions. The result is an 80-page report that provides a baseline for testing and QA trends.

The launch event featured WQR co-authors Mark Buenen, Vice President, Global Leader, Sogeti QA and Testing Practice, Netherlands and Govindarajan Muthukrishnan, Senior Vice President,  Financial Services Testing Leader, United Kingdom. The co-authors spoke eloquently for about 30 minutes each on highlights of the WQR. 

Following are some of the highlights from Mark and Govind’s WQR launch presentation.


As organizations continue on the path of digital transformation, there is immense pressure on the QA organization to deliver customer value and competitiveness. This means that QA professionals are more important and more relevant now than at any time in the past. QA organizations must adapt to this pressure and accept the challenge to be aligned with the business and help to deliver valuable outcomes.

At voke, we have long been advocates of QA professionals and have consistently advised QA and testing professionals to become more strategic and help the business identify risk vs. simply identifying defects. This is the type of mindset shift that QA professionals and testers must adopt to remain not just relevant but necessary.

Top Challenges

Two of the biggest QA challenges identified in the WQR are the lack of environments and lack of production-like data for testing.

Participants in the WQR identified challenges associated with managing and maintaining test environments as one of their top priorities. The problems associated with maintaining multiple versions of test environments, the lack of available environments for testing, scheduling of test environments, and the lack of the right tools for testing were the primary issues cited with respect to test environments.

In short, these concerns say that organizations need an environment as close to production as possible at any time, for as long as necessary. This is not an unreasonable expectation given the amount of platforms that must be tested, the cadence that testing must keep pace with, and the business requirement to release high quality software. 

As an analyst firm, voke has written extensively about this problem since our inception in 2006. voke’s most recent research on virtual and cloud-based labs takes this problem of environments and provides in-depth analysis, compelling ROI, and a list of tool vendors capable of providing these solutions. Our research on virtual and cloud-based labs is available here.

The WQR also identified proper test data as a major issue. Test environments and test data go hand-in-hand. Test data must be secure and compliant. The need to test with production-like data should not put your business or your customer at risk.

voke research shows that the lack of production-like test data causes project delays, cost overruns, and security issues. There are solutions on the market to help organizations create data as close to production as possible.

Test environments and test data management are two topics that have made it to the top of the priority list in the WQR. Over the next 12 months, we should expect these two topics to get more attention in organizations. This is positive for QA professionals and testers. Test environments and test data management are two ways that QA professionals and testers can enhance their skills and deliver value.

Check out our research on lifecycle virtualization to delve deeper into the challenges presented by test environments and test data management. The most recent voke research on lifecycle virtualization is available here


In addition to specific technical challenges, the WQR highlights the need to modernize and understand QA processes as well as the need for skills to increase to keep up with the demands of newer development practices.

The WQR makes a very accurate prediction by stating that “a digital future cannot come at the cost of quality”. As QA professionals read the WQR report they should keep in mind this quote. We are at the point where just releasing software faster is not what is needed. The future belongs to those who can deliver quality.

The WQR is a great read to gain a baseline understanding of what is currently happening in the software testing and quality assurance market.


Popular posts from this blog

We Want YOUR Opinion on Security Operations Automation

We are excited to launch a survey on one of the most topical IT agenda items – security operations automation. Security threats are a 24X7X365 concern for every single enterprise, regardless of size or type of business. Enterprises are worried about the business risk caused by un-remediated security vulnerabilities, compliance challenges, and configuration issues. We want to hear from you! How welcoming is your organization to hackers? Do IT operations professionals have enough information to remediate security vulnerabilities? Are IT security and IT operations working together? Are hackers “welcome” in your systems, infrastructure, and applications? We want to collect as much data as possible by September 25, 2016. So, take the voke Market Snapshot survey on security operations automation here . At the end of the survey you will have the opportunity to register for a complimentary copy of the report for your own personal use. Thank you in advance for your participation –

API Testing – Stop Waiting and Start Testing ASAP!

We have all heard that testers must keep pace with developers to deliver software faster. However, most testers continue to test at the UI level – which is constantly changing, so testers have to wait, and that impacts the ability to meet business demands for faster software releases. It becomes a cycle that testers have a hard time escaping. Testers want to be able to test earlier, reduce risk, and identify defects sooner – all to satisfy the customer. API testing is the perfect way to supplement traditional UI testing, keep pace with development, and deliver better quality at scale!  API testing can help you test earlier, faster, and more efficiently! And now, we have the data to show you the benefits of API testing including how much time is spent on UI testing alone, how much (or should I say little) time is spend on unit and API testing, and how much coverage is achieved.  We will be premiering the results of our recent survey on API testing in a webinar with Paraso

New Service Virtualization Research

voke is excited to share the results of our second and most recent research on service virtualization – the voke Market Snapshot TM  Report: Service Virtualization . The latest research was announced on January 22, 2015. This most recent data was collected from over 500 participants from August – October 2014. Survey participants told us how they are using service virtualization, why they adopted it, their general thoughts about service virtualization, the challenges they face with service virtualization, and the benefits of service virtualization.  This research shows that service virtualization is no longer a nascent technology with a practitioner following. Service virtualization is now a proven technology with visibility at all levels of the organization. Change agents, C-level executives, and practitioners alike find value in the measurable and quick ROI service virtualization brings. Full ROI details achieved by participants provided in the report include: Reduced defect r