The state of QA & testing in North America
The US, like the rest of the world is seeing a continued increase in digital transformation using digital advances in analytics, mobility, social, and smart embedded devices and at the same time streamlining the ERP processes. Another trend is the increase in the adoption of Agile and DevOps methodologies especially for digital transformation. These trends have had an impact on quality assurance (QA) and test function and the organization. According to the World Quality Report survey, the QA and Test function saw a consistent increase of budget, as reported by 90% of US and 69% of Canadian respondents over the last four years. The main factors driving the rise are ‘the increased complexity of IT applications’, ‘the shift to Agile and DevOps causing more test iteration cycles’ and ‘the greater stress being put on quality’. At a fundamental level, this is due to the increased importance of QA and Testing in a digital age to improve or prevent damage to the brand.
One of the biggest trends in North America is the continued adoption of Agile across different industry sectors. This increasing adoption of Agile and DevOps methodology has an important impact on the organization of testing activities. These approaches put an increasing focus on speed and time-to-market and lead to the creation of smaller, integrated teams that can handle a variety of tasks. This is giving rise to hybrid QA organizations, where the digital side of operations is moving towards de-centralization, while operations based on legacy systems are centralized with a Testing Center of Excellence (TCOE). Another important factor in the structure of the Test organization is the level of process maturity within the organization. More mature organizations are transforming towards hybrid test organization wherein the project teams are within the program and the TCoE is providing support on test platforms, governance etc. Organizations that have had low level of maturity in the test functions are forming centralized TCoE organization to bring the rigor for improving product quality.
Irrespective of the Test organization, one key trend is the want to increase the level of automation within the test function. In order to address the challenges around increasing level of robust automation, organizations are trying to increase Interface or API automation and Unit / component level automation. Although the demand for smart test automation is there, the level of automation reported by the survey participants is in the mid-teens. The key challenges in achieving higher level of automation revolve around the lack of skills, challenges in managing test data and availability of test environment. Test data management has always been a challenge but has become more complex due to DevOps and Agile models as well as the move to the cloud. In addition, the General Data Protection Regulation and its associated requirements for data privacy have brought this area into greater focus. There is also a lot of interest around test environment management right now as organizations search for ways to automate environment provisioning and deployment to speed up the entire testing cycle.
The shortage of time to test reported by our respondents is an important factor that has led to the recent rise of predictive analytics in testing. This rise of techniques and tools for risk based testing and defect prediction modeling are another upcoming trend.
Apart from the above trends, there are also some key challenges being faced by the QA and Testing function in North America. One of these, as already mentioned, is a lack of the right kind of skills among QA and Testing professionals. This is a direct result of the increasing adoption of DevOps, Agile and rapidly changing technologies and the convergence of social, mobile and cloud (SMAC) solutions. Due to these trends, there is a need to re-tool or re-skill the existing pool of testers and this continues to be a major challenge in North America.
Compared to Agile, the adoption of DevOps is a more recent trend and the most common DevOps approaches among North American organizations include the virtualization of environments, use of cloud-based test environments and the use of continuous monitoring and predictive analytics.
In summary, it is a market that has been quick to adopt some of the latest QA and Testing trends and is slightly ahead of the curve when it comes to the maturity of its testing practices. Yet, there remain some important challenges that will likely be resolved over the next few years.
By Sandip Parekh, VP, Testing for Apps, North America at Capgemini
Intelliwave SiteSense boosts APTIM material tracking
“We’ve been engaged with the APTIM team since early 2019 providing SiteSense, our mobile construction SaaS solution, for their maintenance and construction projects, allowing them to track materials and equipment, and manage inventory.
We have been working with the APTIM team to standardize material tracking processes and procedures, ultimately with the goal of reducing the amount of time spent looking for materials. Industry studies show that better management of materials can lead to a 16% increase in craft labour productivity.
Everyone knows construction is one of the oldest industries but it’s one of the least tech driven comparatively. About 95% of Engineering and Construction data captured goes unused, 13% of working hours are spent looking for data and around 30% of companies have applications that don’t integrate.
With APTIM, we’re looking at early risk detection, through predictive analysis and forecasting of material constraints, integrating with the ecosystem of software platforms and reporting on real-time data with a ‘field-first’ focus – through initiatives like the Digital Foreman. The APTIM team has seen great wins in the field, utilising bar-code technology, to check in thousands of material items quickly compared to manual methods.
There are three key areas when it comes to successful Materials Management in the software sector – culture, technology, and vendor engagement.
Given the state of world affairs, access to data needs to be off site via the cloud to support remote working conditions, providing a ‘single source of truth’ accessed by many parties; the tech sector is always growing, so companies need faster and more reliable access to this cloud data; digital supply chain initiatives engage vendors a lot earlier in the process to drive collaboration and to engage with their clients, which gives more assurance as there is more emphasis on automating data capture.
It’s been a challenging period with the pandemic, particularly for the supply chain. Look what happened in the Suez Canal – things can suddenly impact material costs and availability, and you really have to be more efficient to survive and succeed. Virtual system access can solve some issues and you need to look at data access in a wider net.
Solving problems comes down to better visibility, and proactively solving issues with vendors and enabling construction teams to execute their work. The biggest cause of delays is not being able to provide teams with what they need.
On average 2% of materials are lost or re-ordered, which only factors in the material cost, what is not captured is the duplicated effort of procurement, vendor and shipping costs, all of which have an environmental impact.
As things start to stabilise, APTIM continues to utilize SiteSense to boost efficiencies and solve productivity issues proactively. Integrating with 3D/4D modelling is just the precipice of what we can do. Access to data can help you firm up bids to win work, to make better cost estimates, and AI and ML are the next phase, providing an eco-system of tools.
A key focus for Intelliwave and APTIM is to increase the availability of data, whether it’s creating a data warehouse for visualisations or increasing integrations to provide additional value. We want to move to a more of an enterprise usage phase – up to now it’s been project based – so more people can access data in real time.