Tag: tricentis

  • Global Survey Finds Testing as the Most Valuable AI Investment Across the Software Development Lifecycle

    Global Survey Finds Testing as the Most Valuable AI Investment Across the Software Development Lifecycle

    Tricentis report reveals AI-augmented DevOps tools will save teams over an estimated 40 hours per month—equivalent to an entire workweek

    AUSTIN, TEXAS – August 6th, 2024 – Tricentis, a global leader in continuous testing and quality engineering, today released the findings of its most recent AI report, “AI-augmented DevOps: Trends Shaping the Future.” This year’s research aims to understand to what extent the anticipated benefits of AI in DevOps have been realized today, and how a lack of trust, skills, or other challenges could affect its adoption.

    When asked to evaluate the most impactful areas for AI investments across the delivery cycle – such as planning, coding, deploying and releasing – DevOps practitioners ranked testing as the most valuable (60%). This result was foreshadowed in the Tricentis’ 2022 study, which found that testing is where organizations expected the greatest value from AI-augmented DevOps, with nearly 70% of respondents having rated the potential of AI-augmented testing as extremely or very valuable.

    The research finds that DevOps teams are realizing the benefits of AI, with mature DevOps teams who have adopted AI significantly more likely (30%) to rate their teams as either extremely or very effective. The biggest challenges DevOps teams are using AI to address are developer team efficiency (60%), reducing the skills gap (54%), cost reduction (47%), and software quality (42%). In fact, almost one third (32%) of respondents estimate AI-augmented DevOps tools will save teams over 40 hours per month—equivalent to an entire workweek.

    The 2024 results show that teams use AI to augment a wide range of testing tasks, including test planning/deciding what to test (47.5%), test case generation (44%), and analyzing test results (32%). Additionally, nearly half (42%) of respondents expect AI to perform a risk analysis of code changes, helping QA teams focus on code areas with the greatest risk of errors to quality.

    The report surveys 500+ DevOps practitioners, managers, and executives from small, mid-size, and enterprise organizations across the globe and in several industries, including financial services, healthcare, and manufacturing.

    Other 2024 findings reveal:

    • Regulation is expected to help build trust, but others worry it will stifle innovation and outcomes. Nearly two thirds (63%) of those surveyed view increased regulation as a way to build confidence in AI across their organization, while a smaller—but not insignificant—number of DevOps practitioners (16%) feel increased regulation will hinder or stifle the potential impact of AI in organizations.
    • Humans remain vital to ensure software quality, but there’s a shortfall in AI skills. Data shows that humans are still very much “in the loop,” with over two thirds (71%) of respondents checking outputs at least half of the time, and almost one in five (19%) claiming to check AI outputs all of the time. However, a lack of AI skills (28%) is seen as the greatest hurdle to AI adoption in DevOps.
    • Generative AI (Gen AI) and AI copilots are key drivers of AI adoption: GenAI (45%) is now the most widely adopted type of AI used by DevOps practitioners. In particular, AI copilots are also on the rise, with use cases in planning, code development, and software testing.

    “AI is an exciting technology and growing at a pace unlike anything we’ve seen in our industry,” said Mav Turner, Chief Product and Strategy Officer, Tricentis. “As AI technology is further developed, however, training software development and quality engineering teams with the necessary skills to effectively work with AI will be absolutely critical.”

    “DevOps teams looking to get started with AI should look no further than their testing processes. AI in testing helps to detect, auto-heal and predict defects during development, as well as identify which tests need to be run based on high risk. When coupled with low-code/no-code technology, this means that, regardless of a team’s technical expertise, AI can significantly contribute to overall software quality. As DevOps teams continue to mature, testing will be pivotal to realizing their investment in AI-augmented DevOps tools and practices.”

    To view the full findings of the report, download the complete “AI-augmented DevOps: Trends Shaping the Future” report here and register for the upcoming webinar on Thursday, August 29th here.

    Additional resources:

    Survey Methodology

    The findings are based on a global study conducted by Techstrong Research on AI augmentation in DevOps environments. The survey was fielded from April 19 to June 30, 2024, and yielded responses from 500+ DevOps practitioners, managers, and executives in the Americas, Europe and the Middle East, and the Asia-Pacific from small, mid-size, and enterprise organizations.

    About Tricentis

    Tricentis is a global leader in continuous testing and quality engineering. The Tricentis AI-based, continuous testing portfolio of products provide a new and fundamentally different way to perform software testing. An approach that’s totally automated, fully codeless, and intelligently driven by AI. It addresses both agile development and complex enterprise apps, enabling enterprises to accelerate their digital transformation by dramatically increasing software release speed, reducing costs, and improving software quality. Widely credited for reinventing software testing for DevOps, cloud, and enterprise applications, Tricentis has been recognized as a leader by all major industry analysts, including Forrester, Gartner, and IDC. Tricentis has more than 3,000 customers, including the largest brands in the world, such as McKesson, Allianz, Telstra, Dolby, and Vodafone. To learn more, visit https://www.tricentis.com.

  • Survey Sees AI Playing Larger Role in Test Automation

    Survey Sees AI Playing Larger Role in Test Automation

    A survey of 1,028 senior IT professionals and application developers in the United Kingdom, U.S., Germany and Singapore finds nearly half (47%) still use manual testing for mobile applications. More than a third (38%) noted that their organization could save between half and three-quarters (51-75%) of funding allocated to testing per year by fully automating mobile application testing.

    Conducted by the market research firm Censuswide on behalf of Tricentis, a provider of a test automation platform, the survey also found that just under half of respondents (49%) reported their organization is already applying artificial intelligence (AI) to application testing. Another 21% plan to apply AI in the next six months. Almost three-quarters (74%) said their organization’s general sentiment toward AI in mobile software development testing is positive.

    Respondents also expected AI to improve mobile application quality (37%), increase productivity (36%) enhance end-user experience (34%) and to reduce the number of vulnerabilities and/or bugs (32%) in their applications.

    Mav Turner, chief product and strategy officer at Tricentis, said that rather than continuing to rely on expensive testing services, more organizations are looking to reduce costs by automating a wider range of testing workflows within the context of a DevOps workflow. In fact, the survey finds just under a third of respondents (32%) expect their organizations will invest more than $1 million to further automate testing.

    As modernization of testing processes continues, the return on investment in mobile application development will only continue to improve, noted Turner.

    The survey identifies the primary benefits of investing in test automation, which are increased productivity (32%), increased revenue (31%), increased user retention (28%) and increased compatibility across devices (28%).

    The primary obstacles organizations encounter as they strive to achieve that goal are competing priorities (28%), lack of technology and talent (25%), time (25%) and cost (24%), the survey finds.

    A full 87% said the quality of mobile applications is critical to their business, with 90% noting that poor mobile application quality costs their business as much as $2.49 million in lost revenue per year. However, just over a quarter (27%) said they believe their organization’s current mobile application development and testing strategy exceeds expectations.

    As part of efforts to automate testing, it’s not clear just how far responsibility for testing is shifting left toward developers, but there is no doubt many more are being exposed to the results earlier in the software development life cycle. The goal is to provide continuous testing capabilities without overly disrupting code writing. It’s also becoming simpler for developers to leverage generative AI tools to provide summaries of tests along with recommendations to improve code. The end result should be higher-quality applications that require less troubleshooting once deployed in a production environment.

    In the meantime, as organizations continue to become more dependent on mobile applications to drive a wide range of digital transformation initiatives, the cost of testing will continue to pale in comparison to the potential amount of lost revenue that might occur when end users either don’t invoke a specific feature or capability or, more commonly, simply abandon the application altogether.

  • Tricentis Adds Device Cloud Service to Scale Mobile App Testing

    Tricentis Adds Device Cloud Service to Scale Mobile App Testing

    Tricentis has extended its cloud service for testing applications to include the ability to emulate multiple classes of mobile computing devices.

    Mav Turner, CTO for DevOps at Tricentis, said the Tricentis Device Cloud (TDC) eliminates the need for organizations to acquire multiple physical devices to test mobile applications at scale.

    Capabilities include the tracking of key performance indicators (KPIs) such as blurriness, slow downloads, HTTP redirects and network or connectivity issues that adversely impact the user experience, in addition to performance issues such as load times and excessive consumption of CPU, memory and battery resources.

    The grid-based service also uses machine learning algorithms to apply artificial intelligence (AI) to monitor application performance and detect video and audio quality issues.

    Overall, the goal is to make it simpler for DevOps teams to build and deploy mobile applications faster and make sure they are thoroughly vetted rather than waiting for feedback from end users to discover issues that could have been easily identified before an application is deployed, said Turner.

    The launch of TDC follows the company’s acquisition of Waldo, a provider of a software-as-a-service (SaaS) platform that provides IT teams with a no-code tool for generating mobile application tests. Waldo uses a virtual environment to simulate iOS and Android devices in a way that eliminates the need for physical devices to conduct tests. Instead, DevOps teams record their applications and then use the no-code tools to generate tests directly from within a browser.

    In the meantime, the debate over how far application testing should be shifted left toward developers continues to rage. In theory, the more developers test applications themselves the fewer issues there should be once an application is deployed in a production environment. However, there is still going to be a need for dedicated testing teams to conduct tests across multiple stages of the application development process to ensure quality. In fact, as more routine tests are conducted by developers, it should free up application testers to focus more on edge use cases that might otherwise not be tested before being encountered by end users, noted Turner.

    Testing mobile applications is more critical than ever because the cost of failure—in terms of impact on the business—is now much higher as more organizations depend on software to drive business processes. The challenge is that many of these app developers don’t have a software engineering mindset, so they need testing platforms that automatically create and run tests on their behalf in a way that can be customized for specific use cases. In time, many of those tests will be automatically created by artificial intelligence (AI) models that should reduce the cognitive load required to manage the testing process, added Turner. In effect, application testing will soon be democratized by AI, he noted.

    Over time, the quality of applications should steadily improve as many of the low-level mistakes that developers make are eliminated. That should improve everything from application security to the user experience before mobile applications are initially deployed and then continuously updated.