devopsy.kinsta.cloud

Tag: tricentis

  • APN Advanced Tier Partner Tricentis to Present on AWS Cloud Load Testing at SAP Sapphire

    Tricentis, the cloud’s #1 Continuous Testing Platform, announced today they will be presenting their Cloud Load Testing solution at the AWS booth at SAP SAPPHIRE NOW on Wednesday, May 8, 5:30 PM. This strategic new offering is now available on the AWS Solution Space.

    “Modern SAP applications, powered by S/4HANA and Fiori 2.0, involve many highly-distributed components—and a performance issue in any of them could have a ripple effect across the entire application,” explained Kevin Dunne, SVP of Strategic Initiatives at Tricentis. “Tricentis allows anyone involved in the quality process to start load and performance testing from their desktop. The same business-readable test case definitions used for functional testing can be used for load and performance testing.”

    Cloud-based Fiori load testing is just one part of Tricentis’ industry-leading SAP Testing for AWS offering. Tricentis Tosca, recognized as the #1 Continuous Testing Platform for SAP, helps leading enterprises modernize testing for SAP Digital Transformation initiatives. With the most advanced SAP business process test automation technology on the market, Tricentis Tosca helps enterprises effortlessly expose change impacts to their core end-to-end business transactions—across and beyond SAP (APIs, web UIs, Java, mobile interfaces, mainframes, data warehouses, and more).

    The solution features include:
    Automated End-To-End Testing for SAP: Automatically test your SAP implementation and beyond. Test business processes across all connected applications + APIs

    • Validate SAP Workloads on AWS: Prevent business disruption by revalidating SAP business processes – measure performance impacts across each critical path
    • Load Testing for SAP Fiori: Easily construct and run load tests specifically tuned to support SAP Fiori
    • AI-Enabled Testing for the Business User: Tricentis Tosca’s model-based test automation approach enables business users to rapidly create resilient, reusable test assets.

    Learn more about Tricentis SAP Testing and Cloud Load Testing for AWS

    About Tricentis

    With the industry’s #1 Continuous Testing platform, Tricentis is recognized for reinventing software testing for DevOps. Through agile test management and advanced test automation optimized to support 150+ technologies, we provide automated insight into the business risks of your software releases—transforming testing from a roadblock to a catalyst for innovation. The result is accelerated software delivery speed, improved cost efficiency, and reduced business risk.

    Tricentis is the only vendor to achieve unanimous “leader” status. This honor is based on our technical leadership, innovation, and a Global 2000 customer base of 1600+ companies, including global enterprises such as Allianz, ANZ Bank, Cisco, Dolby, Experian, First Data, HSBC, Merck, Office Depot, Samsung, Swiss Re, Starbucks, Telstra, UBS, Vodafone, Whole Foods, and WorldPay. Customers rely on Tricentis to achieve and sustain test automation rates of over 90 percent—increasing risk coverage while accelerating testing to keep pace with Agile and DevOps.

    Tricentis has a global presence in Austria, Australia, Belgium, Denmark, Germany, India, Netherlands, Singapore, Switzerland, Poland, United States and the UK. To learn more, visit https://www.tricentis.com or follow us on LinkedIn, Twitter, and Facebook.

     

  • Tricentis Launches, Expands Second Annual Testing Heroes Awards

    Two new team-award categories to recognize collaboration and agile testing excellence

    MOUNTAIN VIEW, CA – April 30, 2019 – Tricentis, the leader in Continuous Testing, has launched its Testing Heroes 2019 awards program. In its inaugural year, Testing Heroes saw more than 52,000 votes come in from the supporters of 65 software testers across a number of categories. To recognize the outstanding contributions of even more testers and QA professionals, Tricentis has added two additional categories that will honor team efforts.

    Testing Heroes 2019 will recognize the winners of the following categories:

    • Tester of the Year
    • Test Manager of the Year
    • Test Team of the Year
    • Agile Testing Team of the Year
    • Exploratory Tester of the Year
    • Test Automation Expert of the Year
    • Performance Tester of the Year

    “Testing Heroes was such a tremendous success last year because of the awareness that was raised of the invaluable work that software testers perform each and every day,” says Tricentis CMO, Wayne Ariola. “It was amazing to see entire organizations around the globe rally behind one their fellow employees in last year’s competition. There were some truly innovative ways these organizations got out the vote to help their candidate win. We can’t wait to see what people come up with this year, and to celebrate with the winners at Accelerate Vienna.”

    Along with receiving a physical award, the Tester of the Year, Test Manager of the Year, and a representative from both the Test Team of the Year and Agile Testing Team of the year will each be awarded complimentary airfare, hotel stay, and conference pass to Accelerate 2019, Tricentis’ annual user conference being held November 13-14 in Vienna, Austria.

    About Tricentis
    With the industry’s #1 Continuous Testing platform, Tricentis is recognized for reinventing software testing for DevOps. Through agile test management and advanced test automation optimized to support 150+ technologies, we provide automated insight into the business risks of your software releases—transforming testing from a roadblock to a catalyst for innovation. The result is accelerated software delivery speed, improved cost efficiency, and reduced business risk.

    Tricentis is the only vendor to achieve “leader” status in all three top analyst reports (i.e., the “Triple Crown.”) This honor is based on our technical leadership, innovation, and a Global 2000 customer base of 1600+ companies, including global enterprises such as Allianz, ANZ Bank, Cisco, Dolby, Experian, First Data, HSBC, Merck, Office Depot, Samsung, Swiss Re, Starbucks, Telstra, UBS, Vodafone, Whole Foods, and WorldPay. Customers rely on Tricentis to achieve and sustain test automation rates of over 90 percent—increasing risk coverage while accelerating testing to keep pace with Agile and DevOps.

    Tricentis has a global presence in Austria, Australia, Belgium, Denmark, Germany, India, Netherlands, Singapore, Switzerland, Poland, United States and the UK. To learn more, visit https://www.tricentis.com or follow us on LinkedIn, Twitter, and Facebook.

  • Tricentis Recognized as a March 2019 Gartner Peer Insights Customers’ Choice for Software Test Automation

    The Gartner Peer Insights Customers’ Choice Distinction is based on positive customer reviews and ratings

    Tricentis, the cloud’s #1 Continuous Testing Platform, announced today that it was recognized as a March 2019 Gartner Peer Insights Customers’ Choice for Software Test Automation. In addition to being named a Customers’ Choice, Tricentis was also recently positioned as a Leader in the 2018 Magic Quadrant for Software Test Automation for the fourth year in a row and scored the highest in the 2018 Gartner Critical Capabilities report for Software Test Automation for the Enterprise End-to-End Testing and Progressive Web Apps/Responsive Web/Native App use cases.

    Gartner Peer Insights Customers’ Choice selections are based on recognition of vendors submitted by verified end-user professionals. Gartner maintains rigorous criteria for recognizing vendors with a high customer satisfaction rate.

    “Over 1600 global organizations have adopted the Tricentis Continuous Testing Platform to accelerate Digital Transformation,” stated Tricentis CEO Sandeep Johri. “In a market that’s dominated by testing tools, our approach to customer success is focused on testing transformation.  The reason for Tricentis’ strong growth is that we partner with our customers to transform their testing process—versus just selling them point tools. These leading enterprises are now consistently delivering differentiating customer/user experiences through software while their less advanced competitors are living on borrowed time.”

     

    Numerous customer reviews for Gartner Peer Insights cited how Tricentis’ innovative model-based test automation has enabled them to rapidly transform their enterprise testing processes for Agile and DevOps. Here’s what some customers had to say:

     

    “Brought us from Zero to hero in QA automation” — IT Leader SDLC and QA tools in the Finance Industry

     

    “Tosca is an extremely powerful tool that can help you change your way of testing.” — Head Competence Center Testing in the Finance Industry

     

    “The future of Test Automation in the DevOps era” — Head of Solution Architecture – Air in the Manufacturing Industry

    “Innovative ideas, fast implementation of new features and very good support” — QA Staff in the Finance Industry

    “Quick adoption for a rapid start and early results.” — Specialist Test Manager in the Transportation Industry

    Read more reviews or share your own Tricentis review (Tosca or qTest)

    About Tricentis

    With the industry’s #1 Continuous Testing platform, Tricentis is recognized for reinventing software testing for DevOps. Through agile test management and advanced test automation optimized to support 150+ technologies, we provide automated insight into the business risks of your software releases—transforming testing from a roadblock to a catalyst for innovation. The result is accelerated software delivery speed, improved cost efficiency, and reduced business risk.

    Tricentis is the only vendor to achieve “leader” status in all three top analyst reports (i.e., the “Triple Crown.”) This honor is based on our technical leadership, innovation, and a Global 2000 customer base of 1600+ companies, including global enterprises such as Allianz, ANZ Bank, Cisco, Dolby, Experian, First Data, HSBC, Merck, Office Depot, Samsung, Swiss Re, Starbucks, Telstra, UBS, Vodafone, Whole Foods, and WorldPay. Customers rely on Tricentis to achieve and sustain test automation rates of over 90 percent—increasing risk coverage while accelerating testing to keep pace with Agile and DevOps.

     

    Tricentis has a global presence in Austria, Australia, Belgium, Denmark, Germany, India, Netherlands, Singapore, Switzerland, Poland, United States and the UK. To learn more, visit https://www.tricentis.com or follow us on LinkedIn, Twitter, and Facebook.

    Sources: Gartner Inc, “Critical Capabilities for Software Test Automation,” Joachim Herschmann, Thomas E. Murphy, Jim Scheibmeir, 18 December 2018. Gartner Magic Quadrant for Software Test Automation Joachim Herschmann, Thomas E. Murphy, Jim Scheibmeir November 27, 2018.

    Gartner Disclaimer: Gartner does not endorse any vendor, product or service depicted in its research publications, and does not advise technology users to select only those vendors with the highest ratings or other designation. Gartner research publications consist of the opinions of Gartner’s research organization and should not be construed as statements of fact. Gartner disclaims all warranties, expressed or implied, with respect to this research, including any warranties of merchantability or fitness for a particular purpose.

     

     

  • Tricentis Flood Announces Azure Integration for Cloud Load Testing

    Tricentis is proud to announce that its cloud load testing solution, Flood, has recently released an industry leading integration to Microsoft Azure.  With this integration, customers can now leverage their own Azure account to host their cloud load tests.

    This landmark release adds increased security and flexibility for Tricentis’ most demanding enterprise customers.  Specifically, many Microsoft customers may be looking for a replacement to the load testing capabilities in Visual Studio which will be deprecated after Visual Studio 2019. With this release, Flood is positioned as the leading solution to replace the native load testing functionalities that Microsoft customers have come to depend on.

    At Flood, we believe strongly in the benefits of using the cloud for load testing your applications, especially those wanting to achieve the economy of scale that this approach leverages.  With Azure as a consistent leader in IaaS, we will continue to invest in this fast growing Azure ecosystem with several key enhancements planned. Tricentis has already achieved the Gold partnership status and is scheduled to participate in key Microsoft events including Microsoft Ignite in November.

    Azure customers will be hard pressed to find a more complete solution than Flood.  With Flood’s hosted deployment option, you can use your own Azure account to create load injectors.  This is the most flexible option, being that it can create load within a VPC and allows for easier access behind firewalls using Static Public IP’s.    Teams now have the flexibility to leverage their existing agreement with Azure to allow them to choose any supported region or instance type.  Hosted accounts require some configuration and expertise with Azure, as well as billing both from Flood and Azure (for the server usage). We have detailed the process of connecting your Azure account with Flood for expedited configuration.

    If you are looking to load test in the cloud using Azure, we are eager to speak with you and share our expertise helping thousands of companies load test in the cloud.  Please feel free to reach out to us and schedule a consultation where we can walk you through the process.

  • Tricentis Delivers Powerful, Intelligent Automation Features for Azure, SAP, and DevOps Environments

    Enterprise customers will accelerate cloud migration, SAP S/4HANA adoption, and DevOps expansion with resilient Continuous Testing

    Mountain View, CA — February 26, 2019 —Tricentis today announced the latest release of Tricentis Tosca, the cloud’s number one Continuous Testing platform. As legacy testing tools from Micro Focus and Worksoft have failed to scale in DevOps environments, Tricentis Tosca delivers resilient Continuous Testing to over 1,600 enterprise customers.

    Tricentis’ industry-leading technology was recently recognized by Gartner in their Critical Capabilities for Software Test Automation 2018 report. Gartner gave Tricentis the highest product scores among 13 total vendors for the use cases “Enterprise End-to-End Testing” and “Progressive Web/Responsive Web/Native Apps.”

    “Organizations that have not transformed their software testing processes simply do not achieve their desired business results from DevOps and agile initiatives,” said Dr. Gerd Weishaar, Chief Product Officer for Tricentis. “Our 12.1 release includes a number of features that are critical to the success of cloud, DevOps, and digital transformation initiatives. The top software testing analysts recognize Tricentis as the leader each year, due to industry-leading advancements like those found in this latest release.”

    Tricentis Tosca 12.1 provides enterprises with:

    Greater scalability and collaboration via the Cloud
    Tricentis Cloud Repository (TCR) runs on Microsoft Azure’s highly-reliable infrastructure to deliver reduced maintenance and improved collaboration. TCR also leverages other reliability features such as point-in-time backups and geographic redundant services.

    Increased support for SAP digital transformation initiatives
    Tricentis extends the #1 Continuous Testing platform for SAP with the ability to extract and mask stateful test data from SAP NetWeaver. This added functionality and enhanced user interface expands Tricentis Tosca’s integration with SAP Solution Manager.

    Distributed Continuous Load Testing
    Tricentis Flood provides a continuous view of performance impacts as applications evolve. Flood gives every developer and tester a full-featured performance lab at their fingertips so teams can test, analyze, and improve their applications in real-time. This release adds new integrations with popular DevOps pipeline tools from Github, AppDynamics, New Relic, Dynatrace, Jenkins, and more.

    Intelligent Automation for BI/Datawarehouse Testing
    Quality assurance for Big Data, BI, and Data Warehouses requires deep technical understanding and excellent SQL skills. That is why this field… so far… has been reserved for developers and specialists. Tricentis Tosca 12.1 introduces a new SQL editor that can be seamlessly integrated into your favorite test IDE.  You can test run your queries, reduce errors with syntax highlighting, and use a translation view to see the actual data used during your test.

    Find out more about these updates and additional functionalities by checking out what’s new in Tricentis Tosca Continuous Testing Platform 12.1.

    About Tricentis
    With the industry’s #1 Continuous Testing platform, Tricentis is recognized for reinventing software testing for DevOps. Through agile test management and advanced test automation optimized to support over 150+ technologies, we provide automated insight into the business risks of your software releases—transforming testing from a roadblock to a catalyst for innovation. The result is accelerated software delivery speed, improved cost efficiency, and reduced business risk.

    Tricentis is the only vendor to achieve “leader” status in all three top analyst reports (i.e., the “Triple Crown.”) This honor is based on our technical leadership, innovation, and a Global 2000 customer base of 1600+ companies, including global enterprises such as Allianz, ANZ Bank, Cisco, Dolby, Experian, First Data, HSBC, Merck, Office Depot, Samsung, Swiss Re, Starbucks, Telstra, UBS, Vodafone, Whole Foods, and WorldPay. Customers rely on Tricentis to achieve and sustain test automation rates of over 90 percent—increasing risk coverage while accelerating testing to keep pace with Agile and DevOps.

    Tricentis has a global presence in Austria, Australia, Belgium, Denmark, Germany, India, Netherlands, Singapore, Switzerland, Poland, United States and the UK. To learn more, visit https://www.tricentis.com or follow us on LinkedIn, Twitter, and Facebook.

     

  • Tricentis Scored Highest in Gartner 2018 Critical Capabilities for Software Test Automation for Enterprise End-to-End Testing and Progressive Web Apps/Responsive Web/Native App Use Cases

    This recognition follows Tricentis being named a Leader in the 2018 Gartner Magic Quadrant for Software Test Automation for the fourth year in a row

    Tricentis announced that Gartner’s Critical Capabilities for Software Test Automation recognized Tricentis with the highest product score for the Enterprise End-to-End Testing use case, as well as for the Progressive Web Apps/Responsive Web/Native Apps use case. Tricentis also received the second and fourth highest product scores for Intelligent Testing and Continuous Testing use cases, respectively.

    [Download the Critical Capabilities for Software Test Automation report now]

    “We believe that Tricentis’ position in the Critical Capabilities report—paired with our 4th consecutive recognition as a Leader in the Gartner Magic Quadrant for Software Test Automation—highlights why over 1600 enterprise customers have selected Tricentis as their partner for transforming software testing for Agile and DevOps,” stated Tricentis CEO Sandeep Johri.

    Tricentis was recently named a Leader in Gartner’s 2018 Magic Quadrant for Software Test Automation research report for the fourth consecutive year. Tricentis was also positioned furthest to the right on the completeness of vision axis for the second consecutive year. In its explanation of completeness of vision, the report notes, “Leaders having a Completeness of Vision are strong in their ability to reach the market via a compelling message and in delivering a solid solution globally. As enterprises engage in multiyear transformations involving agile, DevOps and bimodal practices, the ability of a vendor to create a vision of test automation that consistently creates value along the way and drives positive change will be crucial. The key messages now are around productivity and the ability to aid in technology and process transformation.”

    For details on Tricentis’ SAP testing and enterprise end-to-end testing functionality, see SAP Test Automation and SAP Testing Resource Center.

    About Tricentis

    With the industry’s #1 Continuous Testing platform, Tricentis is recognized for reinventing software testing for DevOps. Through agile test management and advanced test automation optimized to support 150+ technologies, we provide automated insight into the business risks of your software releases—transforming testing from a roadblock to a catalyst for innovation. The result is accelerated software delivery speed, improved cost efficiency, and reduced business risk.

    Tricentis is the only vendor to achieve “leader” status in all three top analyst reports (i.e., the “Triple Crown.”) This honor is based on our technical leadership, innovation, and a Global 2000 customer base of 1500+ companies, including global enterprises such as Allianz, ANZ Bank, Cisco, Dolby, Experian, First Data, HSBC, Merck, Office Depot, Samsung, Swiss Re, Starbucks, Telstra, UBS, Vodafone, Whole Foods, and WorldPay. Customers rely on Tricentis to achieve and sustain test automation rates of over 90 percent—increasing risk coverage while accelerating testing to keep pace with Agile and DevOps.

    Tricentis has a global presence in Austria, Australia, Belgium, Denmark, Germany, India, Netherlands, Singapore, Switzerland, Poland, United States and the UK. To learn more, visit https://www.tricentis.com or follow us on LinkedIn, Twitter, and Facebook.

    Source: Gartner Inc, “Critical Capabilities for Software Test Automation,” Joachim Herschmann, Thomas E. Murphy, Jim Scheibmeir, 18 December 2018.

    Gartner Disclaimer

    Gartner does not endorse any vendor, product or service depicted in its research publications, and does not advise technology users to select only those vendors with the highest ratings or other designation. Gartner research publications consist of the opinions of Gartner’s research organization and should not be construed as statements of fact. Gartner disclaims all warranties, expressed or implied, with respect to this research, including any warranties of merchantability or fitness for a particular purpose.

     

  • Tricentis Named a Leader in the 2018 Gartner Magic Quadrant for Software Test Automation for Fourth Year in a Row

    Tricentis is positioned furthest to the right on the completeness of vision axis

    MOUNTAIN VIEW, CA, November 29, 2018 – Tricentis, leader in Continuous Testing and software test automation, today announced that it has been named a Leader in Gartner’s 2018 Magic Quadrant for Software Test Automation research report for the fourth consecutive year. Tricentis is the only company that has appeared in the Leaders quadrant in each of the last four years.

    Complimentary report access: Gartner 2018 Magic Quadrant for Software Test Automation.

    According to the report, “Cloud and digital business demand a shift toward continuous quality. Application leaders must support their teams in integrating and effectively utilizing test automation tools in their DevOps toolchain, to enable continuous delivery.”

    “Digital transformation is all about ensuring an exceptional customer journey, and you simply cannot deliver that without Continuous Testing,” explained Tricentis CEO Sandeep Johri. “Whether you’re evolving a customized user experience via a mobile app or migrating SAP workloads to the cloud (e.g., with SAP S/4HANA), it all comes down to the speed at which you can deliver software. As both research and practice have shown, Continuous Testing is critical for rapidly assessing whether each release meets your expectations or could negatively impact your business.”

    Tricentis was positioned furthest to the right on the completeness of vision axis for the second consecutive year. In its explanation of completeness of vision, the report notes, “Leaders having a Completeness of Vision are strong in their ability to reach the market via a compelling message and in delivering a solid solution globally. As enterprises engage in multiyear transformations involving agile, DevOps and bimodal practices, the ability of a vendor to create a vision of test automation that consistently creates value along the way and drives positive change will be crucial. The key messages now are around productivity and the ability to aid in technology and process transformation.”

    “Achieving optimized Continuous Testing isn’t as simple as selecting the ‘best’ test automation tool; it’s a journey that involves people, processes, and technologies,” explained Tricentis Founder and Chief Strategy Officer Wolfgang Platz. “At Tricentis, we’ve had the pleasure of guiding hundreds of top enterprises along this journey—in collaboration with many exceptional quality leaders.  We believe this recognition belongs to them as well; we feel that we could not have achieved this recognition without their continued support and collaboration.”

    The Latest Addition: New Tricentis Agile Dev Testing

    Tricentis was in the process of adding qTest Agile Dev Testing to its portfolio as Gartner was researching and producing the 2018 Magic Quadrant for Software Test Automation. This means that Tricentis qTest was not included in the scope of this report.

    For Agile teams, Tricentis qTest adds a suite of software testing tools designed to improve speed, efficiency and collaboration throughout the software testing lifecycle. It provides:

    • Agile Test Management through manual and automated test traceability to Atlassian Jira issues, bugs, and releases in real-time.
    • Shift Left Quality Strategies with open source test automation management (making open source testing tools more productive), test script scheduling, and support for BDD.
    • Predictive Test Analytics to gauge release readiness through executive level dashboards and portfolio level reporting.

    These new Agile Dev Testing capabilities complement the company’s flagship Tricentis Tosca continuous testing, which provides resilient end-to-end regression testing across any architecture or application stack (150+ technologies). Additionally, Tricentis Flood integrates with both Tricentis Tosca and Tricentis qTest, giving developers and testers instant access to cloud-based performance labs for on-demand load testing.

    The complete platform enables:

    • Continuous Testing across all enterprise systems (web, SAP, mainframes, APIs, mobile…)
    • Test orchestration across teams, projects, and applications
    • Centralized visibility and traceability across all teams

     

    About Tricentis
    With the industry’s No. 1 Continuous Testing platform, Tricentis is recognized for reinventing software testing for DevOps. Through risk-based testing, scriptless end-to-end test automation, and the industry’s most extensive technology support, Tricentis breaks through the barriers experienced with conventional software testing methods. Our innovative technologies simplify testing for even the most complex enterprise applications—transforming testing from a roadblock to a catalyst for innovation. The result is accelerated software delivery speed, improved cost efficiency, and reduced business risk.

    Tricentis is the only vendor to achieve “leader” status in all three top analyst reports (i.e., the “Triple Crown”). This honor is based on our technical leadership, innovation, and a Global 2000 customer base of 800+ companies, including global enterprises such as Allianz, ANZ Bank, Experian, First Data, HSBC, Lexmark, Merck, Sentry Insurance, Starbucks, Telstra, UBS, Vantiv (now WorldPay), Vodafone, and Whole Foods. These customers rely on Tricentis to achieve and sustain test automation rates of over 90 percent—increasing risk coverage while accelerating testing to keep pace with Agile and DevOps.

    Tricentis has a global presence in Austria, Australia, Belgium, Denmark, Germany, India, Netherlands, Singapore, Switzerland, Poland, United States and the UK. To learn more, visit https://www.tricentis.com or follow us on LinkedIn, Twitter, and Facebook.

    Source: Gartner, “Magic Quadrant for Software Test Automation,” Joachim Herschmann, Thomas E. Murphy, Jim Scheibmeir, 27 November 2018.

    Disclaimer:

    Gartner does not endorse any vendor, product or service depicted in its research publications, and does not advise technology users to select only those vendors with the highest ratings or other designation. Gartner research publications consist of the opinions of Gartner’s research organization and should not be construed as statements of fact. Gartner disclaims all warranties, expressed or implied, with respect to this research, including any warranties of merchantability or fitness for a particular purpose.

     

  • DevOps Leaders vs. Laggards: Continuous Testing is a Key Differentiator

    DevOps Leaders vs. Laggards: Continuous Testing is a Key Differentiator

    New Forrester research, “The Definitive Software Quality Metrics for Agile + DevOps,” reveals what software quality metrics and practices differentiate DevOps/Agile leaders from DevOps/Agile laggards. The study was commissioned by Tricentis and led by Forrester VP and Principal Analyst Diego Lo Giudice.

    The study found that companies with the most successful Agile and DevOps initiatives do a number of things differently than their peers:

    • They are transforming software testing into continuous testing by adopting five core practices, such as automating end-to-end functional testing and integrating testers into cross-functional teams.
    • They are almost twice as likely to consider automating the software quality process to be a “critical business differentiator.”
    • They are significantly more likely to have high levels of automation for key testing and QA processes (test case design, functional test automation, test data management, etc.).

    However, only 26 percent of firms with active DevOps adoptions are currently practicing the five core continuous testing practices shown to separate leaders from laggards. And, as the infographic below highlights, many CXOs have a severely inflated sense of their firms’ DevOps and continuous testing maturity.

    Different DevOps Quality Metrics

    The study also identified the 20 most important Agile and DevOps quality metrics that separate DevOps/Agile experts from their less advanced peers. Forrester examined 94 quality metrics that were classified into four categories. Key findings include:

    • Understanding of business risk is the most important determining factor of DevOps and Agile maturity.
    • Experts focus primarily on contextual metrics (e.g., requirements coverage) while others focus on “counting” metrics (e.g., number of tests).
    • Experts are more likely to measure the user experience across an end-to-end transaction while others rely on application-specific or team-specific metrics.

    To determine the “most important” metrics, the research surveyed 603 global enterprise participants responsible for their firms’ Agile and/or DevOps strategies. Participants were first asked a variety of questions to assess the maturity of their Agile/DevOps practices. Next, they were asked what quality metrics they actually used, then asked to rank the value of each metric they regularly measured. Results from the Agile/DevOps experts were later separated from, and compared to, those of the “other” respondents. The most important metrics were determined by analyzing the experts’ value rankings for the metrics that they actually used.

    The Risk ‘Blind Spot’

    Risk was a prevalent thread throughout the various parts of the report. Although risk-related metrics did not rank high in overall popularity, Agile and DevOps experts measure them significantly more frequently than the non-experts did. In fact, Agile and DevOps experts consistently ranked risk-related metrics among their top three most valuable metrics in different phases and categories.

    Interestingly, most firms (80 percent) believe they deliver within acceptable business risk, but fewer than a quarter state that their QA and testing processes completely cover business risk. Only 15 percent of respondents say that their test suites reliably provide a good indication of business risk.

    From Tricentis’ analysis of Global 2000 companies’ test case portfolios, we’ve found that most test suites actually cover about 40 percent of the organization’s business risks. However, these test suites have a 67 percent level of redundancy on average—meaning that over two-thirds of the tests don’t actually increase their business risk coverage. This might be one cause of the disconnect: people assume that more tests means more business risk coverage, but that’s often not the case.

    Another likely cause is that most test results focus on pass/fail status, which doesn’t provide the required insight into whether the release has an acceptable level of risk. As companies move towards continuous delivery and automated release processes, real-time insight into business risk becomes critical for promoting acceptable releases as rapidly as possible while stopping potentially-damaging ones from proceeding down the release pipeline.

    Details and Additional Findings

    If you want to learn more about how Forrester arrived at these findings—and see how the 94 quality metrics ranked—you can read the complete “Definitive Software Quality Metrics for Agile+DevOps” on the Tricentis website.

     

    — Wayne Ariola

  • Forrester Study Reveals Software Quality Metrics that Differentiate DevOps Leaders from Laggards

    MOUNTAIN VIEW, Calif., July 23, 2018 (GLOBE NEWSWIRE) — Results from new Forrester Consulting research reveal the 20 most important Agile and DevOps quality metrics that separate DevOps/Agile experts from their less advanced peers. The study, which publishes today, was commissioned by Continuous Testing leader Tricentis and was led by Forrester Vice President and Principal Analyst Diego Lo Giudice.

    The research examined 94 quality metrics that were classified into four categories. As a high-level summary, the research uncovered the following:

    • Understanding of business risk is the most important determining factor of DevOps and Agile maturity.
    • Experts focus primarily on contextual metrics (e.g., requirements coverage) while others focus on “counting” metrics (e.g., number of tests).
    • Experts are more likely to measure the user experience across an end-to-end transaction while others rely on application-specific or team-specific metrics.

    Detailed results and analysis are available in the complete report: The Definitive Software Quality Metrics for Agile+DevOps.

    Agile/DevOps Leaders vs Laggards
    The study also found that companies with the most successful Agile and DevOps initiatives do a number of things differently:

    • They are transforming software testing into Continuous Testing by adopting five core practices, such as automating end-to-end functional testing and integrating testers into cross-functional teams.
    • They are almost twice as likely to consider automating the software quality process to be a “critical business differentiator” (53% vs. 27%).
    • They are significantly more likely (by 23 percentage points) to have high levels of automation for key testing and QA processes (test case design, functional test automation, test data management, etc.).

    “Organizations adopt DevOps to accelerate the delivery of innovative software that creates positive user experiences,” explained Clark Golestani, Managing Director of C Sensei Group and former President, Emerging Businesses and Global CIO of Merck. “If you start accelerating delivery without also rethinking your approach to quality, you will end up rapidly delivering updates that drive your customers to competitors. Automated, continuous testing is the gate that allows you to protect your organization from significant risk as you innovate at the speed modern business demands.”

    The Risk “Blind Spot”
    Risk is a prevalent thread throughout the various parts of the report. Most firms (80%) believe they deliver within acceptable business risk, but fewer than a quarter state that their QA and testing processes completely cover business risk. Moreover, just 15% of respondents say that their test suites reliably provide a good indication of business risk.

    Interestingly, although risk-related metrics do not rank high in overall popularity, Agile and DevOps experts measure them significantly more frequently than the non-experts do. In fact, Agile and DevOps experts consistently rank risk-related metrics among their top 3 most valuable metrics in different phases and categories.

    Additional Findings
    Other notable findings include:

    • Only 26% of firms with active Agile/DevOps adoptions are currently practicing the five core Continuous Testing practices shown to separate Agile/DevOps leaders from laggards.
    • Many CXOs and high-level decision makers are vastly overestimating the maturity of their firms’ Agile and DevOps practices.
    • Firms that rely on manual testing are more than twice as likely to report that testing is a bottleneck (59%), compared to those with more automated quality processes (26%).

    The complete Definitive Software Quality Metrics for Agile+DevOps report is available for complimentary download on the Tricentis web site.

    About Tricentis
    With the industry’s No. 1 Continuous Testing platform, Tricentis is recognized for reinventing software testing for DevOps. Through risk-based testing, scriptless end-to-end test automation, and the industry’s most extensive technology support, Tricentis breaks through the barriers experienced with conventional software testing methods. Our innovative technologies simplify testing for even the most complex enterprise applications—transforming testing from a roadblock to a catalyst for innovation. The result is accelerated software delivery speed, improved cost efficiency, and reduced business risk.

    Tricentis is the only vendor to achieve “leader” status in all three top analyst reports (i.e., the “Triple Crown”). This honor is based on our technical leadership, innovation, and a Global 2000 customer base of 800+ companies, including global enterprises such as Allianz, ANZ Bank, Experian, First Data, HSBC, Lexmark, Merck, Sentry Insurance, Starbucks, Telstra, UBS, Vantiv (now WorldPay), Vodafone, and Whole Foods. These customers rely on Tricentis to achieve and sustain test automation rates of over 90 percent—increasing risk coverage while accelerating testing to keep pace with Agile and DevOps.

    Tricentis has a global presence in Austria, Australia, Belgium, Denmark, Germany, India, Netherlands, Singapore, Switzerland, Poland, United States and the UK. To learn more, visit https://www.tricentis.com or follow us on LinkedIn, Twitter, and Facebook.

  • Testing Heroes to Recognize Individual Contributions to Continuous Quality

    Testing Heroes to Recognize Individual Contributions to Continuous Quality

    Testers have always been great at championing the superstars within the testing community, but who else outside of testing has been listening? Tricentis has launched a campaign aimed at making sure the rest of the world knows just how invaluable testers are, especially in today’s hyper-accelerated release cycles, and with user experience and customer satisfaction becoming the enterprise’s success metrics of choice.

    Testing Heroes will be an annual program in which software testers can be nominated for a variety of award categories, two of which—Tester of the Year and Test Manager of the Year—will be awarded a free trip to Vienna, Austria, to accept their award onstage at Tricentis’ Accelerate 2018 conference.

    Testing Heroes is split into six different categories:

    • Tester of the Year
    • Test Manager of the Year
    • The Explorer
    • The Automator
    • The Performer
    • The Risk-o-Meter

    A Unique Twist

    While most winners are decided on by the awarding organization, the 2018 Testing Heroes will be determined by the level of support from each nominee’s surrounding organization and network. The final round of Testing Heroes will be a voting round. Those whose nomination makes it to this round will be provided with a variety of ideas for encouraging others to rally behind their candidate to get them the recognition they deserve. There are myriad ways to spread the word in your office about the outstanding work being done by one of your own:

    • Encouraging others in your company to vote through Slack, email or an internal newsletter.
    • Recording a short, campaign-style video to share through social media.
    • An iPad loaded to the candidate’s voting page placed in a break room, kitchen or other communal area.
    • Desk-to-desk canvassing (to those who don’t mind you popping in unannounced!).

    One of our initial goals for this campaign was to learn more about the amazing contributions by those in the software testing community, but we quickly realized there is a bigger reward here: When a nominee’s peers bring to light the amazing work being done by one of their own during the campaign process, software testers’ efforts hopefully will be more understood and appreciated by a larger audience than they are currently. This is the real goal of Testing Heroes.

    We encourage you to nominate and then rally behind your own Testing Heroes today!

    — Anand Akela