DevOps – It’s all about continuous testing !

DevOps It's All About Testing

I loved reading Steve Wilson’s blog post “Don’t Fear Testing Team. DevOps is Here!” https://devopsy.kinsta.cloud/blogs/dont-fear-testing-team-devops-is-here/  The idea that DevOps  somehow reduces the need for testing  certainly puts fear in the hearts of QA and test teams who may envision the demise of product quality,  reduced test resources and even their very livelihood.  I understand the sentiment of the idea about testing going away, but this is misleading.

Testing is important to DevOps. Prior to code integration to trunk, developers pre-flight test their code to make sure it doesn’t blow up the trunk. During the CI cycle and code commits from multiple developers integration testing is used to verify merges.  During the continuous testing phase where nightly and weekend regression runs are automated for trunk and release branches it is testing that does the job of finding problems before the software release.  During the development process the verdicts trends from testing are a primary measurement of progress. During the release deployment phase more testing verifies the release packages are ready for release.  Rest assured test team, you are needed.  What DevOps really does is bring testing into the mainstream of development processes, and avoids the problems created by having “big-bang” testing left to the end of the cycle, such as release delays, and quality issues.

Testing maturity is a key differentiator of best practices DevOps infrastructures. My experiences with DevOps infrastructures over the years indicate that testing maturity is a key differentiator of overall DevOps infrastructure maturity. Many organizations can automate their integrations, builds and delivery processes but still have trouble with the subtleness of test orchestration and automation.  There is a vital role for testing architects and testing teams to offer their expertise for test design, test automation and test case development with DevOps.   Whether the organization is using a test driven development methodology, behavior based test creation, model-based testing or whatever they use, testing is a vital part of the overall DevOps process — not only to ensure verify code changes work and integrate well — but to ensure the changes do not blow up the product. So clearly testing is still an integral part of product development and delivery.

At my company Spirent we think testing has a bright future in DevOps. You can read more about our views at http://www.spirent.com/solutions/devops

Comments

8 responses to “DevOps – It’s all about continuous testing !”

  1. […] solutions architect of DevOps continuous test solutions atSpirent Communications, says in his blog that DevOps brings testing into the mainstream of development processes, and avoids the problems […]

  2. […] Marc Hornbeek是思博伦通信(Spirent Communications)的DevOps持续测试方案的高级解决方案架构师,他在一篇博文中表示,DevOps使测试成为开发流程中的主流,并且避免了在传统开发周期结束前才开始的“大爆炸”式测试方法所带来的问题,例如发布的延迟及质量缺陷。 […]

  3. vishnu nallani Avatar
    vishnu nallani

    Great article, how do you see tools like Cucumber fitting into DevOps process

  4. Marc Hornbeek Avatar
    Marc Hornbeek

    Cucumber is certainly one of the testing tools that fits well into DevOps. It uses a Behavior Based description approach that is well suited to applications that can be easily described. DevOps testing does not depend on any one tool or test methodology but cucumber is a good one. Of course I may be biased but I do like Spirent’s Velocity and iTest tools because they not only automate testing in a program-agnostic way but also provide an integrated lab management environment which integrates well into a comprehensive continuous test and management strategy. http://www.spirent.com/Solutions/DevOps

  5. Rick Avatar
    Rick

    Thanks for an interesting article. Cucumber is a business collaboration tool, not a test tool. It helps the business communicate requirements with the BAs in such a way that developers can more easily translate into working code and it follows BDD principles.

    It is erroneously used by testers as a “test tool” but it was not designed with testing in mind: https://cucumber.io/blog/2014/03/03/the-worlds-most-misunderstood-collaboration-tool

    I have worked with organisations where Cucumber is used as part of the test automation process AFTER the code is written. This is a complete waste of time and dangerous, but I don’t think people fully understand – the above is essential reading in my opinion!

  6. 2019-02-07 – Zukunftsthemen, eine erste Auswertung

    Prozesse und Arbeitsweisen Arbeitsweisen Arbeitsfo

  7. 2019-02-07 / 15 – Zukunftsthemen, eine erste Auswertung

    Prozesse und Arbeitsweisen Arbeitsweisen Arbeitsfo

Leave a Reply