{"id":299,"date":"2018-07-10T23:07:58","date_gmt":"2018-07-10T23:07:58","guid":{"rendered":"http:\/\/rainforestqa.com\/2018-07-10-3-test-automation-limitations-technical-leaders-should-know-about\/"},"modified":"2025-03-18T13:21:57","modified_gmt":"2025-03-18T13:21:57","slug":"2018-07-10-3-test-automation-limitations-technical-leaders-should-know-about","status":"publish","type":"post","link":"https:\/\/www.rainforestqa.com\/blog\/2018-07-10-3-test-automation-limitations-technical-leaders-should-know-about","title":{"rendered":"3 test automation limitations technical leaders should know about"},"content":{"rendered":"<p id=\"\">Test automation should be a part of your software quality strategy, especially as your organization and product grow in size and complexity. Implemented thoughtfully, test automation speeds up quality feedback accelerating time to software improvements, overall reducing the time to deliver high-quality products into the hands of your customers.<\/p>\n<p id=\"\">Yet test automation does not magically lead to quality success. A successful test automation strategy contains a range of hidden costs, from <a href=\"https:\/\/www.rainforestqa.com\/blog\/hire-qa-engineer\" target=\"_blank\" rel=\"noopener\">hiring quality engineers<\/a> to script and manage tests, to maintaining the environments in which automated tests run. It&#8217;s important to consider the biggest limitations of test automation before biting the (not-so-silver) bullet.<\/p>\n<blockquote id=\"\"><p>Test automation isn&#8217;t necessarily the nirvana people think it is when they&#8217;re looking for solutions to QA. &#8211; Derek Choy, COO of Rainforest QA<\/p><\/blockquote>\n<p id=\"\">Rainforest CTO and co-founder, and Rainforest COO\u00a0Derek Choy recently sat down to discuss the limitations of test automation that technical leaders should know before building automation into their strategy. Here are 3 limitations that should not be ignored:<\/p>\n<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_82_2 counter-hierarchy ez-toc-counter ez-toc-custom ez-toc-container-direction\">\n<div class=\"ez-toc-title-container\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">Contents<\/p>\n<span class=\"ez-toc-title-toggle\"><a href=\"#\" class=\"ez-toc-pull-right ez-toc-btn ez-toc-btn-xs ez-toc-btn-default ez-toc-toggle\" aria-label=\"Toggle Table of Content\"><span class=\"ez-toc-js-icon-con\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #999;color:#999\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewBox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #999;color:#999\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewBox=\"0 0 24 24\" version=\"1.2\" baseProfile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/span><\/a><\/span><\/div>\n<nav><ul class='ez-toc-list ez-toc-list-level-1 ' ><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/www.rainforestqa.com\/blog\/2018-07-10-3-test-automation-limitations-technical-leaders-should-know-about\/#1_Automated_test_cases_must_be_designed_for_repeatability\" >1. Automated test cases must be designed for repeatability<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/www.rainforestqa.com\/blog\/2018-07-10-3-test-automation-limitations-technical-leaders-should-know-about\/#2_Automated_test_cases_work_best_when_products_are_stable\" >2. Automated test cases work best when products are stable<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-3\" href=\"https:\/\/www.rainforestqa.com\/blog\/2018-07-10-3-test-automation-limitations-technical-leaders-should-know-about\/#3_Automated_test_cases_require_technical_skills_and_expertise\" >3. Automated test cases require technical skills and expertise<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-4\" href=\"https:\/\/www.rainforestqa.com\/blog\/2018-07-10-3-test-automation-limitations-technical-leaders-should-know-about\/#Learn_More_about_How_to_Create_an_Effective_Test_Automation_Strategy\" >Learn More about How to Create an Effective Test Automation Strategy<\/a><\/li><\/ul><\/nav><\/div>\n<h2 id=\"\"><span class=\"ez-toc-section\" id=\"1_Automated_test_cases_must_be_designed_for_repeatability\"><\/span>1. Automated test cases must be designed for repeatability<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p id=\"\">Many people implement test automation for fast product quality feedback whenever they need it. You write the tests once, then can run them over and over and over again with a quick click of a button or a simple command. At least that&#8217;s the idea. right?<\/p>\n<p id=\"\">This works only if automated test cases are setup with repeatability in-mind. Automated test cases often require hours of your technical team&#8217;s time to set up, and even more time to troubleshoot and maintain. If it can&#8217;t run repeatedly after you&#8217;ve spent resources building it, you won&#8217;t get faster feedback or actualize the value of test automation. The key to effective test automation is to optimize for ROI by prioritizing repeatability when building your test automation strategy.<\/p>\n<h2 id=\"\"><span class=\"ez-toc-section\" id=\"2_Automated_test_cases_work_best_when_products_are_stable\"><\/span>2. Automated test cases work best when products are stable<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p id=\"\">Technical leaders often turn to automated testing to effectively scale product quality processes, and for good reason! When done well, it can accelerate and streamline development cycles. <a id=\"\" href=\"\/blog\/2018-06-26-4-common-pitfalls-when-scaling-agile-qa\">But that&#8217;s not to say it&#8217;s without pitfalls<\/a>.<\/p>\n<p id=\"\">Leaning too hard into test automation is a common pitfall people face when scaling agile QA processes. <a href=\"\/blog\/2017-07-10-when-is-a-test-case-ready-for-test-automation\">Not every test case is a great fit for automation<\/a>. You&#8217;ll find scaling success by taking a balanced approach between automated and manual testing.<\/p>\n<p id=\"\">If your product is evolving quickly, with many changes to a large part of the product sprint-over-sprint, you&#8217;ll have to allocate a lot of time and resources to maintaining test scripts. Keep this in-mind before kicking off your automated testing strategy to prevent bottlenecks when scaling.<\/p>\n<h2 id=\"\"><span class=\"ez-toc-section\" id=\"3_Automated_test_cases_require_technical_skills_and_expertise\"><\/span>3. Automated test cases require technical skills and expertise<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p id=\"\">Test automation is not plug-and-play. The reality is that it requires a high level of technical skills and expertise to write and maintain test scripts. Technical expertise is very expensive, and likely one of your most limited resources.<\/p>\n<p id=\"\">This is perhaps one of the biggest limitations of test automation. When creating your strategy, you will need to consider the pros and cons of using technical talent for testing vs. new feature development.<\/p>\n<h2 id=\"\"><span class=\"ez-toc-section\" id=\"Learn_More_about_How_to_Create_an_Effective_Test_Automation_Strategy\"><\/span>Learn More about How to Create an Effective Test Automation Strategy<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p id=\"\">With these three limitations in mind, it is not to say that test automation is not a worthwhile investment. To learn more about how to create an effective test automation strategy, listen on demand to <a href=\"https:\/\/www.brighttalk.com\/webcast\/15641\/327913\" target=\"_blank\" rel=\"noopener\">What Technical Leaders Should Know Before Biting the Bullet<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Rainforest\u2019s CTO and co-founder, Russell Smith, and CIO, Derek Choy, recently discussed test automation limitations technical leaders need to know about before biting the bullet. In this post we cover the 3 biggest limitations to consider.<\/p>\n","protected":false},"author":7,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"content-type":"","inline_featured_image":false,"footnotes":""},"categories":[2],"tags":[],"class_list":["post-299","post","type-post","status-publish","format-standard","hentry","category-test-automation"],"acf":[],"_links":{"self":[{"href":"https:\/\/www.rainforestqa.com\/blog\/wp-json\/wp\/v2\/posts\/299","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.rainforestqa.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.rainforestqa.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.rainforestqa.com\/blog\/wp-json\/wp\/v2\/users\/7"}],"replies":[{"embeddable":true,"href":"https:\/\/www.rainforestqa.com\/blog\/wp-json\/wp\/v2\/comments?post=299"}],"version-history":[{"count":3,"href":"https:\/\/www.rainforestqa.com\/blog\/wp-json\/wp\/v2\/posts\/299\/revisions"}],"predecessor-version":[{"id":3096,"href":"https:\/\/www.rainforestqa.com\/blog\/wp-json\/wp\/v2\/posts\/299\/revisions\/3096"}],"wp:attachment":[{"href":"https:\/\/www.rainforestqa.com\/blog\/wp-json\/wp\/v2\/media?parent=299"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.rainforestqa.com\/blog\/wp-json\/wp\/v2\/categories?post=299"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.rainforestqa.com\/blog\/wp-json\/wp\/v2\/tags?post=299"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}