Teams should leverage test automation. Used strategically, it increases efficiency and speeds up software delivery. Yet, not all tests are a great fit for automation, and teams often find that implementing it creates more challenges than it solves.
But that doesn't mean test automation can't be leveraged to create an optimized QA process. And the team over at DataRobot is doing just that! We sat down for a webinar with their VP of Engineering and Rainforest customer, Dustin Burke, and picked his brain on how they've optimized their QA strategy. Here is what we learned:
Every team and product is unique, with varying testing needs. While there's no one-size-fits-all way to do QA -- especially when deciding how many tests to automate -- there are innovative approaches all successful teams share.
Inspired by the Atlassian team's transition from Quality Assurance to Quality Assistance, DataRobot implemented a QA process that empowers developers to manage code quality with automated regression testing. Quality engineers (QEs) couple with developers as their quality coaches. Efficiently providing advice on common testing guidelines and overall regression test coverage.
QEs do more high-value testing, like exploratory testing, rather than spending their time on regression testing. -Dustin BurkeWith every member of the team contributing to product quality at each stage of the development cycle, QEs have more bandwidth to focus on high-impact testing initiatives. This approach doesn't just shift quality earlier in the development cycle. In DataRobot's case, this approach has created a culture of quality while optimizing resources.
It can be tempting to try automating everything when it comes to software testing. But not all tests are a good fit for automation, and targeting a meaningless goal is not a strategic way to manage QA. To get the benefits of test automation, you need to blend automated and human-executed testing by determining which test cases are a great fit for automation.
While DataRobot operates within a continuous delivery pipeline and automates as many tests as possible, they are strategic about which tests they automate. Furthermore, DataRobot finds ways to automate aspects of their testing process that are not a good fit for test automation.
We are heavily invested in test automation. We even have a dedicated team to make our automated tests scalable and cost-efficient. - Dustin Burke
Strategically automating tests is just one piece of DataRobot's QA success. Additionally, the team automates their manual testing process with the Rainforest platform.
Rainforest provided us with a new capacity to automate the equivalent to manual regression testing for flaky UI tests, previously done by human testers on our team. - Dusin Burke