For many teams, testing processes can’t keep up with development speed. This is especially true for teams that maintain legacy code bases, which are prone to regressions and must be carefully checked before each deployment. Finding a solution that balances reliable results with the speed and scalability that agile teams need to stay competitive can be a challenge. Here’s how PerformanceCentre found a solution to their regression testing roadblock by leveraging crowdtesting.
PerformanceCentre offers a SaaS platform for sales teams to calculate commissions. Their functionality has been built up over the past decade. As with many products with a significant amount of legacy code, regression testing is a critical component of every release. As a result, PerformanceCentre runs as many as 300 regression test cases for each two-week sprint.
Manual execution of PerformanceCentre’s regression test suite required up to 2 weeks of working hours, which puts strain on their lean technical team (4 developers and 1 tester). Finding an alternative to manually executing regression tests was critical to maintaining their deployment cadence without losing the coverage they needed.
While the team made an attempt at shifting to automation, creating and managing automated tests still required a significant amount of PerformanceCentre’s resources, without offering the reliable results they needed. The team considered opting for traditional outsourcing or hiring another test engineer in-house, but neither solution offered the speedy results that PerformanceCentre required to keep pace with their development sprints.
PerformanceCentre landed on crowdtesting as an alternative to traditional QA solutions. Because crowdtesting allows developers to tap into a huge network of trusted software testers, PerformanceCentre can run multiple tests simultaneously, completing their 2-week backlog of tests in around 30 minutes.
By relying on a crowdtesting platform, PerformanceCentre is able to outsource the work of regression testing to the crowd and reduce the amount of testing their team must do in-house. The results they get are not only fast but reliable, with minimal false positives, which gives PerformanceCentre more confidence in the quality of their code. Performance Centre can now release code the day after each sprint ends.
Check out this presentation from Technical Director Marc Fasel to learn more about Performance Centre’s journey from manual testing to agile testing using the crowd. In this deck, Marc covers why he chose Rainforest QA over other crowdsourced testing solutions, and what the results have been.
Want to learn more about how crowdsourced testing helps teams manage regression testing their legacy code more effectively? Find out more about testing strategies for legacy code in our webinar with NPR’s Software Development Manager Paul Miles.
Crowdsourced testing is an emergent method of QA testing which leverages a dispersed, temporary workforce to test software applications quickly and effectively.
Using crowdsourced testing to achieve the mobile app testing coverage teams need that is both affordable and fast enough to leverage without slowing down deployment.
While it’s true that manual testing can be a bottleneck when it comes to fast-moving development, that doesn’t mean you should abandon it entirely.
Crowdsourced testing provides a more flexible, cost-effective means of increasing testing bandwidth and improving product quality for companies like ConsumerAffairs.