June 25, 2020 // By Magenic
Creating and implementing an overall automation roadmap and strategy that aligned with business goals.
A major automotive insurance provider sought to improve and enhance quality of an existing core business application to enable frequent releases and reduce time to market.
The organization was suffering from a testing cycle that would take 3 weeks or longer to execute. As a result, releases were frequently cancelled or delayed as defects were often discovered just days or hours before a release. Defects were also often discovered in production due to the lengthy testing cycle, causing end customer issues and a higher cost to fix.
The organization lacked a proper testing infrastructure, with little to no automation, or standard practices. Testing was mainly performed manually and ad-hoc. Since QE was always playing catch-up, regression coverage was non-existent. In addition, there were challenges with the Dev to QE ratio and requirements.
Magenic implemented a CI/CT (continuous integration/continuous testing) DevOps enabled automation deployment pipeline and developed a project-level testing process that incorporated scalable agile processes to increase efficiency. Our team partnered with the client to create and implement an overall automation roadmap and strategy that aligned with business goals.
Once the automation framework was established, the team integrated automated testing with the new CI/CT process. This enabled the client to assess build quality prior to deployment.
Test coverage increased by adding an extensive automated regression suite that ran daily to quickly identify defects. A smoke test suite was also added to determine build viability.
Magenic QE helped implement ATDD (acceptance test driven development) processes where business owners wrote acceptance criteria that enabled the QE team to create tailored automation tests.
Magenic implemented QE processes and automation best practices resulting in increased efficiencies and significant cost savings.
- Increased coverage by 7900%, from 0 to ~80 automated tests.
- Creation of automated tests allowed quick feedback loops ensuring quality and resulting in a standardized deployment pipeline that was less expensive and easier to maintain.
- Increased deployment frequency to 2 weeks from ~2 months.
- Increased automation coverage by 2900%, from 30 manual tests to 900 automated tests.
- Cycle times reduced by 18,000%, from 3 weeks to ~1 hour.
- Increased confidence of both test coverage and quality.
- Improved process and acceptance criteria decreased the time to test new features by 266%