I wonder if anyone here has implemented automated testing tool for regression testing.
We specialize in Testing D365 and have automated in excess of 10,000 test scripts for different customers across different modules of DS365. We automated these scripts using multiple Test Automation tools, including Microsoft CUI, Selenium and Quick Test Professional. We developed a Test Automation Framework called Frameium, specifically for D365 that sits on top of these tools. The automation framework will speed up the automation process by 40% compared to automating from scratch.
Are people using Microsoft provide tool? (are there any?) or 3rd party tools? Are you testing just UI or also interfaces?
Microsoft has recommended/provided different solutions at different times-Visual Studio Coded UI, EasyRepro & RSAT. The last two make use of Selenium and does address different areas - CE and F&O; both have limitations in coverage and maintenance. The approach has been predominantly UI based. API automation for integration/ interfaces with other third party systems must be handled separately using established API drivers. Several users have resorted to enterprise class automation products from commercial vendors to reduce maintenance efforts and work around the flakiness of Selenium-based solutions. With the runaway train which is the "one version" upgrades every 6 months, how do you plan to deal with the amount of regression necessary?
The "one version" or Evergreen solution from Microsoft will mean that upgrades will come through more regularly 6 months + patch upgrades. The only way to deal with it is to ensure that you have a good set of automated regression test which covers your key business functions. if you have a DevOps CI/CD pipeline you can integrate these tests into the pipeline. Once this is done you can run these automated tests prior to releasing the upgrades to your users. This becomes very critical if there is configuration changes, customization, integration with other software products. With a good set of automated regression tests you can run them as often as you like, daily, weekly, monthly so that you can detect any issues at the earliest possible moment. Please note that there will be some level of investment needed to build the automated regression test pack and to maintain them but the return on this investment is extremely good. The alternatives are either test each upgrade manually or take a risk - upgrade and hope for the best.
If you've found this thread useful, dive deeper into User Group community content by role