Unified Operations & Dynamics AX Forum

Expand all | Collapse all

Automated regression testing for D365

  • 1.  Automated regression testing for D365

    TOP CONTRIBUTOR
    Posted Apr 24, 2019 12:04 AM
    I wonder if anyone here has implemented automated testing tool for regression testing.

    Are people using Microsoft provide tool? (are there any?) or 3rd party tools?
    Are you testing just UI or also interfaces?

    With the runaway train which is the "one version" upgrades every 6 months, how do you plan to deal with the amount of regression necessary?

    ------------------------------
    Zvika Rimalt
    Functional Consultant
    Vancouver BC
    ------------------------------


  • 2.  RE: Automated regression testing for D365

    Posted 30 days ago
    Zvika

    There are tools from MS that help you test your D365 implementation/running production environment. The tool is called Regression Suite Automation Tool, short RSAT.
    RSAT works together with LCS and Azure DevOps. In LCS BPM you store your task recordings coming from D365. In DevOps you manage your test plan and test cases.

    We are currently setting up RSAT as the test automation tool of choice. We'd like to use as much MS tools as possible so we stay in "their universe".

    During the RSAT workshop MS promised to make the whole setup process of RSAT easier. At the current state, it's quite cumbersome to get things running.

    Once all is installed, it works as intended. There are some basic rules which need to be covered
    • Create a dedicated LCS BPM library for RSAT only
    • Create a corresponding Azure DevOps project for your RSAT test plan
    • Don't record E2E scenarios - rather record small portions of a process (e.g create a customer, then create a sales order, then...)
    • Start with a small batch of recordings to create an E2E process
    Try to think small and once this works, grow your test library! If you want too much already in the beginning you're likely to end up frustrated and chasing errors.

    We test UI, ISV add ons and integrations as far as (technically) possible.

    Hope I could help

    Best
    Andreas

    ------------------------------
    Andreas Mörker
    Global Master Data Manager
    SIGVARIS
    ------------------------------



  • 3.  RE: Automated regression testing for D365

    TOP CONTRIBUTOR
    Posted 29 days ago
    Edited by Zvika Rimalt 29 days ago
    Thanks Andreas,

    Do I understand correctly from your message your company is in the process of implementing and has not gone live in production with the testing tools?

    Also  - in addition to run tests that verify transaction entry by users, can this tool also test interfaces?


    ------------------------------
    Zvika Rimalt
    Functional Consultant
    Vancouver BC
    ------------------------------



  • 4.  RE: Automated regression testing for D365

    Posted 26 days ago
    Yes, we are currently preparing the tool. Recording the processes is a heck of a business and takes much more time than MS tells you.
    We won't be testing in Prod. We have an identical UAT System that matches almost Prod (in terms of sizing). where we do run the RSAT tool.

    It also works on a dev box but is not recommended due to transaction data loads you want to test!

    You can test interfaces as well but you need to carefully think this through, where to start and how to trigger, etc.! Best would be do specifically draw the entry points and how to trigger.

    Also, the support from your interface provider in terms of testing environment needs to be in place.

    ------------------------------
    Andreas Mörker
    Global Master Data Manager
    SIGVARIS
    ------------------------------



  • 5.  RE: Automated regression testing for D365

    GOLD CONTRIBUTOR
    Posted 29 days ago
    Hi Zvika,

    We've lined up a speaker about this for our upcoming AXUG meeting on June 6th.

    Details to come...

    Thanks,

    Chris

    ------------------------------
    Christopher Ho Yee
    Altius Consulting
    Richmond BC
    ------------------------------



  • 6.  RE: Automated regression testing for D365

    GOLD CONTRIBUTOR
    Posted 28 days ago
    + some very good insights here https://henrikmarxlarsen.wordpress.com

    ------------------------------
    Regards
    Rahul Mohta
    Advisor - #D365FO
    Real Dynamics
    California, USA
    ------------------------------



  • 7.  RE: Automated regression testing for D365

    Posted 25 days ago
    Zvika,

    We have spent significant resources in testing RSAT is presented and the results are not positive.  We have determined we can complete the regression testing as a team faster and more efficiently.  As a a warehouse and inventory control analyst, I can say I am at a meeting now to see how RSAT can integrate with WMS which could be a significant help to our business.

    As far as 3rd party tools, we are in the process of reviewing and testing a few, two of them are Axeptance https://axeptance.com/ and Rapise https://www.inflectra.com/Rapise/.

    ------------------------------
    William McLendon
    CRC Industries, Inc.
    Horsham PA
    ------------------------------



  • 8.  RE: Automated regression testing for D365

    TOP CONTRIBUTOR
    Posted 25 days ago
    Thanks William, please keep updating on this thread what you find out about WMS testing - we have the same requirement.

    I find it quite ironic that Microsoft on one hand pushes all customers to the "one version" path where you are forced to do much more upgrades every year (so tons more regression testing that you would have chosen to do), but yet not providing a very good solution for automated regression.


    ------------------------------
    Zvika Rimalt
    Functional Consultant
    Vancouver BC
    ------------------------------



  • 9.  RE: Automated regression testing for D365

    Posted 19 days ago
    ​I as well am looking to understand how the Microsoft proposed OneVersion Automated Testing Solution will be rolled out.  It appears that the solution is not ready for prime time and still weeks out before we can get our hand on it.  Are there any webinars, classes, sessions, etc... to attend to get up to speed with the configuration and start-up?

    ------------------------------
    Dennis Thimling
    Jasper Engines
    Jasper IN
    ------------------------------



If you've found this thread useful, dive deeper into User Group community content by role