D365 Finance & Operations and Dynamics AX Forum

View Only

Back to discussions

Expand all | Collapse all

D365 F&O Performance Testing

1. D365 F&O Performance Testing

1 Like
SILVER CONTRIBUTOR

Gabor Fulop
Posted Sep 24, 2019 02:54 PM
Hello All,

We will be going live on D365 for Finance and Operations (Azure-based, not on-premise) and are wondering what others have been doing for performance testing. In addition to speaking with our implementation partner as well as Microsoft, what tools are being used by others?

Thanks and regards,
Gabor

------------------------------
Gabor Fulop
Applications Manager
Transamerican Auto Parts
A Polaris Company
Home of 4WheelParts (4WP.com)
------------------------------
2. RE: D365 F&O Performance Testing

0 Like
GOLD CONTRIBUTOR

Steeve Gilbert
Posted Sep 25, 2019 08:18 AM
It might not help you but I'll share our experience. We filled the Subscritpion estimator the best we could and then added a lot of buffer to the values. Then we crossed our fingers... :)

------------------------------
Steeve Gilbert
Software Development Supervisor
Boa-Franc S.E.N.C.
QC, Canada
------------------------------

Original Message
3. RE: D365 F&O Performance Testing

0 Like
SILVER CONTRIBUTOR

Gabor Fulop
Posted Sep 25, 2019 12:41 PM
Hi Steeve, how has the performance been? If any issues, did Microsoft address the issue?

------------------------------
Gabor Fulop
Applications Manager
Transamerican Auto Parts
A Polaris Company
Home of 4WheelParts (4WP.com)
------------------------------

Original Message
4. RE: D365 F&O Performance Testing

0 Like
GOLD CONTRIBUTOR

Steeve Gilbert
Posted Sep 26, 2019 08:24 AM
Hi Gabor,

We were on Ax2009 before doing to D365. Of course the Web UI responsiveness is not as good as the Windows Native Ax2009 client. That's the first complaint of the end user but they get used it. Overall performance is ok but we are highly customized to that may have some impact. None the less, when we encounter major performance issue with open a ticket and gets resolved quickly. We open the ticket through our partner since they have a better MS Support Level, that way we skip the first layer of basic questions. But it's been quite while since we opened a ticket for performance.

------------------------------
Steeve Gilbert
Software Development Supervisor
Boa-Franc S.E.N.C.
QC, Canada
------------------------------

Original Message
5. RE: D365 F&O Performance Testing

0 Like
TOP CONTRIBUTOR

Mark Schurmann
Posted Sep 25, 2019 09:47 AM
We are equally interested in this topic. We have been on D365 for 3 years and filled out the subscription estimator during the initial implementation. Since then we have not really stressed the system. Even at the extremely low volume, no one is dazzled by the speed. We are now in the middle of a big integration effort with another system that will, at peek need to push as many as 1 million transactions overnight. We have completed a new subscription estimator, but I'm not sure Microsoft did anything with the first one. Our partner is telling us that Microsoft will monitor our transaction volume and resize accordingly. I don't think we can go live hoping that will happen.

Another issue is simply performing some benchmarking. Our LCS Test environment is multi-box, but it is currently supporting our production environment. We created a separate test environment in Azure to support the integration development, however this is a single box. We can make it bigger, but we don't think that really proves much.

Would anyone have a contact suggestion at Microsoft that can speak to this? We could open a ticket but I don't think it would get us to the right person.

------------------------------
Mark Schurmann
Accounting Systems Manager
Automobile Protection Corp
Norcross GA
------------------------------

Original Message
6. RE: D365 F&O Performance Testing

0 Like
vishal Dhawgaye
Posted Sep 25, 2019 05:36 PM
Hi Gabor,

You can use perf-sdk tool for performance testing.

https://docs.microsoft.com/en-us/dynamics365/unified-operations/dev-itpro/perf-test/single-user-test-perf-sdk
https://docs.microsoft.com/en-us/dynamics365/unified-operations/dev-itpro/perf-test/perfsdk-tutorial-lbd

------------------------------
vishal Dhawgaye
Hitachi Solutions America, Ltd.
------------------------------

Original Message
7. RE: D365 F&O Performance Testing

0 Like
SILVER CONTRIBUTOR

Gabor Fulop
Posted Oct 07, 2019 10:40 AM
Thanks Vishal, Our concern with the Performance SDK is that it will be discontinued after VS2019 and no clear direction has been given for roadmap. We are starting to look at 3rd party tools now.

------------------------------
Gabor Fulop
Applications Manager
Transamerican Auto Parts
A Polaris Company
Home of 4WheelParts (4WP.com)
------------------------------

Original Message
8. RE: D365 F&O Performance Testing

0 Like
Anish Roy
Posted Mar 10, 2020 12:57 AM
The reason for performance testing the cloud based version is still valid. The current assumption is that as it is in the cloud and that the cloud will provide adequate resources is not a good assumption. As D365 may be integrated with other systems the performance may be impacted due to the other systems or the connectivity. Normally on a D365 project the best practice is to evaluate whether performance is likely to be a risk factor. If you have very small number of users and very little configuration changes, a little or zero customization and very little integration with other systems then the likelihood of performance being a risk is low.

If the opposite Is true and you consider performance is a risk factor then you should start performance testing exercise as part of your implementation plan. The approach is to consider the key business workflows for the business, for example, raising an invoice or invoice to cash. Select anywhere between 5 and 15 such workflows then use the performance testing tool to simulate the load for those workflows and monitor the resources. The typical performance testing tools used for D365 include Microfocus Performance Centre or Storm Runner, Jmeter, Visual Studio Web and Load. We have executed over 50 performance testing engagements on D365 / Dynamics on premise and have generated common libraries for performance testing. Our experience, expertise and accelerators have given faster and more concise results from a performance testing engagement. You may do the first one alongside us, learn and execute future ones by yourself.

------------------------------
Anish Roy
Director - D365 Quality Assurance
Testhouse Ltd
London, UK
https://www.testhouse.net/service-offerings/microsoft-solutions/dynamics-365-quality-consultancy/
------------------------------

Original Message
9. RE: D365 F&O Performance Testing

1 Like
TOP CONTRIBUTOR

Mark Schurmann
Posted Mar 11, 2020 09:18 AM
We are in the middle of trying to crack this nut. We have reached out to Microsoft to get information, but we are unable to make contact with anyone that can talk in detail about it. A couple things we've learned.

1. We revised our subscription estimate for our new transaction volume, but you cannot activate it yourself. You have to enter a support request. We were interested to know how the scale up happens because we do not want to simply throw the transaction increase at production and hope that it can handle the load. We had a call with Microsoft about this but no one could explain how it works. They advised us to open a support ticket to apply the new subscription estimate and see what happens. After a brief call with the tech, they initiated the scale up. To my surprise, this did not require scheduled downtime and didn't even take that long. The environment briefly went to a "Scaling up" status and then we had two additional AOS servers on our environment.

2. Prior to our Go Live, we need to test at scale. Here Microsoft is making it a little difficult. Microsoft will not scale up your UAT as described in item 1. The standard UAT is a Tier 2 and there is not another option. To test at scale, you have to purchase a separate Tier 4 or Tier 5 environment through you reseller. These can be purchased for a number of months. The structure and pricing of these options are weird and, considering that most customer don't need an environment sized for performance testing for an extended period of time, the pricing seems a bit gougy. Alternatively, you can add one of these environments to your subscription, but then you are committed for the entire year and who needs this type of system for an entire year. It would be nice if D365 would adopt the "pay for what you need" strategy that Azure is using. It would be lovey to be able to perform functional testing on the Tier 2 UAT, request a scale up for a short period to performance test, and then scale back down.

------------------------------
Mark Schurmann
Accounting Systems Manager
Automobile Protection Corp
Norcross GA
------------------------------

Original Message
10. RE: D365 F&O Performance Testing

0 Like
Travis Kurtz
Posted Mar 11, 2020 01:41 PM
Edited by Travis Kurtz Mar 11, 2020 02:22 PM
| view attached
We are on D365 10.0.7 Update 31.

Regarding Performance Testing
https://www.youtube.com/watch?v=qaO8vaP9EUI

UAT
We use Azure DevOps. You can set up all your test cases there. https://azure.microsoft.com/en-us/blog/deep-dive-into-azure-test-plans/ You can assign test cases to users, track bugs, assign bugs and there is a live dashboard of testing progress. You can also have the user create step by step task recordings in the D365 F&O, sync it to LCS & sync LCS to Azure DevOps to create the test cases.

By doing this you are creating the opportunity in the future to set up the Regression Suite Automation Testing to run some of your tests through Microsofts automated testing tool. https://docs.microsoft.com/en-us/dynamics365/fin-ops-core/dev-itpro/perf-test/rsat/rsat-overview

------------------------------
Travis Kurtz
Mansfield Oil Company
Gainesville GA
------------------------------

Attachment(s)

RSAT Workshop Bellevue.zip 8.61 MB 1 version

Original Message
11. RE: D365 F&O Performance Testing

0 Like
SILVER CONTRIBUTOR

Gabor Fulop
Posted Mar 12, 2020 06:17 PM
We ended up using StressStimulus and did the performance testing ourselves. We had three rounds of testing so far and had a one-week Microsoft PFE engagement as well as FastTrack support. We identified a number of issues with custom and Microsoft code as well as database indeces that needed to be added. Microsoft was actually very helpful through this process. The StressStimulus tool was a modest investment and was pretty easy to script. Please let me know if any users have questions.

Best regards,
Gabor

------------------------------
Gabor Fulop
Applications Manager
Transamerican Auto Parts
A Polaris Company
Home of 4WheelParts (4WP.com)
------------------------------

Original Message