Unified Operations & Dynamics AX Forum

Expand all | Collapse all

Incremental update jobs pushing full data load

  • 1.  Incremental update jobs pushing full data load

    Posted 09-13-2018 02:53 PM
    We are running D365 hosted by Microsoft, and we have 4 distribution schedule jobs (1040/1070/1110/1150) running as a single batch job, Sundays through Thursday.
    These jobs should pull incremental changes each night but pretty much every 3rd night, they do a full data extract and push.

    This is causing a lot of trouble in our integration jobs with our partners who are only expecting to receive the changes for the day.

    We've been told this may be caused by the SQL server log retention policy, deleting the logs after 2-3 days.  We've also recently updated to v8.0 and have just noticed this behavior, but because we upgraded, we can not see the download session history from our previous version (July 2017).

    Has anyone else noticed this behavior?  Have you seen it in prior versions, or only on 8.0?  Any solutions to tackle this and prevent sending full data loads?  We are concerned about the large amount of data these generate and the time it takes to integrate, especially as we look to implement full transactional loads in D365.

    ------------------------------
    Allan Russell
    Solutions Architect
    Kent Building Supplies
    Saint John NB
    ------------------------------


  • 2.  RE: Incremental update jobs pushing full data load

    Posted 09-14-2018 08:29 AM
    Hi Allan,

    The first thing you will want to check is in the Retail scheduler parameters form (Retail module > Retail IT > Headquarters setup > Parameters > Retail scheduler parameters) and make sure the "Full dataset generation interval in days" field is set to a value greater than 3 days. With this parameter set, the jobs seem to be sending incremental syncs until that threshold hits. That field is synced with the 1110 Global configuration field, so you may want to also schedule that job after making the change. 

    ------------------------------
    Sean Porter
    Supervisor
    RSM LLP
    Atlanta, GA
    ------------------------------



  • 3.  RE: Incremental update jobs pushing full data load

    Posted 09-17-2018 09:29 AM
    Thanks Sean.  Have checked that out and unfortunately it didn't seem to help. The setting was actually at 2 days in both our prod system (where we have the issue) running 8.0 and an older system with the July 2017 update that is not having the issues at all.
    Seems like it's a problem since the upgrade to version 8.  Doing some testing with product updates on both versions to get some more accurate data and timings as well.

    ------------------------------
    Allan Russell
    Solutions Architect
    Kent Building Supplies
    Saint John NB
    ------------------------------