D365 Finance & Operations and Dynamics AX Forum

Expand all | Collapse all

Budget account entries entity DataManagemetn Import Excel Templates Database size and logs increase abnormally

  • 1.  Budget account entries entity DataManagemetn Import Excel Templates Database size and logs increase abnormally

    Posted Apr 02, 2019 05:18 AM
    Hi ,

    Dynamics D365 Finance and operations on prime- Data Entity import getting databasesize and logs abnormally
    Budget account entries entity DataManagemetn Import Excel Templates with 20000 Records ,
    when I try to import the data management jobs it its importing and my database size same time increase with logs
    Please help us to solve resolve this issue for any settings need for update.

    ------------------------------
    Aslam J
    Arla Foods - Saudi Arabia
    ------------------------------


  • 2.  RE: Budget account entries entity DataManagemetn Import Excel Templates Database size and logs increase abnormally

    TOP CONTRIBUTOR
    Posted Apr 03, 2019 03:31 AM
    Hi Aslam,

    I'm not sure what you are asking here. Do you mean to say that the database logs are growing? If so, a successful backup should empty the log files.

    ------------------------------
    kind regards,

    André Arnaud de Calavon
    Solution Architect, Microsoft MVP - Microsoft Dynamics Business Solutions
    ------------------------------



  • 3.  RE: Budget account entries entity DataManagemetn Import Excel Templates Database size and logs increase abnormally

    Posted Apr 03, 2019 04:31 AM
    Hi André Arnaud de Calavon,
    thanks for your reply 

    Every 15 Minutes logs backups has schedule has taken successfully and full backup  itself scheduled with  every 6 hours   
     when Budget entry import job  running duration only my logs getting increased with 6 to 7 GB transaction log increased and database also increased with 300 Mb for Every 800 to1000  records  that i have noticed, Other time not getting increase as compared  while running job. normal 220 Mb only got log backup with 15 Mints . for normal transaction with batch integration posting not increased. and also for 3000 records import took for one hour. 

    ------------------------------
    Aslam J
    Arla Foods - Saudi Arabia
    ------------------------------



  • 4.  RE: Budget account entries entity DataManagemetn Import Excel Templates Database size and logs increase abnormally

    SILVER CONTRIBUTOR
    Posted Apr 03, 2019 06:09 PM
    Hi,
       Not quite sure exactly what you are saying, but I did have a problem with database size with exporting entities where 'skip staging' was turned off.  Some of my entities that I was exporting had a lot of data, and were been exported regularly.  This generated a lot of data in my staging tables.  Cleaning the staging data would reduce DB size a lot in these cases.  There are some entities that the staging can't be skipped due to virtual fields, but regular cleanup of these staging tables might assist you if that is your cause.  Unfortunately, there are no batch jobs for these, you have to do them individually.  Cleaning up the history log of data management should also clean up the staging that relates to the specific execution id.
    I've made some assumptions around he exact nature of your problem, but if it's related to the staging data for data entities, then cleaning the staging data should assist with your DB size issues.

    Regards,
    Andrew

    ------------------------------
    Andrew Friebel
    Gale Pacific Limited
    ------------------------------



If you've found this thread useful, dive deeper into User Group community content by role