You have a Microsoft Dynamics 365 connector that is set to sync data every 30 mins. However, you have noticed that the majority of the data is replicated in one large sync and you would like to sync it incrementally as per the sync frequency that has been set.
Connector: Microsoft Dynamics 365
To sync new data on each Fivetran sync, you need to enable Change Tracking in Microsoft Dynamics 365.
In your application, you can enable change tracking when you publish one or more entities to a data store. According to the Dynamics 365 documentation, the following steps are to be performed:
In the Data management workspace, select Configure entity export to database.
Select the database to export data to, and then select Publish.
You can publish one or more entities to your database. Select Show published only to see a list of entities that have previously been published.
Select an entity that is published, and then select Change tracking.
Select the appropriate option for change tracking for your environment.
The following message may be seen in the Fivetran UI for certain tables in the schema tab:
"Not recommended: Entity is not enabled for Change Tracking. Such entities have to be reimported and don't support incremental updates."
This message may occur when Change Tracking is not enabled for certain tables in Microsoft Dynamics 365. Fivetran must re-import these tables once a day, resulting in the data syncing in one sync per day as opposed to in each incremental sync.