Connector Improvement: Salesforce Connector enhancement
Currently, we are seeing historical data re-sync through the Salesforce connector, whenever a rollup summary column is added to a salesforce object. This will update the 'SystemModStamp' throughout the table to the latest and Fivetran does a resync of the whole table.
Per Fivetran article :
In Salesforce, we use one of the following timestamp fields to track when data was last updated in the source:
SystemModStamp
LastModifiedDate
CreatedDate
LoginTime
There is a business impact since the data resync will run more than 2 days with no latest refreshed data in SNOWFLAKE.
https://fivetran.com/docs/applications/salesforce
Since we do not have control over the above columns, is there a way to add/implement a feature to select a particular timestamp field in the Salesforce Connector? so that we can set the required columns ( Ex: LastModifieddate in our use case), based on the requirement?
I appreciate it if you can prioritize this task and provide an update as early as possible.
-
Official comment
Hi Adarsh,
I believe the resync will be the only way to fetch the values for the new column. Let me convert this to a support ticket so our team can investigate and confirm the situation and how our connector is working. We will look at making improvements based on the outcome of that! -
Thanks for the update, Ray.
Sure, Please keep me posted. I'd really appreciate if you can prioritize this and implement this feature.
-
Any update on this ?
Please sign in to leave a comment.
Comments
3 comments