Connector Improvement: Sendgrid - Incremental contact loads
Hi there
This was raised as a support ticket #135200.
At the moment due to the way Fivetran is loading the Sendgrid contacts, at the start of each month we are being hit with a large MAR count - for us, we have 300k contacts so this is what hits us at the start of each month. Unfortunately this isn't ideal, and is updating rows that already exist in the database. So in theory, the contact load for a year is costing us 12 x 300,000 = 3,600,000 MAR per year - essentially for the same data.
I was told the Sendgrid API doesn't support created_at or updated_at fields in its contact export - this is not true according to the documentation - https://docs.sendgrid.com/api-reference/contacts/get-batched-contacts-by-ids which as you can see response contains those 2 fields to be able to do an incrementally update on the database.
I request an improvement to this connector to use these fields for incremental update - ie. do a contact export, find new rows and add them to the database, find updated rows and update the database.
This would have significant benefit to customers and their MAR position.
Thank you
Please sign in to leave a comment.
Comments
0 comments