You are sending multiple emails within the same sync period to the Email Connector and you want to understand how those attached files are processed by Fivetran.
When an email is received by the email connector, the attached files are copied to an internal S3 bucket as a file to be processed by Fivetran at the next sync period. If you send multiple emails with the same file name before the next sync period, Fivetran will only ingest the latest unique file name based on the delivery timestamp.
Consider the following scenario with a single email connector that is receiving both files A and B. Sync frequency is hourly and the last sync occurred at 10:00 am.
- File A sent at 10:30 am, delivered at 10:35 am
- File A (modified) sent at 10:31 am, delivered at 10:33 am
- File B sent at 10:32 am, delivered at 10:36 am
At 11:00 am, Fivetran will ingest the latest files that have been delivered to the connector. In this case, only the original File A and File B will be synced into the same schema/table. File A (modified) will be ignored since it was delivered at the earlier time.
If you want to ensure that Fivetran properly processes all your attached files, we recommend you adjust your sync frequency to match the rate of sent emails. For example, if your source sends emails once every hour, you should set the sync frequency to once every hour (or faster).
In cases where the emails are sent in rapid succession (multiple times in a span of minutes), we recommend you ensure that each email is confirmed to be delivered prior to sending the next one. Otherwise the emails might reach Fivetran in a different order than expected.
If you are sending attachments that contain delta values, it is especially important to make sure that only one delta file is delivered during a sync period. Multiple delta files will not be processed if they are delivered during the same sync period.