Connector Improvement: Lever Feature Request – Enable Incremental Sync for /postings Endpoint
AnsweredHi Fivetran Team,
I’m writing to request an enhancement to the /postings endpoint. Currently, this endpoint syncs only once a day as a full reimport, whereas other tables within the connector are updated every 30 minutes. This results in a delay in data freshness for postings relative to other endpoints.
Proposal:
-
Incremental Sync:
Implement an incremental sync mode for the /postings endpoint that only updates records which have been added, modified, or deleted since the last sync. This would greatly reduce processing overhead and improve update times. -
Increased Sync Frequency:
Align the sync schedule of /postings with the 30-minute interval used for other endpoints, or provide a configurable option to adjust the frequency. This ensures that posting data remains as current and consistent as other connectors.
Benefits:
-
Timely Data:
More frequent updates ensure that posting data is current, benefiting all users who rely on near-real-time data. -
Performance Efficiency:
Incremental sync minimizes the volume of data processed during each cycle, reducing load on the system and improving overall performance. -
Improved Consistency:
Syncing all endpoints on a similar schedule will help maintain consistency across your data integrations.
I believe these enhancements will significantly improve the functionality and performance of the connector. Please let me know if any further details or discussion are needed regarding this request.
Thank you for considering this feature.
-
Official comment
Hi Pawan,
Thank you for raising this feature request. This looks to be a valuable addition to the connector performance and data freshness. We will be prioritizing this in Q3 and update you when it is made available.
Thank You,
Vishal
-
Hello Vishal,
Did you have any updates on this?
Thanks!
Please sign in to leave a comment.
Comments
2 comments