Skip to main content
Docs
Feature Requests Onboarding Trust Center Status Page

Community

Connector Improvement: Improve Oracle connector Logminer performance for high volume change logs

Geoff Pahl User

For oracle servers with high volumes of change logs and constrained memory there is a performance problem because the Oracle Fivetran connector will add all logs to the Logminer session before pulling the changes. For example if there are 300Gb of change logs and only 5Gb of memory overhead on the server then it seems to attempt to load the logs into memory and maybe spills to disk.

Can the oracle connector determine if performance is a problem or have a config setting to load change logs one at a time rather than all together?

Please sign in to leave a comment.

Comments

1 comment

Date Votes
  • Official comment
    Kevin Kim Fivetranner

    Hi Geoff,

    Thanks for your post in our feature requests portal! Would you be interested in exploring the new high-volume agent connectors for Oracle for this use case? If you have a high volume of changes it may be a better fit for this database than the LogMiner connector.

    Please confirm this with your Fivetran account team if you are interested in exploring that.