Skip to main content
Docs
Feature Requests Onboarding Trust Center Status Page

Community

Connector Improvement: SAP ERP on HANA Connector - Sync Improvements

Completed
Amit Bajaj User

Hi Team -

Been using SAP ERP on HANA Connector and thought it would be good to have few changes to how the sync works.

1. Be able to sync individual table, today when we run sync on-demand using re-sync option. It triggers sync for all the tables which are already part of the connection.

2. Be able to see sync duration (time difference between sync start and end) by each individual table in the successful sync logs.

3. When we add new table and add a filter condition to it, it auto triggers sync for all the tables part of the connection. Not sure if its a bug, expected behavior or something that needs a fix.

4. Be able to connect to database objects in addition to application layer while using SAP ERP on HANA connector.

5. While the sync is running, it would be good to see somewhere live progress of sync by each table that's part of the connection.

6. If and when pulling data from SAP ADSO/DSO backend active system tables ending with *2, it creates a TRIGGER in the backed SAP system. Which does not let any new data load/activation on the SAP ADSO/DSO. Would be nice to see connector allowing data pull from ADSO tables without locks/triggers causing issue similar to how data is pulled from standard tables.

Thanks !!

Please sign in to leave a comment.

Comments

4 comments

Date Votes
  • Official comment
    Edwin Fivetranner

    Hi Amit,

    Thank you for this extensive feature request.

    If I evaluate your points, I come to:

    1. Selective re-sync: trigger an on-demand sync for individual tables rather than all tables in a connection.
      Fivetran: Agreed, this is behaviour not only in the SAP connector but Fivetran-wide. Pressing the resync link will trigger a full resync for the table, but a CDC run for the other tables.
    2. Sync duration per table: show the time between sync start and end for each table in the successful sync logs.
      Fivetran: Be aware that we run sync in parallel, so individual table timings may be misleading. The Fivetran platform connector should provide more information than is displayed in your dashboard. Your request will be forwarded anyway to the UI team
    3. New table + filter triggers full sync: verify whether this is a bug or expected behavior — we will investigate separately.
      Fivetran: This is expected behaviour as we want to evaluate the whole table against the new filter logic
    4. Database layer access: connect to database objects directly in addition to the SAP application layer.
      Fivetran: Direct (HANA) database connection is a new feature we are getting close to completing. Please let us know if you want to participate in the Private Preview
    5. Live sync progress: show real-time per-table progress while a sync is running.
      Fivetran: This is not (again) a specific feature for the SAP connector, but Fivetran-wide. I will forward this to the UI team, but to set expectations. I've seen a similar request before and it has been hard to fullfil so far.
    6. ADSO/DSO lock-free extraction: pull data from active system tables (*2) without creating triggers that block data activation in SAP.
      Fivetran: We already give the option to load data without trigger (and deletion detection). We are also close to releasing an alternative CDC method without triggers. This has been designed especially for the ADSO use case. Let us know if you are interested, and we can make you part of the Private Preview list for this feature. This will be available for Netweaver and direct DB extractions.

    I hope i have given a bit on insight into the roadmap around our SAP capabilities. I will let you know once there is news about your different requests

    Best regards,

    Edwin

  • Amit Bajaj User

    Thank you Edwin for the information.

    I would like to participate in the private preview if possible.

    -Amit Bajaj

  • Amit Bajaj User

    Hello Team -

    Few other items came up and would be good to have them,

    1. We have a use case where we need to run sync for a table 'A' every 6 hours set up on Connection 'C'. Now that we also need to refresh table 'A' once every week (say Saturday) to refresh for last 7 or 14 days data. How the tool works currently, it does not let us have multiple custom syncs on a same table 'A' part of same connection 'C'. For now, we have to create a new connection for weekly refresh. It would be great to be able to have multiple custom sync on the same table 'A' part of the same connection 'C' instead of us having to build multiple connections.

    2. We would also like to see feasibility to be able to define custom sync time on each table part of the connection. Right now, all tabled part of the same connection sync at the same time. Having control over defining custom sync time reduces creation of multiple connections.

    3. Right now, we see each table is restricted to only 3 conditions/filters. Would like to know why there's a restriction to only 3 conditions and if there's an option to have as many filter conditions.

    4. Also, have not seen anywhere where we could create a simple dynamic filter (for say, current date - 7). Would be great to see some options where the tool offers dynamic filter.

    Thanks,

    Amit Bajaj

  • Edwin Fivetranner

    Hi Amit,

    Just to inform you that direct database connection and ADSO trigger-free CDC have been added to the SAP ERP on HANA connector. This should address the original feature request.

    I noticed you have additional requests. These appear to be less specific to Fivetran SAP functionality and more related to the Fivetran platform as a whole. If possible, I would recommend creating separate feature requests for these items, as that will make it easier to track and report on progress.

    For now, I will close this feature request as completed.

    Best regards,

    Edwin