Other: Missing rows in destination table(snowflake)
CompletedWe have a duplicate data in NetSuite table called amortizationschedulerecurrence and we are missing those duplicate rows when we pull into the snowflake.
For Example:
In the source system NetSuite for AMORTIZATIONSCHEDULE id '22193' , we have 13 rows but in snowflake showing 12 rows. one identical row is missing (It's not actually a duplicate according to business).
I think we just need to add fivetran Index column to retrieve identical rows.
To enhance clarity, I've included a sample query and example. In one table, we encountered duplicate row from source system, which was successfully identified and captured by Fivetran through the addition of fivetran index column. However, the duplicate row not captured in another table because there is no Index column.
e.g:
We have duplicate row in “REVRECSCHEDULERECURRENCE” and it was handled by fiveTran by adding a column called FIVETRAN_INDEX.
Sample Query:
select * from raw.netsuite.revrecschedulerecurrence where revrecschedule = 25982 and _fivetran_deleted = false;
But in the “AMORTIZATIONSCHEDULERECURRENCE” table we miss a row. Due to missing FIVETRAN_INDEX.
Sample Query:
So, if FIVETRAN_INDEX column can be added in the “AMORTIZATIONSCHEDULERECURRENCE” table then the issue will be resolved.
Could you please solve this issue ASAP?
-
Official comment
Hi all,
Closing this ticket as we've added a _fivetran_index column to this table. See our release notes here for more details.
Frank
-
What if you add a column that will make that row non-unique like a sequence number?
Please sign in to leave a comment.
Comments
2 comments