Destination Improvement: ADLS Refresh
We would like to request an enhancement to the ADLS Gen2 Target file that on a refresh the 1st record in the refresh file has hvr_op = 5 (Truncate table) and the hvr_sequence is set to *|000000000000. We are using Delta Live Table (DLT) in Databricks and it would be help to have this information on an ADLS Gen2 refresh file so DLT can detect that it's a refresh and delete the data in Databricks. Please advise if this is feasible.
Please sign in to leave a comment.
Comments
0 comments