Custom Jira Issue fields should be appended into the Issue table
AnsweredConnector name: Jira
Table name: Issue
Column to add: All Custom fields
API documentation link:
Additional details:
Today to get data for issue custom fields we need to ingest the ISSUE_FIELD_HISTORY table. We only want current state of an issue. This is the only place to pull custom field values. This massively inflates our MAR because it contains a key-pair representation of every field in a single Issue record as an SCD2 record.
Alternatively, we should be able to provide a pre-filter where we can specify that we only want current values and list the fields we want with wildcards.
-
Official comment
Hi there,
Thanks for reaching out. While "Custom Jira Issue fields should be appended into the Issue table" isn't directly available today, you can achieve a similar result using existing Fivetran features.
We have a new table called issue_rendered_field table which does contain a current version of text issue fields that you can try. You can also apply row filtering on issue_field_history for just fields you are using for your analysis to reduce the MAR further.
Would this approach work for your immediate needs? Happy to elaborate further.
Thanks,
Frank
Please sign in to leave a comment.
Comments
1 comment