Destination Improvement: Array Support for BigQuery, Snowflake, etc.
Many connectors, like the AirTable connector, bring in data in the form of arrays (in the AirTable example, that includes values from multi-select fields and link fields which manage key raltionships between tables). Currently those array fields import as strings and have to be parsed in complex queries to be utilized. If they could be imported as native ARRAY types, it would simplify use and make use of native warehouse features that use arrays for things like managing many-to-many relationships between tables without needing intermediate relationship tables. As of now, manually parsing those strings to construct arrays on the fly makes queries unnecessarily complex.
Please sign in to leave a comment.
Comments
0 comments