Destination Improvement: Avro unpacking to BQ structs
Any composite object in an avro schema is written as a json STRING field in to the Big query table (only the root level fields get unpacked). Since the avro schema provided by the schema registry would have all the relevant nested field types, it would beneficial to create BQ structs to make the subsequent queries more efficient. https://cloud.google.com/bigquery/docs/reference/standard-sql/data-types#struct_type
Please sign in to leave a comment.
Comments
0 comments