We are currently facing an issue with the Service Bus connector where the source payload contains 800+ columns, but even after performing a full sync, several expected columns are not being reflected in BigQuery.

Below are the details requested:

1. Message Type: JSON
2. Sync Type: Unpacked
3. Missing Columns: Please refer to the attached BigQuery DDL for the `account` table. The Fivetran schema can be used as the reference for the expected Service Bus schema.
4. Field Structure: The missing fields are top-level JSON keys and are not nested within any object or array.
5. Recently Added Fields: A few fields were added recently, but most of the missing fields have existed in the source for a longer period.

Based on our investigation, we understand that the missing columns currently have `NULL`/empty values in the incoming Service Bus messages. Since the connector does not sync/create columns when the fields contain only empty values, these columns are currently not being created in BigQuery.

However, these columns are part of the expected source schema, and we would need them to be available in BigQuery even when their current values are `NULL`.

Could you please confirm if there is any configuration or workaround available to have the connector create/sync these columns even when the incoming values are empty or `NULL`?

If this functionality is not currently supported, could you please confirm whether this would need to be treated as a connector feature enhancement?

Regards,
Rhea Verma