Some data or metadata is not coming in that contains our fulfilment date (track the time from the initial order to when it was fulfilled i.e. sent from the warehouse), among other fields. Our previous setup was event based - we would receive a base_64 object on an event based level. For example, we would receive event 'type': 'OrderCreated' or 'OrderImported' to access our orders. e.g if we wanted to look at these orders we could use only the events of this type, filtering as shown `WHERE JSON_VALUE(base64_string, '$.type') IN ('OrderCreated', 'OrderImported')`. To get the fulfilment date of an order we would look at type: ‘ParcelAddedToDelivery’ as opposed to type: ‘Order’. So, we would have an event type "order" which contains the original order, but we would also have events which gave us information post the order being created like type: ‘ParcelAddedToDelivery’ which gives us our fulfilment date. I understand that the new connector works differently to this, but we need to our fulfilment date. I suspect that it could be in the ORDER_SHIPPING table. When I try to access this - it does not exist, but is in our Fivetran schema. The only fields that i can see in that schema are are orders_id and shipping_key. However when I refer to the ERD here I can see the fields below:

shipping_key 🔑 

order_id 🔑  ▶ ORDER

shipping_rate_input_key

shipping_rate_input_label

shipping_rate_input_score

shipping_rate_input_type

custom_*

shipping_info_*

I believe that we would be able to get our fulfilment date from shipping_info_* or possibly custom_*. 

Another related issue that I have noticed is that our current connector sometimes removes cancelled orders (taken from orders.custom_fields, '$.adyenCancelledDate') before they get to us. We like to monitor how many cancelled orders we are getting. We need this data to get the full picture.
Please get back to me asap