Question
Why is no data being ingested even though the file connector is processing files correctly?
Environment
File connectors
Answer
- Go to Dashboard > Connector > Setup > Edit connector details
- Make sure that the File Type field matches the type of the file you are trying to ingest or set its value to
infer
. - Make sure that the Compression field matches the type of the file you are trying to ingest or set its value to
infer
. - Click Save & Test.
Cause
Your connector is working fine and it can Save & Test correctly because there are files to be detected following your regex pattern.
It cannot ingest any data because the format of the file is different from the one that you are indicating, therefore when the file is identified, uncompression returns no formatted data to ingest.