Issue
A CSV contains decimal numbers that are comma-separated. These are getting into a destination with a STRING
or VARCHAR
type.
Environment
All file connectors.
Resolution
Set the decimal separator as a comma by either:
- Searching and replacing commas in your CSV. You can do this by using the replace function in text editors such as Sublime Text, or Visual Code, or opening the file in Microsoft Excel.
- Changing the decimal separator regional configuration language or locale, so that a decimal point is used instead.
You now need to create a new connector for the new CSV file with the decimal separation dot. In the old connector, the type will not narrow down from STRING
to FLOAT
once it was created in destination.
Cause
The columns are being synced as strings because the decimal separator needs to be a decimal point, instead of a comma.
NOTES - another solution after the source file change is to replace files in the existing file connector, drop tables in the destination, and trigger a resync