Email Connector CSV format vs CSV UTF-8

Luke_Nguyen
Luke_Nguyen Member
in Connectors

Hello,

I download an Excel file from a supplier portal and email it to a DOMO email connector. By default the format is CSV however I find I have to save the file as CSV UTF-8 otherwise DOMO does not ingest all the rows (roughly 17% of the total rows is ingested if I do not change the file format).

I have attempted to change the configuration settings but still no luck. I have attached a screenshot of my current settinga

Snag_22b594f.png Snag_22b8b5c.png

for reference as well as the file format I'm referring to.

Answers

  • ArborRose
    ArborRose Coach

    The problem appears to be with the character set interpretation. The CSV UTF-8 is a universal standard for encoding text. Especially special characters such as non-English. If Excel saves using default csv, it is limited in the characters it supports and may truncate or skip sections. But 17% data loss sounds extreme.

    I don't know about changing the settings in the connector. If you can't automate saving UTF-8 you could try Python.

    import pandas as pd
    
df = pd.read_excel("input.xlsx")
    
df.to_csv("output.csv", index=False, encoding='utf-8-sig')

    ** Was this post helpful? Click Agree or Like below. **
    ** Did this solve your problem? Accept it as a solution! **

Categories