Allow to specify encoding when importing a file

[rafalaidlaw]

Description

When importing file, add a new drop-down menu at the bottom that will allow to select an encoding. This will let user upload files in utf16be, utf16le or ISO-8859-1 (Latin-1). Thank you!

Issue

#464

Functionality recording

Default utf8 encoding on utf8 file

Screen.Recording.2025-10-30.at.5.14.59.PM.mov

Select utf16le encoding on utf16le file

Screen.Recording.2025-10-30.at.5.15.29.PM.mov

Select utf8 encoding on utf16le file and get the expected error

Screen.Recording.2025-10-30.at.5.16.03.PM.mov

[AykutSarac]

Is there a way to auto-detect the encoding instead of letting users to pick the encoding format? That'd improve the experience a lot.

[rafalaidlaw]

Hi @AykutSarac, yes. Do you have a preference on how to do this? I tried a few options:

1. Use a package, I tried https://www.npmjs.com/package/detect-file-encoding-and-language/v/1.5.5 and https://github.com/aadsm/jschardet. Neither recognized my uft16 file, but maybe it is just my file. If you are OK with any of these packages or know another one, I will happily use it.

2. Good old brute force - try a few encodings until one does not give error.