transformation of data in wordlist files Pingrid v3.7

Hi everybody

Answering to myself.
After some test I discovered that anomaly occurs when certain words are present in the file.
By try and error I was able to identify : 爸爸 and 弟弟 (ba4ba and di4di)
Removing these words in the file occurs in no error.
I've tried to put it in the custom dictionary.txt file, but it doesn't works ! I really need to suppress these words.

Must be an index problem somewhere...

I'm afraid there are any others ....

A first look at your files gives a hint.
This is an encoding issue. The file is encoded in UTF-8 code, but Pingrid treats it as if it were GB-encoded.
The reason is that the file in itself does not bear any encoding identification, so Pingrid tries to guess it, and sometimes fails.

Here is what you can do to get the file interpreted correctly:
Solution 1) at the beginning of your file, add a first line containing "utf-8".
Solution 2) in your text editor, save your text files with the "UTF-8 with BOM" format. The BOM is a prefix in the file which flags that the encoding is UTF-8.
Solution 3) from Pingrid, in the "Open file" dialog, open the menu list at the bottom-right and select "UTF-8 file".

I'll look deeper into the issue and see if I can come up with something automatic.