Solved : Reading ASCII/UTF-8 file

Thibaut

Hi all,

I am using Qt to read a file generated by the method store of the Java Properties class. This method generates an ASCII file. However, special characters are written in their Utf-8 equivalent. In the end, the ascii file looks like that :

firstname = g\u00C9rard
lastname = normand

Now, when I read and display the data, I would like to display the symbols itself (gérard normand). I tried using the toUtf8() method but nothing convincing came out. So how do I read this ascii file while handling the Utf-8 symbols ?

Thanks for your help

Thibaut

andre

The format you describe isn't UTF-8, but an escaping sequence. You'll need to parse those. AFAIK, there is no standard Qt codec that deals with these. You could create your own though. See [[doc:QTextCodec]] for more information on that.

Jeroentjehome

Hi, the \u00C9 is a utf32 representation of a capital letter é, so getting the small letter is going to be trouble some. Think as Andre mentioned you need to make your own conversion class to handle this one.

Thibaut

Thanks for the reply. The capital letter é is what I want. I went on http://www.fileformat.info/info/unicode/char/c9/index.htm and it says that \u00C9 is Java/C++ source code for the capital é character. So I was thinking there might be a way around it.

Thibaut

Finally found what I was looking for.
I need to use the following routine

@QRegExp rx("(\\u[0-9a-fA-F]{4})");
int pos = 0;
while ((pos = rx.indexIn(str, pos)) != -1) {
str.replace(pos++, 6, QChar(rx.cap(1).right(4).toUShort(0, 16)));
}@

Thanks a lot for your replies

koahnig

Did you check out "fromUnicode?":http://qt-project.org/doc/qt-4.8/qtextcodec.html#fromUnicode
At least from the name and description it seems to be fitting. However, Andre may have more experience with this.

andre

[quote author="koahnig" date="1342687524"]Did you check out "fromUnicode?":http://qt-project.org/doc/qt-4.8/qtextcodec.html#fromUnicode
At least from the name and description it seems to be fitting. However, Andre may have more experience with this. [/quote]

The problem is that the codec used is not a codec in the normal sense. It is a unicode escape sequence in an otherwise ASCII-encoded file. So to use this method, you first have to actually implement a codec that does that translation back and forth. If you have to work with these files, it is probably a good idea to implement such a codec. Doesn't seem all that hard to me...

Edit: though, I admit, I did not try doing it myself, so it might be harder than it seems by just looking at the docs...

koahnig

[quote author="Andre" date="1342688046"]
[quote author="koahnig" date="1342687524"]Did you check out "fromUnicode?":http://qt-project.org/doc/qt-4.8/qtextcodec.html#fromUnicode
At least from the name and description it seems to be fitting. However, Andre may have more experience with this. [/quote]

The problem is that the codec used is not a codec in the normal sense. It is a unicode escape sequence in an otherwise ASCII-encoded file. So to use this method, you first have to actually implement a codec that does that translation back and forth. If you have to work with these files, it is probably a good idea to implement such a codec. Doesn't seem all that hard to me...
[/quote]

Andre, thanks for clarification