Can QChar functions work with QStrings ?

VRonin

@aha_1980 said in Can QChar functions work with QStrings ?:

QString has dedicated remove functions with regular expressions that migth do the work faster and in one line.

True for all latin-alphabet languages, not 100% sure it is safe for the entirety of unicode.

Christian Ehrlicher

Sadly QString has no QString::erase()... :(

#include <QtCore>
int main(int argc, char **argv)
{
    QCoreApplication app(argc, argv);
    if (argc != 2)
        return 0;
    QString str = app.arguments().at(1);
    const auto checkFunc = [](const QChar c) -> bool
    {
        return c.isLetterOrNumber();
    };
    //str.erase(std::remove_if(str.begin(), str.end(), checkFunc), str.end());
    str.chop(str.end() - std::remove_if(str.begin(), str.end(), checkFunc));
    qDebug() << app.arguments().at(1) << str;
    return 0;
}

aha_1980

@VRonin said in Can QChar functions work with QStrings ?:

True for all latin-alphabet languages

Therefore my question, what the OP really wants to do.

not 100% sure it is safe for the entirety of unicode.

https://stackoverflow.com/questions/38001256/handling-accented-letters-in-qregularexpressions-in-qt5

jefazo92

What I'm trying to do is to check the QString for characters which aren't letters and then delete them. For example, "H?e__llo" would become "Hello".

jefazo92

You are right about isLetterorNumber being redundant I thought it made sense when only isLetter () is what I need. My new code would be:

for (int i = 0, size = aword.size(); i < size; i++)
         {

              if (aword[i].isLetter() != 1)
               {
                  aword.remove(i--, 1);
                  size = aword.size(); 
               }

         }

jefazo92

But I'm still not sure if it'll work. I've read the docs but it says that isLetter() works only for UCS-4 encoded characters but the character of a QString corresponds to one UTF-16 code unit. In that case, I'm not sure if my code would eventually give rise to random behaviour.

Christian Ehrlicher

@jefazo92 said in Can QChar functions work with QStrings ?:

works only for UCS-4 encoded characters

You read the wrong documentation - you're using QChar::isLetter(), not the static QChar::isLetter(uint).

aha_1980

@jefazo92

I've read the docs but it says that isLetter() works only for UCS-4 encoded characters

And that is only correct for this overload, which you are not using. You are using this.

But: You still didn't tell us what you really want to do. I read your last code, as if you want to remove all non-letter chars from the string.

Example: "%$Hello/World![" > "HelloWorld" Is that correct?

jefazo92

So what should I do in that case ? I'm a bit lost here.

jefazo92

Yes exactly. That's what I want.

aha_1980

@jefazo92 Then here's a one-liner:

#include <QDebug>
#include <QRegularExpression>

int main(int argc, char *argv[])
{
    QString s = "%$Hello/World![";

    s.remove(QRegularExpression("[^\\p{L}]"));

    qDebug() << "s =" << s;
}

Output: s = "HelloWorld"

jefazo92

@aha_1980 said in Can QChar functions work with QStrings ?:

QRegularExpression

Would that then remove any punctuation marks, numbers and blank spaces ? Or would I have to add something else ?

jefazo92

Also does that mean that my line above would then not work as it should ?

aha_1980

@jefazo92

Your code should work as well, I'd just clean it up a bit:

for (int i = 0; i < aword.size(); i++) {
    if (!aword[i].isLetter())
      aword.remove(i--, 1);
}

However, why re-invent the wheel if there is a ready-made function?

jefazo92

@aha_1980 said in Can QChar functions work with QStrings ?:

QRegularExpression

Hi @aha_1980,

Thank you a lot for your reply. If it's not too much asking how did you find QRegularExpression ? Like I'm ctrl+F at the QStrings doc but I get 53 coincidences I don't know which of them all is the one that suits me for this example. I'm trying to understand what the [^\p{L}] in the QRegularExpression("[^\p{L}]") means. Also how did you know that the QChar functions I used for QString would work ? Since I'm still a rooky, all these details are important to help me fend off by myself in the future. Thanks.

Christian Ehrlicher

You can find the documentation here: QRegularExpression

JonB

@Christian-Ehrlicher
To be fair to @jefazo92, that docs page does not begin to attempt to explain [^\p{L}], or even the \p{L}. In fact it only refers the reader to other sources, such as http://pcre.org/pcre.txt, for all syntax.

I like reg exes, and have used them for years (decades), but it's only right to say to the OP that they are a bit tricky and he'll have to go outside Qt docs to find out about them. A resource I would recommend is an on-line constructor/tester like https://regex101.com/ or https://regexr.com/, though they are not very tutorially.

aha_1980

@jefazo92 said in Can QChar functions work with QStrings ?:

Thank you a lot for your reply. If it's not too much asking how did you find QRegularExpression ? Like I'm ctrl+F at the QStrings doc but I get 53 coincidences I don't know which of them all is the one that suits me for this example.

I'd recomment another way: You know that you want to remove something from your string, so you search for remove first. That gives you some overloads:

QString &	remove(int position, int n)
QString &	remove(QChar ch, Qt::CaseSensitivity cs = Qt::CaseSensitive)
QString &	remove(QLatin1String str, Qt::CaseSensitivity cs = Qt::CaseSensitive)
QString &	remove(const QString &str, Qt::CaseSensitivity cs = Qt::CaseSensitive)
QString &	remove(const QRegExp &rx)
QString &	remove(const QRegularExpression &re)

The first one simply removes n chars starting at position. The second one removes a specific char from the string. The third and fourth remove a substring. And the last two operate on regular expressions (with QRegExp beeing deprecated).

If you now know that regular expressions are used to describe text patterns, you already have the correct remove overload. Then I googled for qregularexpression non-letter which brought me to https://stackoverflow.com/questions/38001256/handling-accented-letters-in-qregularexpressions-in-qt5

The rest is experience.

I'm trying to understand what the [^\p{L}] in the QRegularExpression("[^\p{L}]") means.

This pattern describes everything that is not ([^]) an unicode letter (\\p{L}). You already got links to regex pages from my mates.

Regards

JonB

@aha_1980
It's coming across the \p{L} construct for Unicode letter that's hard/intimidating. One does not come across it in many examples, and it's a later addition to reg exes.

fcarney

It bothers me that this ([^\p{L}]) regular expression would work in one engine and fail in another, at least according to the website that was linked:
https://regex101.com/
I tried it in the PHP one and it worked, but the Python and Ecmascript ones failed.

Somehow I had it in my head that regexs were standardized for the most part. That apparently is a bad assumption.