How to use QNetworkAccessManager without leaking memory.

Bonnie

@Q139 Actually, I don't get a increasing memory while testing the last and the previous code of yours.
I wonder if it needs to be tested with a url that have a big size of reply data...
I'm using Qt 5.12 though...

Christian Ehrlicher

@Q139 said in How to use QNetworkAccessManager without leaking memory.:

If someone plans to use it as ddos code it will probably flood your own memory up instead.

No it won't - there is no leak in this code anymore.
The disconnect() is not needed though.

Q139

I still get leak.
alt text

Could you check if application output gives SSL error while connecting to https site?
I also had to install openSSL in addition to get it working, maybe it is related to that.
And while tested on ubuntu got no leak , but it had SSL errors in app output.
Got SSL for win7 and win10 from here, the lite edition, maybe that component causes problems.

Q139

@Bonnie Used invalid url text , like "test" also and got leak.

Q139

Install openSSL on Windows 7 or 10 and see if the app below leaks memory.

Windows ssl libraries site
direct link to download-Win64 OpenSSL v1.1.1g Light

Project file

Q139

Current solution to use QNetworkAcessManager 50 times:
I thought maybe using just once and deleting gives overhead.
This way it goes to ~100mb and back to ~20mb all the time, instead of gb+


int qnamUses=0;
QNetworkAccessManager *qnam=new QNetworkAccessManager;
QNetworkReply *reply;

void Form::startRequest()
{
    qnamUses++;
    if(qnamUses>50){
            qnam->deleteLater();

      qnam=new QNetworkAccessManager;
    }

    reply = qnam->get(QNetworkRequest(QUrl("www.microsoft.com")));
    connect(reply, &QNetworkReply::finished, this, &Form::httpFinished);
}

void Form::httpFinished()
{
  //  qnam.clearAccessCache();
    //qnam->deleteLater();
    reply->deleteLater();
    QTimer::singleShot(0, this, &Form::startRequest);
}

jsulm

@Q139 said in How to use QNetworkAccessManager without leaking memory.:

qnam=new QNetworkAccessManager;

Why do you create QNetworkAccessManager instance for each request? One can handle many requests...

Q139

@jsulm For 50 requests , then schedule for deletion. to prevent memory usage growth.
Maybe i am using something incorrectly.

SGaist

You never reset qnamUses. Therefore after 51 requests, you recreate your qnam object for every request.

Q139

Reset was fixed in test.
Is there a way to use single instance of QNetworkAccessManager for 10k+ times without drastic memory usage growth?

Christian Ehrlicher

@Q139 said in How to use QNetworkAccessManager without leaking memory.:

I still get leak.

The Task manager is no tool to measure a memory leak!

Is there a way to use single instance of QNetworkAccessManager for 10k+ times without drastic memory usage growth?

Yes, simply use it.

Q139

@Christian-Ehrlicher It ends with app filling memory and crashing if simply using.

Christian Ehrlicher

@Q139 I still don't have a valid reproducer for this behavior...

Q139

@Christian-Ehrlicher I tryed and it leaks on win 7 in vmware and win 10 native.
What version of Qt are you running? Did you also intall the openSSL?

This produces problem in my tests. Only solution i find is to delete QNetworkAccessManager after some period and recreate it.
@Q139 said in How to use QNetworkAccessManager without leaking memory.:

Install openSSL on Windows 7 or 10 and see if the app below leaks memory.

Windows ssl libraries site
direct link to download-Win64 OpenSSL v1.1.1g Light

Project file

Christian Ehrlicher

@Q139 said in How to use QNetworkAccessManager without leaking memory.:

Did you also intall the openSSL?

No need for ssl at all since your url ist http.

Christian Ehrlicher

´Please update the wait time between two requests to 100ms and see if the problem still persists. Looks like there is a race condition when the same url is queried very fast. But can't see the main reason for it currently.

Q139

Using 100ms and variable urls solves it.

kevinzhwl

Helpful discussion for me ,thank eveyone
Same situation with Qt 5.14.2 Mingw on Windows7 and Qt5.9.9 on MacOSX

tibalt

@Christian-Ehrlicher said in How to use QNetworkAccessManager without leaking memory.:

´Please update the wait time between two requests to 100ms and see if the problem still persists. Looks like there is a race condition when the same url is queried very fast. But can't see the main reason for it currently.

Hi, we meet this bug on site. is this bug fixed in the newer versions?