QNetworkAccessManager doesn't post request in case of large file

Christian Ehrlicher

@Robert-Winke Your code can't work the way you posted it because release() destroys your QFile object.

Robert Winke

@Christian-Ehrlicher According to this:
http://www.cplusplus.com/reference/memory/unique_ptr/release/
it just releases the responsibility to delete the object but doesn't destroy it.
But anyway I just tried it again using a raw pointer (by calling new) and also tried it as a stack allocated member variable (passing the address of it to post() and setParent() calls. And it has the same result.

Christian Ehrlicher

I misread it as reset(), sorry.
No need for a member at all.

QFle *f = new QFile(...);
if (!f->open(QIODevice::ReadOnly))
  return false;
_pReply = _netMan.post(postFileRequest, f);
f->setParent(_pReply);

Robert Winke

@Christian-Ehrlicher said in QNetworkAccessManager doesn't post request in case of large file:

QFle *f

I tried this as well but it doesn't make a difference. Still it works with a small file but not with the 6 Mb one

JonB

@Robert-Winke
Totally throw away observation, no idea if it has any validity: is the scope of your QNetworkRequest relevant, does it have to stay in scope while the upload is in progress?

KroMignon

@Robert-Winke Are you sure the QFile instance is create in same thread as _pReply?
You could change the code as follow:

    auto currentFile = _file.release();
    _pReply = _netMan.post(postFileRequest, currentFile);

    ...

    // capture QFile pointer in lambda and delete it there
    QObject::connect(_pReply, &QNetworkReply::finished,
        [this, currentFile ](){ // also catch FP here
            auto error = this->_pReply->error();
            currentFile->delateLater();
            ...
        });

Robert Winke

@KroMignon said in QNetworkAccessManager doesn't post request in case of large file:

e threa

yes, they are in the same thread also it already opens the file just before the post request so it exists.
I made your recommended change, it does seem more elegant but my problem persists:(

Bonnie

Have you tried to upload using other tools?
Maybe your server has size limitation for uploads.

KroMignon

@Robert-Winke I read again you first post, you write error 2 which is QNetworkReply::RemoteHostClosedError.

This means that the server closed the socket. So perhaps the problem is not on this software but on the server side.
Are there logs you can check or do you have tried to look tcp traffic with a network sniffer like WireShark?

Robert Winke

@KroMignon That is a good guess but I forgot to mention that I have a python script which makes this post request with the large file without a problem and the server receives the file so it can't be a server side problem..
I am using wireshark to monitor the traffic and in case of large file I don't see the post request (no packets leave my computer) but with the small file I see it and it works

KroMignon

@Robert-Winke It look like you hurting same issue as this one ==> https://www.kdab.com/there-and-back-again/

Robert Winke

@Bonnie Yes I have a working python script so it's not a server side problem but it's a good guess. I edited the original post

Robert Winke

@JonB I think it should be fine as a local variable but just in case I made it a member var but it didn't help:(

SGaist

Hi,

Would it be possible to provide a minimal example application and server that shows that issue ?

Robert Winke

@KroMignon I tried with the patch for that issue but it didn't help. That description is mostly just about latency issue. :(

JonB

@Robert-Winke
If you hope for an answer here, I suggest you have a go at @SGaist's request, we need some minimal sample app to reproduce.

Robert Winke

@SGaist yes, I created a sandbox project for this with a working web server in python. There is a readme with instructions how to build and test it. I tried to attach the file here but I dont have enough privileges so here is a google drive link:

https://drive.google.com/drive/folders/1lxPun_p_crKlui5KU8Q1qKBp0ue7vvok?usp=sharing

Robert Winke

@SGaist ps the error with this web server is not the same. This time I can see the post request from wireshark but the client receives Error code: 99 Unknown error. The progress still doesn't go up to 50 (100%) but it does with the small.txt

SGaist

Your sample Python server does not handle post requests properly and kills the connection early.

Once that fixed, big files are properly uploaded.

Now the question is:
auto prog = sent*100/(2*static_cast<double>(total));

What does that 2 do in there ? Mathematically, you can't reach 100% with that equation unless you send twice the number of bytes.

Robert Winke

@SGaist That 2 doesn't matter, I'm not expecting it to go to 100 just 50 I just forgot to remove it for this sandbox project.
I'll look into the python server but that's not actually the server I used for testing. The one I used is proven to be working with another client but I cannot attach that.