Your browser does not seem to support JavaScript. As a result, your viewing experience will be diminished, and you have been placed in read-only mode.

Please download a browser that supports JavaScript, or enable it if it's disabled (i.e. NoScript).

Qt Installer Framework 7zip exception not enough memory

Unsolved Qt Creator and other tools

21 Posts 13 Posters 9.2k Views 3 Watching

L Offline
L Offline
lbaudouin

wrote on last edited by koahnig

#1

Hi,

When I want to generate repository using repogen on Windows10 with Qt Installer Framework 3.0.
I have an issue with 7zip:

repogen.exe -p packages repository
Caught 7zip exception: Cannot create archive "<full_path>\1.0.3lib.7z": not enough memory

I have at least 24GB of free memory, and enough disk space. Manual 7zip works perfectly.

Note: The lib folder contains some .lib and one of them is big: 387MB (total 410MB).

Is there any limitation of QtInstallerFramework? How can I use big files with this tool?
K J 2 Replies Last reply

0
L lbaudouin

Hi,

When I want to generate repository using repogen on Windows10 with Qt Installer Framework 3.0.
I have an issue with 7zip:

repogen.exe -p packages repository
Caught 7zip exception: Cannot create archive "<full_path>\1.0.3lib.7z": not enough memory

I have at least 24GB of free memory, and enough disk space. Manual 7zip works perfectly.

Note: The lib folder contains some .lib and one of them is big: 387MB (total 410MB).

Is there any limitation of QtInstallerFramework? How can I use big files with this tool?
K Offline
K Offline
koahnig

wrote on last edited by koahnig

#2

@lbaudouin

Hi and welcome to devnet forum

I doubt that there is a limitation, but I do not have enough insight there.

Try to remove the big library in order to check, if it is the real problem.
Vote the answer(s) that helped you to solve your issue(s)
1 Reply Last reply

0
L lbaudouin

Hi,

When I want to generate repository using repogen on Windows10 with Qt Installer Framework 3.0.
I have an issue with 7zip:

repogen.exe -p packages repository
Caught 7zip exception: Cannot create archive "<full_path>\1.0.3lib.7z": not enough memory

I have at least 24GB of free memory, and enough disk space. Manual 7zip works perfectly.

Note: The lib folder contains some .lib and one of them is big: 387MB (total 410MB).

Is there any limitation of QtInstallerFramework? How can I use big files with this tool?
J Offline
J Offline
JonB

wrote on last edited by

#3

@lbaudouin
There's nothing "big" about 400MB as far as 7Zip is concerned! Sounds like something else is wrong.
1 Reply Last reply

1
L Offline
L Offline
lbaudouin

wrote on last edited by

#4

If I replace the 400MB by a smaller one (100MB), it works.
K 1 Reply Last reply

0
L lbaudouin

If I replace the 400MB by a smaller one (100MB), it works.
K Offline
K Offline
koahnig

wrote on last edited by

#5

@lbaudouin

As @JonB I consider this as odd. I am using 7z on a regular basis with really large files.

The only explanation possible is that there is part of 7z integrated in the installer and that part is creating the problem.

This is merely a user driven forum. Typically with Installer FrameWork questions not a lot of feedback is anticipated. Possibly on the developer mailing list there are some of IFW developers around.
They would know also if there are really such limitations.
Vote the answer(s) that helped you to solve your issue(s)
1 Reply Last reply

2
A Offline
A Offline
AdamC1228

wrote on last edited by

#6
I too am running into this issue. However I am trying to build the offline installer. When use the release build for my program the libraries are small enough that they do not trigger this issue. Using the Debug build causes the binarycreator to throw a fit. In my case it really does not like Qt5Cored.dll. When that dll is present it triggers the following:
```
[2757] Warning: QFile::remove: Empty or null file name
Caught exception: Cannot create archive "C:\Users\XXXX\AppData\Local\Temp\binarycreator-l9Mfi9\com.XXXX.xxxxx\2.0.0content.7z": not enough memory
```
I'm not sure if this helps matters at all but if you find out anything from the developer mailing list please drop a comment here.

BTW, I am using the 3.0.4 release for windows.
1 Reply Last reply

0
M Offline
M Offline
mselizabeth005
Banned
wrote on last edited by mselizabeth005

#7

This post is deleted!
M 1 Reply Last reply

0
M mselizabeth005

This post is deleted!
M Offline
M Offline
miller9163286

wrote on last edited by miller9163286

#8

This post is deleted!
1 Reply Last reply

0
K Offline
K Offline
kuro

wrote on last edited by kuro

#9

Hi,
I'm facing just same problem.
After some investigation, I found thant this is caused by multithread build of 7zip codes.
Though I have not solved this bug(must be a bug) yet, I found we can use Single Threaded IFW by specifing _7ZIP_ST preprocessor macro on building IFW.
(If you can make effort to build IFW by yourself)
anyway, I'll make bug report to IFW team.
A D 2 Replies Last reply

2
K kuro

Hi,
I'm facing just same problem.
After some investigation, I found thant this is caused by multithread build of 7zip codes.
Though I have not solved this bug(must be a bug) yet, I found we can use Single Threaded IFW by specifing _7ZIP_ST preprocessor macro on building IFW.
(If you can make effort to build IFW by yourself)
anyway, I'll make bug report to IFW team.
A Offline
A Offline
aha_1980
Lifetime Qt Champion
wrote on last edited by

#10

@kuro

Thanks for reporting this. Please add a link to the report her once you've done it, so others can follow.

Regards
Qt has to stay free or it will die.
1 Reply Last reply

1
K Offline
K Offline
kuro

wrote on last edited by kuro

#11

O key, I see, I'll put link to the issue after submit it.
because I'm now doing some more investigation(for writing more precise report), it will takes more time.
Thank you for your guide.
1 Reply Last reply

2
K Offline
K Offline
kuro

wrote on last edited by

#12

I searched bug tracker site for this issue, then found this:
https://bugreports.qt.io/browse/QTIFW-1157
This issue is already closed because this is duplication of this:
https://bugreports.qt.io/browse/QTIFW-957

Regards.
K A 2 Replies Last reply

2
K kuro

I searched bug tracker site for this issue, then found this:
https://bugreports.qt.io/browse/QTIFW-1157
This issue is already closed because this is duplication of this:
https://bugreports.qt.io/browse/QTIFW-957

Regards.
K Offline
K Offline
koahnig

wrote on last edited by

#13

@kuro said in Qt Installer Framework 7zip exception not enough memory:

I searched bug tracker site for this issue, then found this:
https://bugreports.qt.io/browse/QTIFW-1157
This issue is already closed because this is duplication of this:
https://bugreports.qt.io/browse/QTIFW-957

Regards.

Thanks for following up and reporting links
Vote the answer(s) that helped you to solve your issue(s)
1 Reply Last reply

0
K kuro

I searched bug tracker site for this issue, then found this:
https://bugreports.qt.io/browse/QTIFW-1157
This issue is already closed because this is duplication of this:
https://bugreports.qt.io/browse/QTIFW-957

Regards.
A Offline
A Offline
aha_1980
Lifetime Qt Champion
wrote on last edited by

#14

@kuro Thanks for your findings. You can vote and comment at the bug QTIFW-957 to give it more priority :)
Qt has to stay free or it will die.
1 Reply Last reply

0
K kuro

Hi,
I'm facing just same problem.
After some investigation, I found thant this is caused by multithread build of 7zip codes.
Though I have not solved this bug(must be a bug) yet, I found we can use Single Threaded IFW by specifing _7ZIP_ST preprocessor macro on building IFW.
(If you can make effort to build IFW by yourself)
anyway, I'll make bug report to IFW team.
D Offline
D Offline
dcouch

wrote on last edited by

#15

@kuro Where are you defining this preprocessor macro?
1 Reply Last reply

0
K Offline
K Offline
KMKT

wrote on last edited by

#16

Hi! This topic is pretty old; but the problem remains...
I am currently using IFW 4.2 with a Core i9 processor with10 cores => 20 logical processors.
I have 32GB RAM but I guess that the 32-bit official version 4.2 can only handle 2GB...
I bet the high number of threads combined with limited 32-bit memory is a bad combination.
Building the IFW in 64-bit (or, as kuro suggests: limiting the number of threads) would help.
However, many Qt users (like me) just want to use the official build installed by the MaintenanceTool.
Can we expect the forthcoming official release version 4.3 to fix this? I see a recent git commit about using libarchive for 7zip. The comment seems to tell that using libarchive will not be official but will require a special build option...
C 1 Reply Last reply

0
K KMKT

Hi! This topic is pretty old; but the problem remains...
I am currently using IFW 4.2 with a Core i9 processor with10 cores => 20 logical processors.
I have 32GB RAM but I guess that the 32-bit official version 4.2 can only handle 2GB...
I bet the high number of threads combined with limited 32-bit memory is a bad combination.
Building the IFW in 64-bit (or, as kuro suggests: limiting the number of threads) would help.
However, many Qt users (like me) just want to use the official build installed by the MaintenanceTool.
Can we expect the forthcoming official release version 4.3 to fix this? I see a recent git commit about using libarchive for 7zip. The comment seems to tell that using libarchive will not be official but will require a special build option...
C Online
C Online
Christian Ehrlicher
Lifetime Qt Champion
wrote on last edited by

#17

@KMKT said in Qt Installer Framework 7zip exception not enough memory:

Can we expect the forthcoming official release version 4.3 to fix this?

Wrong place to ask such things, this is a user-driven forum -> bugreports.qt.io
Qt Online Installer direct download: https://download.qt.io/official_releases/online_installers/
Visit the Qt Academy at https://academy.qt.io/catalog
K 1 Reply Last reply

0
C Christian Ehrlicher

@KMKT said in Qt Installer Framework 7zip exception not enough memory:

Can we expect the forthcoming official release version 4.3 to fix this?

Wrong place to ask such things, this is a user-driven forum -> bugreports.qt.io
K Offline
K Offline
KMKT

wrote on last edited by

#18

@Christian-Ehrlicher Oh! I'm sorry.
My first search on bugreports.qt.io only found closed topics that did not fix the problem, and I was too shy to open a new one while so many others were closed. Then I found this open topic on this forum.
Anyway, after a second search on bugreports.qt.io, I found this: https://bugreports.qt.io/browse/QTIFW-2375
This will probably fix the problem. I guess, we'll have to wait for v4.3.0...
In the meantime, I can use my old 4-core computer to build installers; or use zip compression instead of 7zip, which results in a 10% larger file size (+50MB in my case).
S A 2 Replies Last reply

2
K KMKT

@Christian-Ehrlicher Oh! I'm sorry.
My first search on bugreports.qt.io only found closed topics that did not fix the problem, and I was too shy to open a new one while so many others were closed. Then I found this open topic on this forum.
Anyway, after a second search on bugreports.qt.io, I found this: https://bugreports.qt.io/browse/QTIFW-2375
This will probably fix the problem. I guess, we'll have to wait for v4.3.0...
In the meantime, I can use my old 4-core computer to build installers; or use zip compression instead of 7zip, which results in a 10% larger file size (+50MB in my case).
S Offline
S Offline
Stephen Quan

wrote on last edited by

#19

@KMKT writes:

In the meantime, I can use my old 4-core computer to build installers; or use zip compression instead of 7zip, which results in a 10% larger file size (+50MB in my case).

I have been having this issue for 3 years now, but, your sentence gave me a new perspective on this issue. For me, the computer that always fails has 12 cores, whereas the computer that always works has 4 cores.

I decided to do an experiment on my failing 12 core machine: I run MSCONFIG, go to Boot options go into Advanced Options I tried changing my cores to either 4 or 8. And, oh my gosh, to my surprise, in both tests, the problem went away?!?! So, there must be some fault in the 7zip library not handling a large number of cores?!
K 1 Reply Last reply

4
S Stephen Quan

@KMKT writes:

In the meantime, I can use my old 4-core computer to build installers; or use zip compression instead of 7zip, which results in a 10% larger file size (+50MB in my case).

I have been having this issue for 3 years now, but, your sentence gave me a new perspective on this issue. For me, the computer that always fails has 12 cores, whereas the computer that always works has 4 cores.

I decided to do an experiment on my failing 12 core machine: I run MSCONFIG, go to Boot options go into Advanced Options I tried changing my cores to either 4 or 8. And, oh my gosh, to my surprise, in both tests, the problem went away?!?! So, there must be some fault in the 7zip library not handling a large number of cores?!
K Offline
K Offline
KMKT

wrote on last edited by

#20

@Stephen-Quan Thank you for detailing how to limit the number of processors. I did not know it was possible.
Remark: my Intel Core i9 CPU has 10 cores, which makes 20 logical processors. So if I set the number of processors to 8, it iactually limits my CPU to 4 cores.
1 Reply Last reply

0