Link all libraries into the executable (actually: make a deploy folder)

asanka424

@mrjj if you are on linux you can use rpath and specify where to look for binaries, which is very handy. so you can distribute your application in a clean directory structure. you dont have to use a startup script

Pippin

I'm sorry but I'm a total newbie, I'd appreciate if somebody could walk me through it. First, how do I get to find the list of all the .so files I need (how do I know I need this one and not that one for instance) ?

mrjj

@asanka424
yeah I tried that once. Seems very handy.
Mostly used the script but rpath seems far more elegant.

mrjj

@Pippin
build you "exe" file
go to the folder in a shell
type
ldd ./yourprogram

and it lists all it needs.
But the http://www.tripleboot.org/?p=138 does list the barebone
SO files. so its a good start.
then u might need some boost so files.

asanka424

@mrjj Yes ldd is your friend in Ubuntu. Don't forget platforms folder in Qt plugins directory.

Pippin

Thanks for your replies.

This is what I get when I run ldd ./my_app

linux-vdso.so.1 =>  (0x00007ffd2c59c000)
libsfml-system.so.2.3 => /usr/local/lib/libsfml-system.so.2.3 (0x00007f754cf96000)
libsfml-network.so.2.3 => /usr/local/lib/libsfml-network.so.2.3 (0x00007f754cd78000)
libQt5Widgets.so.5 => /usr/lib/x86_64-linux-gnu/libQt5Widgets.so.5 (0x00007f754c6f6000)
libQt5Gui.so.5 => /usr/lib/x86_64-linux-gnu/libQt5Gui.so.5 (0x00007f754c1bc000)
libQt5Core.so.5 => /usr/lib/x86_64-linux-gnu/libQt5Core.so.5 (0x00007f754bd00000)
libpthread.so.0 => /lib/x86_64-linux-gnu/libpthread.so.0 (0x00007f754bae1000)
libstdc++.so.6 => /usr/lib/x86_64-linux-gnu/libstdc++.so.6 (0x00007f754b75f000)
libm.so.6 => /lib/x86_64-linux-gnu/libm.so.6 (0x00007f754b457000)
libgcc_s.so.1 => /lib/x86_64-linux-gnu/libgcc_s.so.1 (0x00007f754b23f000)
libc.so.6 => /lib/x86_64-linux-gnu/libc.so.6 (0x00007f754ae75000)
librt.so.1 => /lib/x86_64-linux-gnu/librt.so.1 (0x00007f754ac6d000)
libgobject-2.0.so.0 => /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0 (0x00007f754aa19000)
libglib-2.0.so.0 => /lib/x86_64-linux-gnu/libglib-2.0.so.0 (0x00007f754a70a000)
libX11.so.6 => /usr/lib/x86_64-linux-gnu/libX11.so.6 (0x00007f754a3d0000)
libpng12.so.0 => /lib/x86_64-linux-gnu/libpng12.so.0 (0x00007f754a1a9000)
libharfbuzz.so.0 => /usr/lib/x86_64-linux-gnu/libharfbuzz.so.0 (0x00007f7549f4b000)
libz.so.1 => /lib/x86_64-linux-gnu/libz.so.1 (0x00007f7549d31000)
libGL.so.1 => /usr/lib/x86_64-linux-gnu/mesa/libGL.so.1 (0x00007f7549a98000)
libicui18n.so.55 => /usr/lib/x86_64-linux-gnu/libicui18n.so.55 (0x00007f7549635000)
libicuuc.so.55 => /usr/lib/x86_64-linux-gnu/libicuuc.so.55 (0x00007f75492a1000)
libpcre16.so.3 => /usr/lib/x86_64-linux-gnu/libpcre16.so.3 (0x00007f754903d000)
libdl.so.2 => /lib/x86_64-linux-gnu/libdl.so.2 (0x00007f7548e39000)
/lib64/ld-linux-x86-64.so.2 (0x000056220c544000)
libffi.so.6 => /usr/lib/x86_64-linux-gnu/libffi.so.6 (0x00007f7548c30000)
libpcre.so.3 => /lib/x86_64-linux-gnu/libpcre.so.3 (0x00007f75489c3000)
libxcb.so.1 => /usr/lib/x86_64-linux-gnu/libxcb.so.1 (0x00007f75487a2000)
libfreetype.so.6 => /usr/lib/x86_64-linux-gnu/libfreetype.so.6 (0x00007f75484fb000)
libgraphite2.so.3 => /usr/lib/x86_64-linux-gnu/libgraphite2.so.3 (0x00007f75482df000)
libexpat.so.1 => /lib/x86_64-linux-gnu/libexpat.so.1 (0x00007f75480b6000)
libglapi.so.0 => /usr/lib/x86_64-linux-gnu/libglapi.so.0 (0x00007f7547e87000)
libXext.so.6 => /usr/lib/x86_64-linux-gnu/libXext.so.6 (0x00007f7547c75000)
libXdamage.so.1 => /usr/lib/x86_64-linux-gnu/libXdamage.so.1 (0x00007f7547a72000)
libXfixes.so.3 => /usr/lib/x86_64-linux-gnu/libXfixes.so.3 (0x00007f754786b000)
libX11-xcb.so.1 => /usr/lib/x86_64-linux-gnu/libX11-xcb.so.1 (0x00007f7547669000)
libxcb-glx.so.0 => /usr/lib/x86_64-linux-gnu/libxcb-glx.so.0 (0x00007f7547450000)
libxcb-dri2.so.0 => /usr/lib/x86_64-linux-gnu/libxcb-dri2.so.0 (0x00007f754724a000)
libxcb-dri3.so.0 => /usr/lib/x86_64-linux-gnu/libxcb-dri3.so.0 (0x00007f7547047000)
libxcb-present.so.0 => /usr/lib/x86_64-linux-gnu/libxcb-present.so.0 (0x00007f7546e44000)
libxcb-sync.so.1 => /usr/lib/x86_64-linux-gnu/libxcb-sync.so.1 (0x00007f7546c3c000)
libxshmfence.so.1 => /usr/lib/x86_64-linux-gnu/libxshmfence.so.1 (0x00007f7546a39000)
libXxf86vm.so.1 => /usr/lib/x86_64-linux-gnu/libXxf86vm.so.1 (0x00007f7546833000)
libdrm.so.2 => /usr/lib/x86_64-linux-gnu/libdrm.so.2 (0x00007f7546624000)
libicudata.so.55 => /usr/lib/x86_64-linux-gnu/libicudata.so.55 (0x00007f7544b6d000)
libXau.so.6 => /usr/lib/x86_64-linux-gnu/libXau.so.6 (0x00007f7544968000)
libXdmcp.so.6 => /usr/lib/x86_64-linux-gnu/libXdmcp.so.6 (0x00007f7544762000)

The very first file (linux-vdso.so.1) has no path, where can I find it?

@asanka424 said:

Also make sure you include Qt plugins as well. Dependecy Walker might not show these as dependencies. These are (incomplete list)

platforms
imageformats
iconengines
sqldrivers and etc.

How can I know which .so files in these folders are required, and which ones aren't?

Pippin

Status update: So I've managed to put all of the .so files that ldd listed in my project's directory. When I typed ldd ./my_app again, I could verify that every single .so file is found in my project's directory as expected.

Now, when I run ./my_app I get two different errors, depending on whether I run it on a computer that has all libraries installed, or on a computer that has nothing installed.

On Ubuntu 15.10 with everything installed:

./my_app: symbol lookup error: /home/lol/Documents/Coding/Union/libQt5Gui.so.5: undefined symbol: glGetString

On Ubuntu 15.10 with nothing installed:

This application failed to start because it could not find or load the Qt platform plugin "xcb".

So I must have skipped a few steps. Also, I'm not sure I understand why ldd never listed any kind of boost .so file. I must have to link the boost library at some point I suppose.

mrjj

Hi
Good work.
did u remember a subfolder called platforms
as mentioned here
http://www.tripleboot.org/?p=138

Im also a bit surprised that no boost is listed. Maybe u compile it in ?

Pippin

Okay but what about my first error?

./my_app: symbol lookup error: /home/lol/Documents/Coding/Union/libQt5Gui.so.5: undefined symbol: glGetString

It seems to indicate that something has not been linked, so I think it's the same problem as the boost problem I mentioned. How can I find out all of the .so files that I need and that ldd did not list? How would you guys solve this problem if it were yours?

Edit: Not sure if that helps, but additional information. I typed ldd -v ./my_app for further details and I found this (I filtered most of the output, it should be much longer than that):

	/home/lol/Documents/Coding/Union/./libQt5Core.so.5:
		ld-linux-x86-64.so.2 (GLIBC_2.3) => /lib64/ld-linux-x86-64.so.2

	/home/lol/Documents/Coding/Union/./libpthread.so.0:
		ld-linux-x86-64.so.2 (GLIBC_2.2.5) => /lib64/ld-linux-x86-64.so.2
		ld-linux-x86-64.so.2 (GLIBC_2.3) => /lib64/ld-linux-x86-64.so.2
		ld-linux-x86-64.so.2 (GLIBC_PRIVATE) => /lib64/ld-linux-x86-64.so.2

	/home/lol/Documents/Coding/Union/./libstdc++.so.6:
		ld-linux-x86-64.so.2 (GLIBC_2.3) => /lib64/ld-linux-x86-64.so.2

	/home/lol/Documents/Coding/Union/./libc.so.6:
		ld-linux-x86-64.so.2 (GLIBC_2.3) => /lib64/ld-linux-x86-64.so.2
		ld-linux-x86-64.so.2 (GLIBC_PRIVATE) => /lib64/ld-linux-x86-64.so.2

	/home/lol/Documents/Coding/Union/./libdl.so.2:
		ld-linux-x86-64.so.2 (GLIBC_PRIVATE) => /lib64/ld-linux-x86-64.so.2

For some reason, ld-linux-x86-64.so.2 (in my project directory) links to its other copy /lib64/ld-linux-x86-64.so.2 (not in my project directory) even though both files are identical. I literally copy/pasted it.

mrjj

Hi
I would take the SO files listed
http://www.tripleboot.org/?p=138
Please say you did read it.

and then try to deploy on clean linux.
if it wont start, i would use ldd to see which so it still needs on the clean machine.

Please note that not all dll that LDD lists are needed as some are part of linux so only Qt ones and libsfml
would be interesting.

some files like
/lib/x86_64-linux-gnu/libc.so.6
should already be in the linux

kshegunov

@Pippin
Don't copy system libraries at random, especially the linker, loader, the C runtime and the like! You need to extract all Qt's binaries and your external dependencies. Moreover, on linux one usually leaves the dependencies to the package manager instead of deploying copies of the libraries (by means of packaging one's apps/libraries). Consider, what happens if I try running your application (especially if you haven't set the rpath) on my machine, it's a recipe for trouble. If you're deploying for testing purposes I propose using LD_LIBRARY_PATH when starting the application.

This:

./my_app: symbol lookup error: /home/lol/Documents/Coding/Union/libQt5Gui.so.5: undefined symbol: glGetString

is a loader error and means that the open GL library is nowhere to be found. Make sure you have that installed on the machine.

Kind regards.

Pippin

@mrjj said:

http://www.tripleboot.org/?p=138
Please say you did read it.

Yes, I did read it.

But I think I'm failing to understand what you people want me to do. I've tried to follow the link you showed, and it caused problems, which I have submitted and am waiting for solutions. Especially, I would like to know how to find out the hidden .so files that my project needs.

@mrjj said:

and then try to deploy on clean linux.
if it wont start, i would use ldd to see which so it still needs on the clean machine.

I've already tried that, but shouldn't it first work on this machine before working on others?

@kshegunov said:

You need to extract all Qt's binaries and your external dependencies.

I'm sorry but as a newbie, I do not know how to do that. I am not using Qt Creator at all, I'm doing everything through the terminal. I use qmake, make and run the executable.

Also, I'm confused that the open GL library is nowhere to be found as I do link libGL.so.1, libglib-2.0.so.0, libglapi.so.0, libxcb-glx.so.0 and libglib-2.0.so.0. I'm looking forward to your next instructions.

kshegunov

@Pippin

I'm sorry but as a newbie, I do not know how to do that. I am not using Qt Creator at all, I'm doing everything through the terminal. I use qmake, make and run the executable.

I mean that you'd package them with your executable. From your ldd called on the application you get:

/home/lol/Documents/Coding/Union/./libQt5Core.so.5:
        ld-linux-x86-64.so.2 (GLIBC_2.3) => /lib64/ld-linux-x86-64.so.2

which means, you'll need to have libQt5Core.so to run your application. However libstdc++.so is a system library and you shouldn't copy it along your application. Additionally, each of the *.so's you copy have dependencies of its own that should be met (meaning you have to copy them if needed as well).

When you start your application the loader (called also the dynamic linker on Linux) will read up the dependencies and start mapping the libraries to memory. Each of the loaded libraries' dependencies will be loaded as well. For this to happen the loader must know where to find the libraries. The singular path, provided a special rpath variable in the ELF header is not present, is a set of system directories (most commonly /lib, /usr/lib). There's a way to tell the loader where your libraries are located when starting your application with the LD_LIBRARY_PATH system variable, although for most cases this is discouraged. This somewhat lengthily describes what is done by the OS, and in fact is Qt-independent, it's just how Linux works.

Now, back to your original problem. After you copy all the Qt libraries you're using, and their dependencies (the link @mrjj provided is an excellent staring point), and after you make sure all the system libraries are installed on the sytem (like stdc++, libGL and so on) you can start your application. You do that like this:

>$ LD_LIBRARY_PATH=/path/to/libraries:$LD_LIBRARY_PATH ./executablename

/path/to/libraries is where the loader should search for the libraries you've copied, and executablename is the name of your program. If all the prerequisites are met (as described above) you should be able to see that your application runs.

Kind regards.

asanka424

if you have all your so files in same directory as your executable, it will find those libraries. Only things you want to copy is Qt related libaries. Other than files starting with libQt5 you will need

libicudata
libicui18n
libicuuc.so

Also platforms directory from qt plugings directory. For example
/opt/Qt/5.5.1/5.5/gcc_64/plugins.

kshegunov

@asanka424

if you have all your so files in same directory as your executable, it will find those libraries.

On Windows, yes, but not on Linux. You have to explicitly point the loader to the current working directory.

asanka424

@kshegunov I thought . is default added into rpath. Yes that is build chain specific thing and should not consider as a global thing.

Pippin

@kshegunov Thanks for taking the time to break it down for me, I appreciate it. So I'll try to sort the .so file list I made earlier:

These files should be in my project directory:

platforms/libqxcb.so
libsfml-system.so.2.3
libsfml-network.so.2.3
libQt5Widgets.so.5
libQt5Gui.so.5
libQt5Core.so.5

As well as these files (because of the SFML libraries)

libfreetype.so.6
libX11.so.6
libxcb.so.1
libX11-xcb.so.1
libxcb-glx.so.0
libxcb-dri2.so.0
libxcb-dri3.so.0
libxcb-present.so.0
libxcb-sync.so.1
libGL.so.1
libpthread.so.0

As well as these files (because of the Qt libraries)

libicudata.so.55
libicui18n.so.55
libicuuc.so.55

And these files should not be included in my project directory:

libstdc++.so.6
libm.so.6
libgcc_s.so.1
libc.so.6
librt.so.1
libgobject-2.0.so.0
libglib-2.0.so.0
libgobject-2.0.so.0
libpng12.so.0
libharfbuzz.so.0
libz.so.1
libpcre16.so.3
libdl.so.2
libffi.so.6
libpcre.so.3
libgraphite2.so.3
libexpat.so.1
libglapi.so.0
libXext.so.6
libXdamage.so.1
libXfixes.so.3
libxshmfence.so.1
libXxf86vm.so.1
libdrm.so.2
libXau.so.6
libXdmcp.so.6

Did I get something wrong in any list? Anyway, I tried that and compiled my project successfully. When I run it however, I still get the old openGL message:

./my_app: symbol lookup error: /home/lol/Documents/Coding/Union/libQt5Gui.so.5: undefined symbol: glGetString

which I never had before I started to mess with .so files. I'm not sure how to determine which .so file is needed for glGetString.

kshegunov

@asanka424

is default added into rpath. Yes that is build chain specific thing and should not consider as a global thing.

Nope, by default rpath is not set.

@Pippin

Leave those to the system (don't copy them with your executable):

libfreetype - a fonts library
libX11* - X11 libraries
libxcb* - more X11 libraries
libGL - OpenGL library
libpthread - thread support

Copy libQt* (those that you need, and you seem to have done that) and libic* + the platform plugin (I also see it in your project folder).

I'm not sure how to determine which .so file is needed for glGetString.

This would be libGL.so, however if it's installed on your system it should be known to the loader. One thing that might be interfering with that would be some binary incompatibility - either a different compiler was used (unlikely to cause a problem) or a very different version of the library. Did you make sure you have libGL installed on your system?

Kind regards.

Pippin

Well I googled the issue, I added -lGL -lstdc++ -lc -lm -lglut -lGLU to LIBS in the .pro file but I still get the error. I really don't know what's happening here :S

libgl1-mesa-dev is already the newest version.

kshegunov

@Pippin
Could you run ld --verbose | grep SEARCH_DIR | tr -s ' ;' \\012 on the command line and paste what it returns? Additionally what does ldd libQt5Gui.so when you run it on your deployment folder's library?