Opening .tiff geoimages consumes enormous memory

mrjj

Hi
A 500 MB tiff is massive if high compression is used.
Unless you have 32+ GB ram, it might not be possible to open it.

The alternative is to load it in chunks
https://wiki.qt.io/Loading_Large_Images

But depending on what you need to do with it, it might not be a solution.
Also I have not tested this with the TIFF format.

Ah, never mind. you want use openCV to load the image.

update:
You might want to check out
https://github.com/pearu/pylibtiff
it's a python wrapper for libtiff which is supports tiles (chunks) directly.
So you might be able to load it via this and us openCV to display.
https://answers.opencv.org/question/86621/reading-geo-tiff/#86740

SGaist

Hi,

One thing to take into account: to represent a compressed image in a format like RGB, you will have to decompress it. You are mixing storage and usage. Depending on what you need from that image, you may have a thumbnail already embedded into it. In any case, you really should analyse what you need to do with that image and then adapt your code for that. Like suggested by my fellows there are tools to deal with these kind of data.

john_hobbyist

I am trying opening the tiff with this command:

QImageReader reader("/home/UbuntuUser/Desktop/UAV.tif");
print(reader)

but something is wrong... Any idea?

update:

File "code.py", line 547
    QImageReader reader("/home/UbuntuUser/Desktop/UAV.tif");
                 ^
SyntaxError: invalid syntax

SGaist

What does "but something is wrong" mean ?

mrjj

Hi
That looks like c++ syntax but you are using python, right ?
So is it not like
r = QImageReader("/home/UbuntuUser/Desktop/UAV.tif")

john_hobbyist

This post is deleted!

mrjj

@john_hobbyist

Hi
Why this old version ?

Anyway, what are you trying ?

Building PyQT4 from source ?

Also is there any reason you want to use the competing Qt binding from another company instead of the
official support one called pyside2 ?
https://pypi.org/project/PySide2/
https://doc.qt.io/qtforpython/

john_hobbyist

@mrjj

I don't know what goes wrong...

I just try to handle large tiff images instead of using opencv (that makes my program realy slow) with QTimagereader

Sorry, I didn't identify it was a competing company...just a result in google when tried to install PyQt4

Ok, I will look at it.

mrjj

@john_hobbyist
Hi
Np I just wondered why you want Qt4 version and build from the source when
PyQt5 is there and seems to be installable directly.
Also here is how to use it
https://programtalk.com/python-examples/PyQt5.Qt.QImageReader/
Do note none of them use setClipRect to load image in chunks but
should be easy to add.

Christian Ehrlicher

QtImagrReader is for sure not the correct way to handle geotiff. Either use openCV or better gdal for such tasks.

john_hobbyist

@Christian-Ehrlicher

I am trying GDAL in order to print the image:

from osgeo import gdal
import sys

ds = gdal.Open('UAV_image.tif')
print(ds)

and I get this error:

<osgeo.gdal.Dataset; proxy of <Swig Object of type 'GDALDatasetShadow *' at 0x7fb89062b840> >

Any idea what I am missing here?

Christian Ehrlicher

@john_hobbyist said in Opening .tiff geoimages consumes enormous memory:

Any idea what I am missing here?

Nothing. All is fine.

john_hobbyist

Why I cannot see the image?

SGaist

The Python print function only print strings or a string representation of the object.

Check if GDAL provides a widget or equivalent for that.

john_hobbyist

Ok, until now OpenCV requires ~24GB RAM, gdal does not work. Is there any QImageReader sample code to open the .tif? I am searching the google for this...nothing found.

mrjj

@john_hobbyist
Hi
in what way did GDAL not work ?

Also, Mr @Christian-Ehrlicher made me realize that geotiff is a special tiff so
even QImageReader can read an image in sections. it might not really do what you want.

What do you need to do to this image ?

Christian Ehrlicher

@john_hobbyist I wonder what you want to do with this image when you even don't know the basics of this format... it's a georeferenced image with multiple images and bands inside. It's not a simple picture at all.

john_hobbyist

@mrjj and @Christian-Ehrlicher:

I want to open it and do some zooming with code I use. Also I want to read the coordinates from the image (I do not how, but I am searching it)

mrjj

@john_hobbyist
Ok then QImageReader is not the way as it can't access any coordinates.

I think you gave up on GDAL too fast. It's whats people seem to use.

john_hobbyist

@mrjj: yes with

gdalinfo

command on the terminal I get the information I want...
Is there any way to get these information from the terminal and feed it to my python code for further processing? In other words how do I read information posted in terminal and use it inside my python code?

Ok, I will try again gdal to open the .tif