Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • Users
  • Groups
  • Search
  • Get Qt Extensions
  • Unsolved
Collapse
Brand Logo
  1. Home
  2. Qt Development
  3. General and Desktop
  4. Exception of multi thread reading QSqlTableModel

Exception of multi thread reading QSqlTableModel

Scheduled Pinned Locked Moved Solved General and Desktop
39 Posts 5 Posters 4.1k Views
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • JonBJ JonB

    @tovax

    I created the QSqlTableModel in the main thread and connected it to the database correctly. I want to quickly read the data in the model in the child thread

    You are not allowed to perform SQL operations in a different thread from where the connection/model were created/live.

    tovaxT Offline
    tovaxT Offline
    tovax
    wrote on last edited by
    #4

    @JonB
    In other words, it is necessary to copy the data in the model into memory. Is my understanding correct please?

    JonBJ 1 Reply Last reply
    0
    • JonBJ JonB

      @tovax

      I created the QSqlTableModel in the main thread and connected it to the database correctly. I want to quickly read the data in the model in the child thread

      You are not allowed to perform SQL operations in a different thread from where the connection/model were created/live.

      tovaxT Offline
      tovaxT Offline
      tovax
      wrote on last edited by
      #5

      @JonB
      Thank you very much!
      Best Wishes!

      1 Reply Last reply
      0
      • tovaxT tovax

        @JonB
        In other words, it is necessary to copy the data in the model into memory. Is my understanding correct please?

        JonBJ Offline
        JonBJ Offline
        JonB
        wrote on last edited by
        #6

        @tovax said in Exception of multi thread reading QSqlTableModel:

        In other words, it is necessary to copy the data in the model into memory. Is my understanding correct please?

        I don't really understand what this question means? A SQL operation like fetching the data must be performed in the thread owning the SQL connection. That thread could pre-read the result set, or a child thread could send it a signal asking it to do so when it wants it. I don't know why you are using child thread(s) here, but if you do your reading in another thread you might be best putting the QSql... variables there, or moving them to that thread.

        tovaxT 1 Reply Last reply
        1
        • JonBJ JonB

          @tovax said in Exception of multi thread reading QSqlTableModel:

          In other words, it is necessary to copy the data in the model into memory. Is my understanding correct please?

          I don't really understand what this question means? A SQL operation like fetching the data must be performed in the thread owning the SQL connection. That thread could pre-read the result set, or a child thread could send it a signal asking it to do so when it wants it. I don't know why you are using child thread(s) here, but if you do your reading in another thread you might be best putting the QSql... variables there, or moving them to that thread.

          tovaxT Offline
          tovaxT Offline
          tovax
          wrote on last edited by
          #7

          @JonB
          The data of QSqlTableModel is a global parameter, which needs to be used by multiple child threads. Your reply made me know the reason. According to your help, copying the data in the model to memory should solve my problem. I am modifying the code.
          It should also be a good way to reestablish a connection between the model and the database at each child thread.
          Thank you again.

          1 Reply Last reply
          0
          • SGaistS Offline
            SGaistS Offline
            SGaist
            Lifetime Qt Champion
            wrote on last edited by
            #8

            Hi,

            If you want multithreaded access you should create one connection per thread.

            Interested in AI ? www.idiap.ch
            Please read the Qt Code of Conduct - https://forum.qt.io/topic/113070/qt-code-of-conduct

            tovaxT 1 Reply Last reply
            1
            • SGaistS SGaist

              Hi,

              If you want multithreaded access you should create one connection per thread.

              tovaxT Offline
              tovaxT Offline
              tovax
              wrote on last edited by tovax
              #9

              @SGaist Hi, Thanks a lot for your help!
              If a child thread modifies the data in the database, how can the QSqlTableModel of other threads be updated synchronously? By a signal send from this child thread?

              1 Reply Last reply
              0
              • tovaxT Offline
                tovaxT Offline
                tovax
                wrote on last edited by
                #10

                7d9b611a-ea89-451b-94c6-4e275ff6bb43-图片.png
                Main thread: create QTableView to modify the database
                Child thread1: only read database
                Child thread2: read database by "tableModel->data()", and write database by "tableModel->setData()"
                Child thread3: only read database
                All threads must be synchronized.

                1 Reply Last reply
                0
                • tovaxT Offline
                  tovaxT Offline
                  tovax
                  wrote on last edited by
                  #11

                  In other words, different threads connect to the same database. When one thread updates the data in the database, how do other threads know that the database has been updated? The method of using Signal-Slots between threads seems troublesome.

                  JonBJ 1 Reply Last reply
                  0
                  • tovaxT tovax

                    In other words, different threads connect to the same database. When one thread updates the data in the database, how do other threads know that the database has been updated? The method of using Signal-Slots between threads seems troublesome.

                    JonBJ Offline
                    JonBJ Offline
                    JonB
                    wrote on last edited by JonB
                    #12

                    @tovax said in Exception of multi thread reading QSqlTableModel:

                    The method of using Signal-Slots between threads seems troublesome.

                    Nonetheless this is indeed the paradigm Qt wants you to use! Why do you find it "troublesome"?

                    Although doubtless he is correct --- he usually is! --- I do not share @SGaist's immediate alacrity to move to separate connections per thread. It may be required, but it could be costly on resources/memory/speed/consistency. You might also consider either working on an in-memory, shared copy of the data already read in, or signals/slots to/from the main thread. It depends on what you are doing where.

                    tovaxT 1 Reply Last reply
                    0
                    • Christian EhrlicherC Offline
                      Christian EhrlicherC Offline
                      Christian Ehrlicher
                      Lifetime Qt Champion
                      wrote on last edited by
                      #13

                      @JonB said in Exception of multi thread reading QSqlTableModel:

                      It may be required,

                      It is required - QSqlDatabase database connection is not thread-safe.

                      how do other threads know that the database has been updated?

                      Use signals/slots

                      The method of using Signal-Slots between threads seems troublesome.

                      Why? It's much easier than using semaphores and wait conditions.

                      But still don't see why you need threads in the first place.

                      Qt Online Installer direct download: https://download.qt.io/official_releases/online_installers/
                      Visit the Qt Academy at https://academy.qt.io/catalog

                      JonBJ tovaxT 2 Replies Last reply
                      0
                      • JonBJ JonB

                        @tovax said in Exception of multi thread reading QSqlTableModel:

                        The method of using Signal-Slots between threads seems troublesome.

                        Nonetheless this is indeed the paradigm Qt wants you to use! Why do you find it "troublesome"?

                        Although doubtless he is correct --- he usually is! --- I do not share @SGaist's immediate alacrity to move to separate connections per thread. It may be required, but it could be costly on resources/memory/speed/consistency. You might also consider either working on an in-memory, shared copy of the data already read in, or signals/slots to/from the main thread. It depends on what you are doing where.

                        tovaxT Offline
                        tovaxT Offline
                        tovax
                        wrote on last edited by
                        #14

                        @JonB said in Exception of multi thread reading QSqlTableModel:

                        gm Qt wants you to use! Why do you find it "troubles

                        If there are more threads that modify the database, then it is necessary to establish signal slot connections from these threads to all other threads.

                        KroMignonK 1 Reply Last reply
                        0
                        • Christian EhrlicherC Offline
                          Christian EhrlicherC Offline
                          Christian Ehrlicher
                          Lifetime Qt Champion
                          wrote on last edited by
                          #15

                          @tovax said in Exception of multi thread reading QSqlTableModel:

                          then it is necessary to establish signal slot connections from these threads to all other threads.

                          That's also true when you don't use signals and slots...

                          Qt Online Installer direct download: https://download.qt.io/official_releases/online_installers/
                          Visit the Qt Academy at https://academy.qt.io/catalog

                          1 Reply Last reply
                          0
                          • Christian EhrlicherC Christian Ehrlicher

                            @JonB said in Exception of multi thread reading QSqlTableModel:

                            It may be required,

                            It is required - QSqlDatabase database connection is not thread-safe.

                            how do other threads know that the database has been updated?

                            Use signals/slots

                            The method of using Signal-Slots between threads seems troublesome.

                            Why? It's much easier than using semaphores and wait conditions.

                            But still don't see why you need threads in the first place.

                            JonBJ Offline
                            JonBJ Offline
                            JonB
                            wrote on last edited by
                            #16

                            @Christian-Ehrlicher said in Exception of multi thread reading QSqlTableModel:

                            It may be required,

                            It is required - QSqlDatabase database connection is not thread-safe.

                            Yes, I was the first person to say that if you want to access a QSqlDatabase database connection you must only do so from its owning thread. If you read what I was saying, I was talking about not having multiple database connections, as an alternative.

                            If, for whatever reason, the user wants to have 100 threads running accessing data read from the database, having 100 separate database connections is not an advisable approach. IMHO.

                            tovaxT 1 Reply Last reply
                            0
                            • Christian EhrlicherC Christian Ehrlicher

                              @JonB said in Exception of multi thread reading QSqlTableModel:

                              It may be required,

                              It is required - QSqlDatabase database connection is not thread-safe.

                              how do other threads know that the database has been updated?

                              Use signals/slots

                              The method of using Signal-Slots between threads seems troublesome.

                              Why? It's much easier than using semaphores and wait conditions.

                              But still don't see why you need threads in the first place.

                              tovaxT Offline
                              tovaxT Offline
                              tovax
                              wrote on last edited by
                              #17

                              @Christian-Ehrlicher said in Exception of multi thread reading QSqlTableModel:

                              But still don't see why you need threads in the first place.

                              The time-consuming trajectory algorithm and real-time motion control algorithm in the application program need to be processed by separate threads, which will use the parameter data in the database.

                              1 Reply Last reply
                              0
                              • tovaxT tovax

                                @JonB said in Exception of multi thread reading QSqlTableModel:

                                gm Qt wants you to use! Why do you find it "troubles

                                If there are more threads that modify the database, then it is necessary to establish signal slot connections from these threads to all other threads.

                                KroMignonK Offline
                                KroMignonK Offline
                                KroMignon
                                wrote on last edited by
                                #18

                                @tovax said in Exception of multi thread reading QSqlTableModel:

                                If there are more threads that modify the database, then it is necessary to establish signal slot connections from these threads to all other threads.

                                As @Christian-Ehrlicher already written, QSqlDatabase is not thread-safe, so you have 2 options:

                                • do all DB stuff in one thread, by using signals/slots it is quit easy.
                                • use as many QSqlDatabase connections as you have threads ==> take a look here for example: https://forum.qt.io/topic/103626/problem-with-sqlite-database-and-threads-database-is-locked/14

                                It is an old maxim of mine that when you have excluded the impossible, whatever remains, however improbable, must be the truth. (Sherlock Holmes)

                                tovaxT 1 Reply Last reply
                                0
                                • JonBJ JonB

                                  @Christian-Ehrlicher said in Exception of multi thread reading QSqlTableModel:

                                  It may be required,

                                  It is required - QSqlDatabase database connection is not thread-safe.

                                  Yes, I was the first person to say that if you want to access a QSqlDatabase database connection you must only do so from its owning thread. If you read what I was saying, I was talking about not having multiple database connections, as an alternative.

                                  If, for whatever reason, the user wants to have 100 threads running accessing data read from the database, having 100 separate database connections is not an advisable approach. IMHO.

                                  tovaxT Offline
                                  tovaxT Offline
                                  tovax
                                  wrote on last edited by
                                  #19

                                  @JonB
                                  Yes, I agree with you. In extreme cases, establishing separate database connections should be very resource intensive. At present, I prefer to share memory copies.

                                  1 Reply Last reply
                                  0
                                  • KroMignonK KroMignon

                                    @tovax said in Exception of multi thread reading QSqlTableModel:

                                    If there are more threads that modify the database, then it is necessary to establish signal slot connections from these threads to all other threads.

                                    As @Christian-Ehrlicher already written, QSqlDatabase is not thread-safe, so you have 2 options:

                                    • do all DB stuff in one thread, by using signals/slots it is quit easy.
                                    • use as many QSqlDatabase connections as you have threads ==> take a look here for example: https://forum.qt.io/topic/103626/problem-with-sqlite-database-and-threads-database-is-locked/14
                                    tovaxT Offline
                                    tovaxT Offline
                                    tovax
                                    wrote on last edited by
                                    #20

                                    @KroMignon said in Exception of multi thread reading QSqlTableModel:

                                    do all DB stuff in one thread, by using signals/slots it is quit easy.

                                    It's easy to write data by using signals/slots, but is it necessary to copy a memory copy for reading data? Because DB data cannot be read directly from other threads...

                                    JonBJ 1 Reply Last reply
                                    1
                                    • tovaxT tovax

                                      @KroMignon said in Exception of multi thread reading QSqlTableModel:

                                      do all DB stuff in one thread, by using signals/slots it is quit easy.

                                      It's easy to write data by using signals/slots, but is it necessary to copy a memory copy for reading data? Because DB data cannot be read directly from other threads...

                                      JonBJ Offline
                                      JonBJ Offline
                                      JonB
                                      wrote on last edited by JonB
                                      #21

                                      @tovax
                                      Yes, this is the issue. As you say, emitting a signal to ask the main thread to do a write (setData()) for your thread is not so difficult. Your problem comes on trying to synchronise read access (data()).

                                      It is easier to maintain per-thread connections for that purpose. But that comes with other overheads, as discussed. Depends on how much of what you need to do when.

                                      1 Reply Last reply
                                      0
                                      • Christian EhrlicherC Offline
                                        Christian EhrlicherC Offline
                                        Christian Ehrlicher
                                        Lifetime Qt Champion
                                        wrote on last edited by
                                        #22

                                        Again: why do you think you need threads for simple reading data from the database? What heaviy computation do you do with those values?

                                        Qt Online Installer direct download: https://download.qt.io/official_releases/online_installers/
                                        Visit the Qt Academy at https://academy.qt.io/catalog

                                        tovaxT 1 Reply Last reply
                                        1
                                        • Christian EhrlicherC Christian Ehrlicher

                                          Again: why do you think you need threads for simple reading data from the database? What heaviy computation do you do with those values?

                                          tovaxT Offline
                                          tovaxT Offline
                                          tovax
                                          wrote on last edited by
                                          #23

                                          @Christian-Ehrlicher
                                          The main purpose of thread is to process time-consuming algorithms and real-time control. Reading data from the database is only to obtain the global parameters needed in the algorithm and control process.

                                          JonBJ KroMignonK 2 Replies Last reply
                                          0

                                          • Login

                                          • Login or register to search.
                                          • First post
                                            Last post
                                          0
                                          • Categories
                                          • Recent
                                          • Tags
                                          • Popular
                                          • Users
                                          • Groups
                                          • Search
                                          • Get Qt Extensions
                                          • Unsolved