Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • Users
  • Groups
  • Search
  • Get Qt Extensions
  • Unsolved
Collapse
Brand Logo
  1. Home
  2. Qt Development
  3. General and Desktop
  4. Handling large amounts of data
Forum Updated to NodeBB v4.3 + New Features

Handling large amounts of data

Scheduled Pinned Locked Moved General and Desktop
2 Posts 2 Posters 1.1k Views 1 Watching
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • C Offline
    C Offline
    clarkb7
    wrote on last edited by
    #1

    My app has to keep track of (potentially) several GB of data. This data is in the form of numbers (qreal) and strings (QString), which represents heap usage(allocs, staleness, etc), callstacks, etc of an application.

    Currently I am storing structs on the heap to keep track of the data. Would switching to a model/view style benefit me at all? Does this framework provide methods to keep memory usage down?

    Or should I use some sort of packing infrastructure to compress the data I don't need at the moment, and just keep a cache of recently accessed data.

    Only a fraction of the data needs to be accessed at any given moment (1-15%), so overall memory usage is really what I'm concerned with.

    Any other suggestions would be greatly appreciated, thanks.

    1 Reply Last reply
    0
    • SGaistS Offline
      SGaistS Offline
      SGaist
      Lifetime Qt Champion
      wrote on last edited by
      #2

      Hi,

      What about using a database ? That would allow you to avoid using enormous amount of memory for unused data and use the model view paradigm.

      If you need to keep a cache of current data, you could create a custom model to access them that could also fetch the data from the database as needed.

      Hope it helps

      Interested in AI ? www.idiap.ch
      Please read the Qt Code of Conduct - https://forum.qt.io/topic/113070/qt-code-of-conduct

      1 Reply Last reply
      0

      • Login

      • Login or register to search.
      • First post
        Last post
      0
      • Categories
      • Recent
      • Tags
      • Popular
      • Users
      • Groups
      • Search
      • Get Qt Extensions
      • Unsolved