Important: Please read the Qt Code of Conduct - https://forum.qt.io/topic/113070/qt-code-of-conduct

Problem with gbinary files, and QVector



  • Hi, i tried to save QVector data, and read it from binary file, but it crashes every time, when i try to access the file.

    If i remember good, it will work, but only if the QVector size is constant, then i can load it back, if i add some elements, save, and load the data, it will crash.

    I think the problem is, i can't save the arrays correctly, because i get the whole one big object, cast it to char, and load it back. I tried to find some good tutorials, but i wasn't unable to save the all the data.

    I use standard STD method, no qfile or something. If someone could give me an example or something, how to do it, i will appreciate it. If you want actual code, i will paste it here, but i don't think it will help, because most likely, it should be something completely different.


  • Lifetime Qt Champion

    Hi,

    It would surely help that you show the code you are using, otherwise it's just going to be shots in the dark as you don't explain what type of data you have in the QVector nor how you manipulate it.



  • @SGaist
    This is version one.

    #include "Windows/Main_Window/Main_Window.hpp"
    #include "ui_Main_Window.h"
    #include <QDebug>
    
    //***************************************************************************
    //***************************************************************************
    Main_Window::Main_Window(QWidget *parent) : QMainWindow(parent), ui(new Ui::Main_Window)
    {
        ui->setupUi(this);
        this->file_I = new ifstream("Data.bin", ios_base::binary | ios_base::in | ios_base::trunc);
        this->file_O = new ofstream;
    }
    //***************************************************************************
    //***************************************************************************
    Main_Window::~Main_Window()
    {
        this->file_I->close();
        this->file_O->close();
        delete this->file_I;
        delete this->file_O;
        delete ui;
    }
    //***************************************************************************
    //***************************************************************************
    void Main_Window::on_save_button_clicked()
    {
        this->Get_Data();
        this->Write(this->File, this->data);
        this->Show_Data();
    }
    //***************************************************************************
    //***************************************************************************
    void Main_Window::on_load_button_clicked()
    {
        this->Load(this->File, this->data);
        this->Show_Data();
    }
    //***************************************************************************
    //***************************************************************************
    void Main_Window::Write(FILE* file, Data& data)
    {
        file = fopen("Data.bin", "wb");
        fwrite(&data, sizeof(Data), 1, file);
        fclose(file);
    }
    //***************************************************************************
    //***************************************************************************
    void Main_Window::Load(FILE* file, Data& data)
    {
        fopen("Data.bin", "wb");
        fread(&data, sizeof(Data), 1, file);
        fclose(file);
    }
    //***************************************************************************
    //***************************************************************************
    void Main_Window::Show_Data()
    {
        this->ui->table_widget->item(0, 0)->setText(QString::number(this->data.scatter));
        this->ui->table_widget->item(1, 0)->setText(QString::number(this->data.speed));
        this->ui->table_widget->item(2, 0)->setText(QString::fromStdString(this->data.name));
    }
    //***************************************************************************
    //***************************************************************************
    void Main_Window::Get_Data()
    {
        this->data.scatter = this->ui->table_widget->item(0, 0)->text().toInt();
        this->data.speed = this->ui->table_widget->item(1, 0)->text().toInt();
        this->data.name = this->ui->table_widget->item(2, 0)->text().toStdString();
    }
    //***************************************************************************
    //***************************************************************************
    


  • @SGaist
    I tried many times, and this crap still don't work.
    ``

    #include "Windows/Main_Window/Main_Window.hpp"
    #include "ui_Main_Window.h"
    #include <QDebug>
    
    //***************************************************************************
    //***************************************************************************
    Main_Window::Main_Window(QWidget *parent) : QMainWindow(parent), ui(new Ui::Main_Window)
    {
        ui->setupUi(this);
        this->file_I = new ifstream("Data.bin", ios_base::binary | ios_base::in | ios_base::trunc);
        this->file_O = new ofstream;
    }
    //***************************************************************************
    //***************************************************************************
    Main_Window::~Main_Window()
    {
        this->file_I->close();
        this->file_O->close();
        delete this->file_I;
        delete this->file_O;
        delete ui;
    }
    //***************************************************************************
    //***************************************************************************
    void Main_Window::on_save_button_clicked()
    {
        this->Get_Data();
        this->Write((*this->file_O), this->data);
        this->Show_Data();
    }
    //***************************************************************************
    //***************************************************************************
    void Main_Window::on_load_button_clicked()
    {
        this->Load((*this->file_I), this->data);
        this->Show_Data();
    }
    //***************************************************************************
    //***************************************************************************
    void Main_Window::Write(ofstream &file, Data& data)
    {
        file.open("Data.bin", ios_base::binary | ios_base::out | ios_base::trunc);
        if(file.is_open() == true)
        {
            file.write((char*)&data, sizeof(Data));
        }
        file.close();
    }
    //***************************************************************************
    //***************************************************************************
    void Main_Window::Load(ifstream &file, Data& data)
    {
        file.open("Data.bin", ios_base::binary | ios_base::in | ios_base::trunc);
        if(file.is_open() == true)
        {
            while(!file.eof())
            {file.read((char*)&data, sizeof(Data));}
        }
        file.close();
    }
    //***************************************************************************
    //***************************************************************************
    void Main_Window::Show_Data()
    {
        this->ui->table_widget->item(0, 0)->setText(QString::number(this->data.scatter));
        this->ui->table_widget->item(1, 0)->setText(QString::number(this->data.speed));
        this->ui->table_widget->item(2, 0)->setText(QString::fromStdString(this->data.name));
    }
    //***************************************************************************
    //***************************************************************************
    void Main_Window::Get_Data()
    {
        this->data.scatter = this->ui->table_widget->item(0, 0)->text().toInt();
        this->data.speed = this->ui->table_widget->item(1, 0)->text().toInt();
        this->data.name = this->ui->table_widget->item(2, 0)->text().toStdString();
    }
    //***************************************************************************
    //***************************************************************************
    

  • Qt Champions 2017

    By looking at the code are you writing the Data(which is structure/class) to file ? While writing the user defined objects you need to serialise & write it. Have you seen the [example] ?(http://blog.qt.io/blog/2018/05/31/serialization-in-and-with-qt/). Also I did not see Vector in the code. Did I miss something ?



  • @dheerendra I notice the problem with saving any data. I can save something, but if i close the program and run it again, then try to read it, the program will always crash.
    I saw many of tutorials, but they are a little bit stupid, what they do, they save the file, and read it immediately, they don't close the program.


  • Qt Champions 2019

    When it's crashing you should use a debugger to see where exactly it is crashing. And since we're a Qt forum I would not use std::io but QFile.



  • @Christian-Ehrlicher I tried that too, but it won't help. It will be good, is someone could take a look at the load function, because i feel like it's not loading the data correctly.


  • Qt Champions 2019

    First you open the file twice. Second I don't understand why you pass all ifstream and ofstream around around for no good reason. And Third I don't think you want to read a file which gets truncated when it's opened for reading.
    You should really use a debugger to see where it crashes as I already said in my last post - I don't see what your problem has to do why Qt in any way.



  • @Christian-Ehrlicher Listen, if i was good with files, i would not ask for help most likely, this is just a test program and it has nothing to do with real data, and real functionality.

    I tried it with the second version of the code, that one with ofstream and ifstream, and now it's not crashing but it loads the default values... I have no clue why, it's working like there is no load function, and the data is not loading.

    So i am running the program, i change the values and save them, exit, then i run it again, click the load button, and i see the default values.


  • Qt Champions 2019

    @Christian-Ehrlicher said in Problem with gbinary files, and QVector:

    I don't think you want to read a file which gets truncated when it's opened for reading.

    Did you actually read what ios_base::trunc does?



  • @Christian-Ehrlicher I remember i tried not using it, and it dosn't help.


  • Lifetime Qt Champion

    You're truncating your file both when reading and writing. Then you have that data variable but it's unknown whether it's properly initialised.



  • @SGaist Ok, i try again, but take in consideration in those tutorials i saw, they use that trunc.
    I removed that trunc everywhere, now something is working, but the next problem i get, is it's crashing, because of the string "name" variable.
    What happened, is i get the error, i run the debugger, and it points on the name variable, in the show_data function, if i just comment it, then it's working.

    How to fix this? I guess it's the stream size fault, because last day i saw a weird error, and saw some weird symbols when i was trying to read the data, and the program crash few seconds later.

    How to save all those QVectors, stings etc, when the size variable change?


  • Lifetime Qt Champion

    I do take that into consideration. You should also take into consideration that if there's something you are not sure about, you should look up the documentation regarding that element rather than blindingly adding things here and there.

    As suggested before, since you are using Qt, use its facilities like QFile and QDataStream and be done with it. Streaming of QString, QVector etc, is already supported.



  • @SGaist I don't know any documentation about files and arrays, if i was able to do it with that, i would not post anything, because there is no point.


  • Lifetime Qt Champion

    @Loc888 The link to QDataStream that @SGaist gave you contains an almost reusable, yet small example for loading and saving. Have you looked at it?

    Regards


  • Lifetime Qt Champion

    @Loc888
    Hi
    The real benefit of using QFile and QDataStream is that it already can handle many Qt types.
    (including QString and QVector)

    http://doc.qt.io/qt-5/datastreamformat.html

    So you need not to do anything special besides how mini sample shows it

    QFile file("file.dat");
    file.open(QIODevice::WriteOnly);
    QDataStream out(&file); // we will serialize the data into the file
    QVector<double> list;
    out << list; // serialize a list of doubles. handle size by it self.

    However, if you QVector is a list of custom object ( your own class) you need to define
    << and >> for it so it know how to stream your types too.
    Often that is just to stream the member variables if they in turn are plain Qt types.



  • @mrjj Ok, i tried it with simple data, and it's working very good, it's even too easy to use, with comparision to that std stuff. So, about that standard method, if someone could help me learn how to do that, i mean how to read an array i will appreciate it, even if i am gonna use QFile because it's much more cleaner and faster too use.


  • Lifetime Qt Champion

    @Loc888
    Hi
    yes, its actually nicer than the std stuff.

    Well, it can directly do it with QVector.
    It actually write the size first then each item but its handled automatically.

    When you say array, you mean QVector or what type ?

    for any supported Qtype, a list or vector is the same as basic variables.
    simply
    outstream << thelist;
    and
    instream >> somelistvar;

    Do you have a special case in in mind with the "array" ?
    Can you show the declaration of your array ?
    makes it easier to talk about.



  • @mrjj Back to that QFile for one moment, i have to inherit that QDataStream, and overload the operators?


  • Qt Champions 2019

    @Loc888 No, you just implement << and >> operators for your own data types.
    See documentation: http://doc.qt.io/qt-5/qdatastream.html#
    You need:

    QDataStream &operator<<(QDataStream &, const YOUR_TYPE &);
    QDataStream &operator>>(QDataStream &, YOUR_TYPE &);
    

    You don't have to do it for Qt types like QVector.



  • @jsulm Ok, i took a look, and it says

    "In addition to the overloaded stream operators documented here, any Qt classes that you might want to serialize to a QDataStream will have appropriate stream operators declared as non-member of the class:"

    So i have to do that, outside the class, but how to use it then? If i crate a object, then how to use that overloaded operators?


  • Lifetime Qt Champion

    @Loc888 said in Problem with gbinary files, and QVector:

    So i have to do that, outside the class, but how to use it then? If i crate a object, then how to use that overloaded operators?

    Hi
    That is the easy part.
    Simply try it and see

    QFile file("file.dat");
    file.open(QIODevice::WriteOnly);
    QDataStream out(&file);
    out << *yourclassptr;
    (note the *)
    if Qt can find an << for a type, it will simply use it.

    That way, you can << anything you like.



  • @mrjj Ok, i try. SO i have to do a class, put there thise operators, and then use:

    out << *new_class ?


  • Lifetime Qt Champion

    @Loc888
    Yes and the reason for the * in from of object pointer is that the header says
    (QDataStream &, const YOUR_TYPE &); << reference

    so if you give it the pointer without *, it
    will save/stream the address of the object as it then matches << for int instead.
    so say always use * when you have a pointer to an object with <<


  • Lifetime Qt Champion

    Hi
    Just to be sure
    can you show your
    QDataStream &operator<<(QDataStream &, const YOUR_Class &);
    implementation.
    (not the .h declaration) but the actual body of it.



  • @mrjj In the QDataStream Class it looks like that, so i guess i am gonna use this template, except i am gonna use a custom data:

    inline QDataStream &QDataStream::operator<<(quint16 i)
    { return *this << qint16(i); }


  • Lifetime Qt Champion

    Hi
    Here is small sample.

    --in the .H file--
    class MyClass
    {
    public:
        int value = 6;
        QString name = "test";
    };
    
    QDataStream &operator<<(QDataStream &out, const MyClass &);
    QDataStream &operator>>(QDataStream &in, MyClass &);
    
    -----------
    --in the .CPP file--
    QDataStream &operator<<(QDataStream &out, const MyClass &classRef) {
    return out << classRef.value <<  classRef.name; // save each member of your class
    }
    
    QDataStream &operator>>(QDataStream &in,  MyClass &classRef){
    return in >> classRef.value >>  classRef.name; // read in IN SAME order
    }
    
    ------------------------------
    //--test of saving--
       {
            QFile file("e:/file.dat");
            file.open(QIODevice::WriteOnly);
            QDataStream out(&file);
            MyClass *ptr = new MyClass;
            out << *ptr;
        }
    //--test of loading--
        {
            QFile file("e:/file.dat");
            file.open(QIODevice::ReadOnly);
            QDataStream in(&file);
            MyClass *otherptr = new MyClass;
            in >> *otherptr;      
        }
    
    


  • @mrjj Something weird is happening, i declared those operators in a header file, then include it, and it's working, if i use that MyClass pointer, then i get the error..


  • Lifetime Qt Champion

    @Loc888
    What error?



  • @mrjj Nope, it's ok... I just typed the wrong object type. It's working finnaly. Thanks
    everybody for help.


  • Lifetime Qt Champion

    @Loc888
    Good work. :)
    please mark as solved then.



  • @mrjj It's solved, but i don't wanna close it, maybe somebody will need help with that STD stuff, i leave it behind for now, because this motheod is cleaner and faster.


  • Qt Champions 2019

    @Loc888 Please close. If somebody has a problem/question he/she can open a new thread. Your problem is solved, right?


Log in to reply