from QCamera or QVideoWidget get video bytes

[zabitqt]

@Bonnie hi, I also ask to stackoverflow

https://stackoverflow.com/questions/74058405/capture-qvideoframe-and-display-it-in-qvideowidget

Can you help me

[Bonnie]

I don't know much about QAbstractVideoSurface.
Did you try using QVideoProbe to monitor the QCamera object as I said?
If that works then there's no need to create your custom video surface to get frames.

[zabitqt]

@Bonnie said in from QCamera or QVideoWidget get video bytes:

QVideoProbe

I test QVideoProbe but unfortunately return false
qDebug() << "return" << prob->setSource(recorder);

QCamera* mCamera = new QCamera();
QMediaRecorder* recorder = new QMediaRecorder(mCamera);
QVideoEncoderSettings settings = recorder->videoSettings();
QVideoProbe* prob = new QVideoProbe();

settings.setResolution(640, 480);
settings.setQuality(QMultimedia::VeryHighQuality);
settings.setFrameRate(30.0);
settings.setCodec("video/mp4");
recorder->setVideoSettings(settings);
recorder->setContainerFormat("mp4");
mCamera->setCaptureMode(QCamera::CaptureVideo);

[Bonnie]

@zabitqt Haven't you read my above reply? I said to monitor the camera object, not the recorder, because that's unsupported on Windows and Unix...

[zabitqt]

Ok now return true!

but it display
QVideoFrame(QSize(640, 480), Format_YUYV, NoHandle, ReadOnly, [no timestamp])
image base64: ""

I don't understand. I can pay you for consulting If you resolve me problem

[Bonnie]

@zabitqt I don't do consulting jobs haha. What do you not understand? How to get bytes from QVideoFrame?

[zabitqt]

void QtVideoWidgetsIssueTrack::processFrame(const QVideoFrame& frame) {
    qDebug() << "processFrame";
    if (frame.isValid()) {
        QVideoFrame cloneFrame(frame);

        cloneFrame.map(QAbstractVideoBuffer::ReadOnly);
        qDebug() << cloneFrame;

        const QImage image(cloneFrame.bits(),
            cloneFrame.width(),
            cloneFrame.height(),
            QVideoFrame::imageFormatFromPixelFormat(cloneFrame.pixelFormat()));

        QByteArray ba;
        QBuffer bu(&ba);
        bu.open(QBuffer::ReadWrite);
        //bu.open(QIODevice::WriteOnly);
        image.save(&bu, "PNG");
        //bu.close();
        //QString imgBase64 = ba.toBase64();
        QString imgBase64 = QString::fromLatin1(ba.toBase64().data());
        qDebug() << "image base64: " << imgBase64;

        cloneFrame.unmap();
    }
}

[Bonnie]

@zabitqt Oh, you can't convert it to QImage like this, as your debug info shows, the frame data you get from the camera is in YUV format, which QImage doesn't support.
If you want to get a QImage, just call frame.image(), you don't even need to clone, map and unmap...

[zabitqt]

@Bonnie said in from QCamera or QVideoWidget get video bytes:

frame.image()

It doesn't exist method frame.image(). OK I have understand that the problem is QImage that not support Format_YUYV. I search a solution in google. Thank you so much!

[Bonnie]

@zabitqt This function exists since qt5.15 :), in which Qt has done the YUV to RGB conversion internally.
(Also have checked that in Qt6 it should be toImage() )