Simple app to show webcam output via GStreamer pipeline

[JoeCFD]

@HanSooloo install gstreamer good plugin which has qml gl sink. Unluckily, there is not much doc for you to refer to.

[HanSooloo]

@JoeCFD I configured the GStreamer source using the meson configure -Dqt6=enabled builddir configuration option and built with regular ninja command, and finally installed via meson install.

I was able to confirm Qt6 support with the following:

$ gst-inspect-1.0 | grep qml
qml6:  qml6glmixer: Qt6 Video Mixer
qml6:  qml6gloverlay: Qt Video Overlay
qml6:  qml6glsink: Qt6 Video Sink
qml6:  qml6glsrc: Qt Video Source

After updating my pipeline as follows, I am still getting the black screen in the window. Any thoughts on where to go from here?

GST_PIPELINE = ('avfvideosrc device-index=1 ! '
                '"video/x-raw, width=1280, height=720, format=(string)YUY2, texture-target=rectangle" ! '
                'rawvideoparse width=1280 height=720 format=yuy2 ! '
                'queue ! '
                'autovideoconvert ! '
                'qml6glsink')

[JoeCFD]

@HanSooloo Does your pipeline run from command line? Wait, Qt6 may have removed support for running gstreamer pipeline in Qt. You may need to find it out. If my memory serves me right, Qt5 supports it. I do not use QMultimedia module for video display. Instead, I use raw gstreamer code to do it.

You can check this example out:
https://github.com/GStreamer/gst-plugins-good/tree/master/tests/examples/qt/qmlsink
BTW, QMultimedia module does not offer enough controls over video play.

[HanSooloo]

@JoeCFD said in Simple app to show webcam output via GStreamer pipeline:

@HanSooloo Does your pipeline run from command line? Wait, Qt6 may have removed support for running gstreamer pipeline in Qt. You may need to find it out. If my memory serves me right, Qt5 supports it. I do not use QMultimedia module for video display. Instead, I use raw gstreamer code to do it.

You can check this example out:
https://github.com/GStreamer/gst-plugins-good/tree/master/tests/examples/qt/qmlsink
BTW, QMultimedia module does not offer enough controls over video play.

The pipeline with autovideosink works on the command line. However, the one with qml6glsink doesn't work, since it is expecting a QGuiApplication context, e.g.,

(pipeline modified to a super simple video test pattern for brevity)

$ gst-launch-1.0 -v -e  videotestsrc ! autovideoconvert ! qml6glsink
Setting pipeline to PAUSED ...
ERROR: from element /GstPipeline:pipeline0/GstQml6GLSink:qml6glsink0: Failed to connect to Qt
Additional debug info:
../subprojects/gst-plugins-good/ext/qt6/gstqml6glsink.cc(353): gst_qml6_gl_sink_change_state (): /GstPipeline:pipeline0/GstQml6GLSink:qml6glsink0:
Could not retrieve QGuiApplication instance
ERROR: pipeline doesn't want to preroll.
Failed to set pipeline to PAUSED.
Setting pipeline to NULL ...
Freeing pipeline ...

[JoeCFD]

@HanSooloo you can not do it. From command line, gstreamer has nothing to do with Qt.
gst-launch-1.0 -v -e videotestsrc ! autovideoconvert ! autovideosink
qml6glsink is attached to a qt widget or qml item. Check the example out.

[HanSooloo]

@JoeCFD as you suggested, understand that Qt6 with GStreamer backend on macOS is not an option.

So, decided to switch back to Qt5 just to validate a basic GStreamer pipeline. Even with the below code that uses a simple video test source, I am still getting a black window content.

Any thoughts on where to go from here?

import sys

from PyQt5.QtWidgets import QApplication, QMainWindow, QPushButton, QWidget
from PyQt5.QtCore import QSize, Qt, QUrl
from PyQt5.QtMultimedia import QMediaPlayer, QMediaContent
from PyQt5.QtMultimediaWidgets import QVideoWidget

GST_PIPELINE = 'videotestsrc ! autovideoconvert ! autovideosink'


class MainWindow(QMainWindow):
  def __init__(self):
    super().__init__()
    self._player = QMediaPlayer()
    self._video_widget = QVideoWidget()
    self.setCentralWidget(self._video_widget)
    self._player.setVideoOutput(self._video_widget)

  def _play(self):
    self._player.setMedia(QMediaContent(QUrl(f'gst-pipeline: {GST_PIPELINE}')))
    self._player.play()


if __name__ == '__main__':
  app = QApplication(sys.argv)

  window = MainWindow()
  window.show()
  window._play()

  sys.exit(app.exec())

[JoeCFD]

@HanSooloo https://forum.qt.io/topic/141301/understanding-qt-documentation-about-using-qtmultimedia-with-lgpl-gstreamer-on-android/8

the sink is qtvideosink

[malikcis]

@HanSooloo said in Simple app to show webcam output via GStreamer pipeline:

qml6glsrc

Hi,
Any idea on how to use qml6glsrc?
Since QT6 Multimedia does not support gstreamer I don't know how qml6glsrc is supposed to work.

[JoeCFD]

@malikcis some made an example here.
https://forum.qt.io/topic/155422/parallel-pipelines-with-qml6glsink?_=1712071475549

[JoeCFD]

@JoeCFD gstreamer 1.24 build includes qml6glsink automatically if qt6 is installed in Ubuntu. No extra settings is needed in the build of gstreamer 1.24.