QML video playback

RiteshPanchal

@raven-worx
I am using in debug mode without any debugger.
I tried build in release but no improvement.

raven-worx

@RiteshPanchal
then i guess its most probably indeed the missing HW acceleration. What backend do you use?

RiteshPanchal

I thinks its some problem with gstreamer-1.0 and qt.
Because i can't play any video using Qt Multimedia example like qmlvideo, videowidget etc..

I can play video with external 3rd party player and also with gstreamer pipeline separately.
So whats missing now?

raven-worx

@RiteshPanchal
you can try to set the QT_DEBUG_PLUGINS env variable to a non-zero value and check the console output. Maybe it tells something regarding the multimedia plugins.

RiteshPanchal

@raven-worx said in QML video playback:

you

nVidia TX1 supports OMX HW acceleration which support 4K encoding and decoding. I can play 4K video using gstreamer pipeline.

And also i have added env variable QT_DEBUG_PLUGINS to 1 in Release build . and here is application output

Starting /home/ubuntu/Desktop/build-Test-Desktop-Release/Test...
QFactoryLoader::QFactoryLoader() checking directory path "/usr/local/plugins/platforms" ...
QFactoryLoader::QFactoryLoader() looking at "/usr/local/plugins/platforms/libqeglfs.so"
Found metadata in lib /usr/local/plugins/platforms/libqeglfs.so, metadata=
{
    "IID": "org.qt-project.Qt.QPA.QPlatformIntegrationFactoryInterface.5.3",
    "MetaData": {
        "Keys": [
            "eglfs"
        ]
    },
    "className": "QEglFSIntegrationPlugin",
    "debug": false,
    "version": 329728
}


Got keys from plugin meta data ("eglfs")
QFactoryLoader::QFactoryLoader() looking at "/usr/local/plugins/platforms/libqlinuxfb.so"
Found metadata in lib /usr/local/plugins/platforms/libqlinuxfb.so, metadata=
{
    "IID": "org.qt-project.Qt.QPA.QPlatformIntegrationFactoryInterface.5.3",
    "MetaData": {
        "Keys": [
            "linuxfb"
        ]
    },
    "className": "QLinuxFbIntegrationPlugin",
    "debug": false,
    "version": 329728
}


Got keys from plugin meta data ("linuxfb")
QFactoryLoader::QFactoryLoader() looking at "/usr/local/plugins/platforms/libqminimal.so"
Found metadata in lib /usr/local/plugins/platforms/libqminimal.so, metadata=
{
    "IID": "org.qt-project.Qt.QPA.QPlatformIntegrationFactoryInterface.5.3",
    "MetaData": {
        "Keys": [
            "minimal"
        ]
    },
    "className": "QMinimalIntegrationPlugin",
    "debug": false,
    "version": 329728
}


Got keys from plugin meta data ("minimal")
QFactoryLoader::QFactoryLoader() looking at "/usr/local/plugins/platforms/libqminimalegl.so"
Found metadata in lib /usr/local/plugins/platforms/libqminimalegl.so, metadata=
{
    "IID": "org.qt-project.Qt.QPA.QPlatformIntegrationFactoryInterface.5.3",
    "MetaData": {
        "Keys": [
            "minimalegl"
        ]
    },
    "className": "QMinimalEglIntegrationPlugin",
    "debug": false,
    "version": 329728
}


Got keys from plugin meta data ("minimalegl")
QFactoryLoader::QFactoryLoader() looking at "/usr/local/plugins/platforms/libqoffscreen.so"
Found metadata in lib /usr/local/plugins/platforms/libqoffscreen.so, metadata=
{
    "IID": "org.qt-project.Qt.QPA.QPlatformIntegrationFactoryInterface.5.3",
    "MetaData": {
        "Keys": [
            "offscreen"
        ]
    },
    "className": "QOffscreenIntegrationPlugin",
    "debug": false,
    "version": 329728
}


Got keys from plugin meta data ("offscreen")
QFactoryLoader::QFactoryLoader() looking at "/usr/local/plugins/platforms/libqvnc.so"
Found metadata in lib /usr/local/plugins/platforms/libqvnc.so, metadata=
{
    "IID": "org.qt-project.Qt.QPA.QPlatformIntegrationFactoryInterface.5.3",
    "MetaData": {
        "Keys": [
            "vnc"
        ]
    },
    "className": "QVncIntegrationPlugin",
    "debug": false,
    "version": 329728
}


Got keys from plugin meta data ("vnc")
QFactoryLoader::QFactoryLoader() looking at "/usr/local/plugins/platforms/libqxcb.so"
Found metadata in lib /usr/local/plugins/platforms/libqxcb.so, metadata=
{
    "IID": "org.qt-project.Qt.QPA.QPlatformIntegrationFactoryInterface.5.3",
    "MetaData": {
        "Keys": [
            "xcb"
        ]
    },
    "className": "QXcbIntegrationPlugin",
    "debug": false,
    "version": 329728
}


Got keys from plugin meta data ("xcb")
QFactoryLoader::QFactoryLoader() checking directory path "/home/ubuntu/Desktop/build-Test-Desktop-Release/platforms" ...
loaded library "/usr/local/plugins/platforms/libqxcb.so"
loaded library "Xcursor"
QFactoryLoader::QFactoryLoader() checking directory path "/usr/local/plugins/xcbglintegrations" ...
QFactoryLoader::QFactoryLoader() looking at "/usr/local/plugins/xcbglintegrations/libqxcb-egl-integration.so"
Found metadata in lib /usr/local/plugins/xcbglintegrations/libqxcb-egl-integration.so, metadata=
{
    "IID": "org.qt-project.Qt.QPA.Xcb.QXcbGlIntegrationFactoryInterface.5.5",
    "MetaData": {
        "Keys": [
            "xcb_egl"
        ]
    },
    "className": "QXcbEglIntegrationPlugin",
    "debug": false,
    "version": 329728
}


Got keys from plugin meta data ("xcb_egl")
QFactoryLoader::QFactoryLoader() looking at "/usr/local/plugins/xcbglintegrations/libqxcb-glx-integration.so"
Found metadata in lib /usr/local/plugins/xcbglintegrations/libqxcb-glx-integration.so, metadata=
{
    "IID": "org.qt-project.Qt.QPA.Xcb.QXcbGlIntegrationFactoryInterface.5.5",
    "MetaData": {
        "Keys": [
            "xcb_glx"
        ]
    },
    "className": "QXcbGlxIntegrationPlugin",
    "debug": false,
    "version": 329728
}


Got keys from plugin meta data ("xcb_glx")
QFactoryLoader::QFactoryLoader() checking directory path "/home/ubuntu/Desktop/build-Test-Desktop-Release/xcbglintegrations" ...
loaded library "/usr/local/plugins/xcbglintegrations/libqxcb-glx-integration.so"
QFactoryLoader::QFactoryLoader() checking directory path "/usr/local/plugins/platformthemes" ...
QFactoryLoader::QFactoryLoader() looking at "/usr/local/plugins/platformthemes/libqgtk3.so"
Found metadata in lib /usr/local/plugins/platformthemes/libqgtk3.so, metadata=
{
    "IID": "org.qt-project.Qt.QPA.QPlatformThemeFactoryInterface.5.1",
    "MetaData": {
        "Keys": [
            "gtk3"
        ]
    },
    "className": "QGtk3ThemePlugin",
    "debug": false,
    "version": 329728
}


Got keys from plugin meta data ("gtk3")
QFactoryLoader::QFactoryLoader() checking directory path "/home/ubuntu/Desktop/build-Test-Desktop-Release/platformthemes" ...
QFactoryLoader::QFactoryLoader() checking directory path "/usr/local/plugins/platforminputcontexts" ...
QFactoryLoader::QFactoryLoader() looking at "/usr/local/plugins/platforminputcontexts/libcomposeplatforminputcontextplugin.so"
Found metadata in lib /usr/local/plugins/platforminputcontexts/libcomposeplatforminputcontextplugin.so, metadata=
{
    "IID": "org.qt-project.Qt.QPlatformInputContextFactoryInterface.5.1",
    "MetaData": {
        "Keys": [
            "compose",
            "xim"
        ]
    },
    "className": "QComposePlatformInputContextPlugin",
    "debug": false,
    "version": 329728
}


Got keys from plugin meta data ("compose", "xim")
QFactoryLoader::QFactoryLoader() looking at "/usr/local/plugins/platforminputcontexts/libibusplatforminputcontextplugin.so"
Found metadata in lib /usr/local/plugins/platforminputcontexts/libibusplatforminputcontextplugin.so, metadata=
{
    "IID": "org.qt-project.Qt.QPlatformInputContextFactoryInterface.5.1",
    "MetaData": {
        "Keys": [
            "ibus"
        ]
    },
    "className": "QIbusPlatformInputContextPlugin",
    "debug": false,
    "version": 329728
}


Got keys from plugin meta data ("ibus")
QFactoryLoader::QFactoryLoader() looking at "/usr/local/plugins/platforminputcontexts/libqtvirtualkeyboardplugin.so"
Found metadata in lib /usr/local/plugins/platforminputcontexts/libqtvirtualkeyboardplugin.so, metadata=
{
    "IID": "org.qt-project.Qt.QPlatformInputContextFactoryInterface.5.1",
    "MetaData": {
        "Keys": [
            "qtvirtualkeyboard"
        ]
    },
    "className": "QVirtualKeyboardPlugin",
    "debug": false,
    "version": 329728
}


Got keys from plugin meta data ("qtvirtualkeyboard")
QFactoryLoader::QFactoryLoader() checking directory path "/home/ubuntu/Desktop/build-Test-Desktop-Release/platforminputcontexts" ...
loaded library "/usr/local/plugins/platforminputcontexts/libcomposeplatforminputcontextplugin.so"
Found metadata in lib /usr/local/qml/QtQuick.2/libqtquick2plugin.so, metadata=
{
    "IID": "org.qt-project.Qt.QQmlExtensionInterface/1.0",
    "MetaData": {
    },
    "className": "QtQuick2Plugin",
    "debug": false,
    "uri": [
        "QtQuick.2"
    ],
    "version": 329728
}


loaded library "/usr/local/qml/QtQuick.2/libqtquick2plugin.so"
Found metadata in lib /usr/local/qml/QtMultimedia/libdeclarative_multimedia.so, metadata=
{
    "IID": "org.qt-project.Qt.QQmlExtensionInterface/1.0",
    "MetaData": {
    },
    "className": "QMultimediaDeclarativeModule",
    "debug": false,
    "uri": [
        "QtMultimedia"
    ],
    "version": 329728
}


loaded library "/usr/local/qml/QtMultimedia/libdeclarative_multimedia.so"
QFactoryLoader::QFactoryLoader() checking directory path "/usr/local/plugins/mediaservice" ...
QFactoryLoader::QFactoryLoader() looking at "/usr/local/plugins/mediaservice/libgstaudiodecoder.so"
Found metadata in lib /usr/local/plugins/mediaservice/libgstaudiodecoder.so, metadata=
{
    "IID": "org.qt-project.qt.mediaserviceproviderfactory/5.0",
    "MetaData": {
        "Keys": [
            "gstreameraudiodecode"
        ],
        "Services": [
            "org.qt-project.qt.audiodecode"
        ]
    },
    "className": "QGstreamerAudioDecoderServicePlugin",
    "debug": false,
    "version": 329728
}


Got keys from plugin meta data ("gstreameraudiodecode")
QFactoryLoader::QFactoryLoader() looking at "/usr/local/plugins/mediaservice/libgstcamerabin.so"
Found metadata in lib /usr/local/plugins/mediaservice/libgstcamerabin.so, metadata=
{
    "IID": "org.qt-project.qt.mediaserviceproviderfactory/5.0",
    "MetaData": {
        "Keys": [
            "gstreamercamerabin"
        ],
        "Services": [
            "org.qt-project.qt.camera"
        ]
    },
    "className": "CameraBinServicePlugin",
    "debug": false,
    "version": 329728
}


Got keys from plugin meta data ("gstreamercamerabin")
QFactoryLoader::QFactoryLoader() looking at "/usr/local/plugins/mediaservice/libgstmediacapture.so"
Found metadata in lib /usr/local/plugins/mediaservice/libgstmediacapture.so, metadata=
{
    "IID": "org.qt-project.qt.mediaserviceproviderfactory/5.0",
    "MetaData": {
        "Keys": [
            "gstreamermediacapture"
        ],
        "Services": [
            "org.qt-project.qt.audiosource"
        ]
    },
    "className": "QGstreamerCaptureServicePlugin",
    "debug": false,
    "version": 329728
}


Got keys from plugin meta data ("gstreamermediacapture")
QFactoryLoader::QFactoryLoader() looking at "/usr/local/plugins/mediaservice/libgstmediaplayer.so"
Found metadata in lib /usr/local/plugins/mediaservice/libgstmediaplayer.so, metadata=
{
    "IID": "org.qt-project.qt.mediaserviceproviderfactory/5.0",
    "MetaData": {
        "Keys": [
            "gstreamermediaplayer"
        ],
        "Services": [
            "org.qt-project.qt.mediaplayer"
        ]
    },
    "className": "QGstreamerPlayerServicePlugin",
    "debug": false,
    "version": 329728
}


Got keys from plugin meta data ("gstreamermediaplayer")
QFactoryLoader::QFactoryLoader() checking directory path "/home/ubuntu/Desktop/build-Test-Desktop-Release/mediaservice" ...
loaded library "/usr/local/plugins/mediaservice/libgstmediaplayer.so"
QFactoryLoader::QFactoryLoader() checking directory path "/usr/local/plugins/resourcepolicy" ...
QFactoryLoader::QFactoryLoader() checking directory path "/home/ubuntu/Desktop/build-Test-Desktop-Release/resourcepolicy" ...
QFactoryLoader::QFactoryLoader() checking directory path "/usr/local/plugins/video/declarativevideobackend" ...
QFactoryLoader::QFactoryLoader() checking directory path "/home/ubuntu/Desktop/build-Test-Desktop-Release/video/declarativevideobackend" ...
QFactoryLoader::QFactoryLoader() checking directory path "/usr/local/plugins/video/videonode" ...
QFactoryLoader::QFactoryLoader() checking directory path "/home/ubuntu/Desktop/build-Test-Desktop-Release/video/videonode" ...
QFactoryLoader::QFactoryLoader() checking directory path "/usr/local/plugins/video/gstvideorenderer" ...
QFactoryLoader::QFactoryLoader() checking directory path "/home/ubuntu/Desktop/build-Test-Desktop-Release/video/gstvideorenderer" ...
QFactoryLoader::QFactoryLoader() checking directory path "/usr/local/plugins/accessiblebridge" ...
QFactoryLoader::QFactoryLoader() checking directory path "/home/ubuntu/Desktop/build-Test-Desktop-Release/accessiblebridge" ...
Inside NvxLiteH264DecoderLowLatencyInitNvxLiteH264DecoderLowLatencyInit set DPB and MjstreamingInside NvxLiteH265DecoderLowLatencyInitNvxLiteH265DecoderLowLatencyInit set DPB and MjstreamingNvMMLiteOpen : Block : BlockType = 261 
TVMR: NvMMLiteTVMRDecBlockOpen: 6736: NvMMLiteBlockOpen 
NvMMLiteBlockCreate : Block : BlockType = 261 
TVMR: cbBeginSequence: 803: BeginSequence  1920x1088, bVPR = 0
TVMR: cbBeginSequence: 1147: DecodeBuffers = 4, pnvsi->eCodec = 4, codec = 0 
TVMR: cbBeginSequence: 1206: Display Resolution : (1920x1080) 
TVMR: cbBeginSequence: 1207: Display Aspect Ratio : (1920x1080) 
TVMR: cbBeginSequence: 1247: ColorFormat : 5 
TVMR: cbBeginSequence:1258 ColorSpace = NvColorSpace_YCbCr709
TVMR: cbBeginSequence: 1429: SurfaceLayout = 3
TVMR: cbBeginSequence: 1474: NumOfSurfaces = 8, InteraceStream = 0, InterlaceEnabled = 0, bSecure = 0, MVC = 0 Semiplanar = 1, bReinit = 1, BitDepthForSurface = 8
Allocating new output: 1920x1088 (x 10), ThumbnailMode = 0
QFactoryLoader::QFactoryLoader() checking directory path "/usr/local/plugins/accessible" ...
QFactoryLoader::QFactoryLoader() checking directory path "/home/ubuntu/Desktop/build-Test-Desktop-Release/accessible" ...
TVMR: cbDisplayPicture: 3289: Retunred NULL Frame Buffer 
TVMR: FrameRate = 29 
TVMR: NVDEC LowCorner Freq = (174000 * 1024) 
TVMR: FrameRate = 29.970180 
TVMR: FrameRate = 29.970090 
Warning: "A lot of buffers are being dropped."

raven-worx

@RiteshPanchal
hmm...the plugin log looks good.

But this line looks suspicious:
TVMR: cbDisplayPicture: 3289: Retunred NULL Frame Buffer

I am not a linux guru, so i am not much of a help here from now on :/

RiteshPanchal

@raven-worx said in QML video playback:

I am not a linux guru, so i am not much of a help here from now on :/

Ya its ok.. But thanks for your great help.

peteritv

@RiteshPanchal

I am no guru either, but it looks to me that your linux setup is using the default framebuffer video driver (linuxfb in your case, which is a software driver) instead of the hardware accelerated NVidea driver.

I assume that is not true, and you can play the video with a standard player at full HD resolution (1920x1080 30fps)?

RiteshPanchal

@peteritv said in QML video playback:

you can play the video with a standard player at full HD resolution (1920x1080 30fps)?

After Fresh flashing ubuntu 14.04 to nVidia TX1. I can't play 1080p .mp4 video using totem player (ubuntu default video player). But after installing some missing codec using below command i can play those video smoothly.

sudo apt-get install ubuntu-restricted-extras

I can also play even 4K@30fps video using gstreamer pipeline using OMX HW acceleration.
But still i am not able to play any .mp4 videos using VLC player on TX1. I am getting Black screen while playing the video.

I think still some codec are missing that's causing this issue to vlc and also to Qt.
I searched on net says ffmpeg is missing so i downloaded the source and compiled the latest version to TX1 but still Black video output to VLC and also TVMR: cbDisplayPicture: 3289: Retunred NULL Frame Buffer in Qt.

So waiting for some reply from TX1.

peteritv

@RiteshPanchal

Mmmm... Still sounds like a driver problem to me (which is not unusual for any Linux with NVidea). Does sound work when you try to play?

Could you post your /etc/X11/xorg.conf file (X configuration) ?
And what does the X log (errors "EE" and warnings "WW") show ?

grep "EE\|WW" /var/log/Xorg.0.log

Looks like a nice device btw, that TX1 :)

RiteshPanchal

@peteritv said in QML video playback:

Does sound work when you try to play?

Yes. Sound works when i play .mp4 video with vlc.

etc/X11/xorg.conf

# Copyright (c) 2015, NVIDIA CORPORATION.  All Rights Reserved.
#
# This is the minimal configuration necessary to use the Tegra driver.
# Please refer to the xorg.conf man page for more configuration
# options provided by the X server, including display-related options
# provided by RandR 1.2 and higher.

# Disable extensions not useful on Tegra.
Section "Module"
    Disable     "dri"
    SubSection  "extmod"
    Option  "omit xfree86-dga"
    EndSubSection
EndSection

Section "Device"
    Identifier  "Tegra0"
    Driver      "nvidia"
    Option      "AllowEmptyInitialConfiguration" "true"
EndSection

Section "Monitor"
   Identifier "DSI-0"
   Option    "Ignore"
EndSection

grep "EE|WW" /var/log/Xorg.0.log

[    13.176] Current Operating System: Linux tegra-ubuntu 3.10.67 #46 SMP PREEMPT Tue Sep 13 14:54:38 IST 2016 aarch64
	(WW) warning, (EE) error, (NI) not implemented, (??) unknown.
[    13.189] (WW) The directory "/usr/share/fonts/X11/cyrillic" does not exist.
[    13.189] (WW) The directory "/usr/share/fonts/X11/100dpi/" does not exist.
[    13.189] (WW) The directory "/usr/share/fonts/X11/75dpi/" does not exist.
[    13.189] (WW) The directory "/usr/share/fonts/X11/100dpi" does not exist.
[    13.189] (WW) The directory "/usr/share/fonts/X11/75dpi" does not exist.
[    13.191] Initializing built-in extension MIT-SCREEN-SAVER
[    13.191] (WW) "dri" will not be loaded unless you've specified it to be loaded elsewhere.
[    13.191] (WW) "xmir" is not to be loaded by default. Skipping.
[    13.349] (WW) Falling back to old probe method for NVIDIA
[    13.411] (EE) NVIDIA(GPU-0): Failed to initialize client
[    13.520] (WW) NVIDIA(GPU-0): Failed to enter interactive mode. 
[    13.528] (EE) NVIDIA(0): Failed to allocate NVIDIA Error Handler
[    14.092] (EE) NVIDIA(0): Failed to allocate NVIDIA Damage Manager

peteritv

@RiteshPanchal
As expected (by me, not by you) it seems that your driver does not play well with Linux.

What you could try, is to completely remove the NVidia driver from your device. That way, when the system boots up again, it will fall back to the native "nuveau" software driver, which is slower of course, but usually works!

See:
http://askubuntu.com/questions/206283/how-can-i-uninstall-a-nvidia-driver-completely

peteritv

NVidia has a very sad history of supporting Linux...

With ur TX1, I would have voted they would have gotten it right,
TX1 is a NVidia thing, right?
Ur development kit comes from NVidia, right?

peteritv

May I assume that Ubuntu is not the native OS that TX1 supplies?

peteritv

What native OS does the TX1 come with?

peteritv

Out of the Box?

peteritv

I am not just a fool answering here...
I have had 30+ years experience on embedded software and devices.

peteritv

And I can tell you: NVidia sucks