topic Re: Issue with Virtual Channel Extension: Video in Horizon for Linux

Issue with Virtual Channel Extension: Video

mvogt1 — Thu, 26 Oct 2023 10:26:43 GMT

I'm using RedHat el 9.2, and build the kernel module according to Install V4L2 loopback driver and build with the Real-Time-Audio extension .

I modified /etc/vmware/config to:

RTAV.logLevel=trace VVC.RTAV.WebcamMaxFrameRate=15 VVC.RTAV.WebcamMaxResWidth=1920 VVC.RTAV.WebcamMaxResHeight=1080 VVC.RTAV.WebcamDefaultResWidth=1280 VVC.RTAV.WebcamDefaultResHeight=720

In the log file /tmp/vmware-vmwblast/vmware-RTAV-XYZ.log:

RTAV: virtual void FFmpegDecoder::GetConfiguration() - forceQSV: 0, forceNV: 1, threads: 1 HostCPUs: 4 mThreadCounts: 1 RTAV: static DWORD ConfigSettings::GetDWORD(std::string, DWORD) - key='rtav.h264_loglevel' default=8 RTAV: virtual bool FFmpegDecoder::InitFFmpegDecoder(): enable Nvidia hardware acceleration decoder In(05) host-21552 RTAV: OnRecvData - Recv - DataLen=11779 QLen=0 In(05) host-23689 RTAV: Decode: mDecParams (wxh) = (1280,720) In(05) host-23689 RTAV: Decode: mFrame (wxh) = (1280,720), format = 98 In(05) host-23689 RTAV: Decode: mFrame->linesize(0,1,2) = (0,0,0) In(05) host-23688 RTAV: static bool MediaPlayerLinux::VdoServiceThreadCB(void*, VMWThread*) - Play Video: New data arrival notification received In(05) host-23688 RTAV: SendImgData: Write data 1843200

Thus it works, 11779 bytes h264 video frame come in and gets decoded in HW to 1843200 bytes (YUV,RGB who knows), But this does only work with google-chrome.

It does not work with firefox

Firefox and Google share the same webrtc implementation, the one from google https://webrtc.googlesource.com/src/ and of course firefox works in these scenarios

local webcam with firefox
Virtual Channel webcam windows_client -> windows_agent

The Virtual Channel webcam windows_client -> linux_agent does not work.

==> Therefore I suspect the kernel loopback interface does not support everything which firefox calls.

Anyone have tried to enable ioctl debugging or have a patch?

Re: Issue with Virtual Channel Extension: Video

songkai — Fri, 03 Nov 2023 05:43:17 GMT

Hi mvogt1
I'm sorry for the trouble of webcom redirection. I test the https://webcammictest.com in firefox with the same config of webcam redirection on rhel 9. It work well on my local. my firefox version is as following:

[vmware@ksong-rhel9 ~]$ firefox --version
Mozilla Firefox 91.8.0esr

Could you share which websit use to test remote webcam on firefox? Which version of firefox do you use? Is there any error message when you try the webcam on firefox? Could you help to open an bug for this problem and update your linux desktop logs? You can collect the linux desktop log via execute "/usr/lib/vmware/viewagent/bin/dct-debug.sh". Thank you very much!

Best Regards
Kai

Re: Issue with Virtual Channel Extension: Video

mvogt1 — Mon, 06 Nov 2023 09:18:10 GMT

The isue is gone. I had this when RealTime Audio was not setup correctly.

Chrome worked (withouth audio of course, but with video) and firefox did not show any video, which was possible a side effect of the non working audio channel.

Thus, as soon as realtime audio was setup and worked, firefox worked too (video and audio)