Issue with Virtual Channel Extension: Video

[mvogt1]

I'm using RedHat el 9.2, and build the kernel module according to Install V4L2 loopback driver and build with the Real-Time-Audio extension .

I modified /etc/vmware/config to:

RTAV.logLevel=trace
VVC.RTAV.WebcamMaxFrameRate=15
VVC.RTAV.WebcamMaxResWidth=1920
VVC.RTAV.WebcamMaxResHeight=1080
VVC.RTAV.WebcamDefaultResWidth=1280
VVC.RTAV.WebcamDefaultResHeight=720

In the log file /tmp/vmware-vmwblast/vmware-RTAV-XYZ.log:

RTAV: virtual void FFmpegDecoder::GetConfiguration() - forceQSV: 0, forceNV: 1, threads: 1 HostCPUs: 4 mThreadCounts: 1
RTAV: static DWORD ConfigSettings::GetDWORD(std::string, DWORD) - key='rtav.h264_loglevel' default=8
RTAV: virtual bool FFmpegDecoder::InitFFmpegDecoder(): enable Nvidia hardware acceleration decoder

In(05) host-21552 RTAV: OnRecvData - Recv - DataLen=11779  QLen=0
In(05) host-23689 RTAV: Decode: mDecParams (wxh) = (1280,720)
In(05) host-23689 RTAV: Decode: mFrame (wxh) = (1280,720), format = 98
In(05) host-23689 RTAV: Decode: mFrame->linesize(0,1,2) = (0,0,0)
In(05) host-23688 RTAV: static bool MediaPlayerLinux::VdoServiceThreadCB(void*, VMWThread*) - Play Video: New data arrival notification received
In(05) host-23688 RTAV: SendImgData: Write data 1843200

Thus it works, 11779 bytes h264 video frame come in and gets decoded in HW to 1843200 bytes (YUV,RGB who knows), But this does only work with google-chrome.

• It does not work with firefox

Firefox and Google share the same webrtc implementation, the one from google https://webrtc.googlesource.com/src/ and of course firefox works in these scenarios

• local webcam with firefox
• Virtual Channel webcam windows_client -> windows_agent

The Virtual Channel webcam windows_client -> linux_agent does not work.

==> Therefore I suspect the kernel loopback interface does not support everything which firefox calls.

Anyone have tried to enable ioctl debugging or have a patch?

[songkai]

Hi  mvogt1
I'm sorry for the trouble of webcom redirection. I test the https://webcammictest.com in firefox with the same config of webcam redirection on rhel 9. It work well on my local. my firefox version is as following:

[vmware@ksong-rhel9 ~]$ firefox --version
Mozilla Firefox 91.8.0esr

Could you share which websit use to test remote webcam on firefox? Which version of firefox do you use? Is there any error message when you try the webcam on firefox? Could you help to open an bug for this problem and update your linux desktop logs? You can collect the linux desktop log via execute "/usr/lib/vmware/viewagent/bin/dct-debug.sh". Thank you very much!

Best Regards
Kai

[mvogt1]

The isue is gone. I had this when RealTime Audio was not setup correctly.

Chrome worked (withouth audio of course, but with video) and firefox did not show any video, which was possible a side effect of the non working audio channel.

Thus, as soon as realtime audio was setup and worked, firefox worked too (video and audio)