13 Replies Latest reply on Jun 19, 2020 4:56 AM by ijdemes

    DEM taking 20 minute to log off

    AdiNugraha Novice

      Hello,

       

      I have 1 RDS Farm with 3 RDS host, there is one server that is taking consistently 20 minutes to log off because of DEM agent, while the other 2 rds server are logged off normally ( a minute or so), I've looked through the flexengin logs on debug mode and found nothing special, just that the export is taking around a minute each when logging off from the effected server, Windows application logs just shows a warning that VMware UEM is taking a long time to llog off, any suggestions on where to check for issues ?

        • 1. Re: DEM taking 20 minute to log off
          DEMdev Master
          VMware Employees

          Hi AdiNugraha,

           

          Would you mind moving your question to the Dynamic Environment Manager forum, to get some more DEM-specific eyes on it?

           

          In the meantime, what exactly do you mean by "the export is taking around a minute each when logging off from the effected server"? Can you share a "slow" and a "fast" FlexEngine log in DEBUG mode, covering the logoffs?

          • 2. Re: DEM taking 20 minute to log off
            AdiNugraha Novice

            Moved the post to DEM forum,

             

            Will try to get the logs and post it here later on, in general the logs when logging off from the effected server was running as usual, just like the logs from the other rds hosts, just that it takes longer (the export duration)

            • 3. Re: DEM taking 20 minute to log off
              DEMdev Master
              VMware Employees

              Hi AdiNugraha,

               

              Thank you for moving your post. Are there any obvious "gaps" in the log of those slow exports, indicating that specific actions are particularly slow?

              • 4. Re: DEM taking 20 minute to log off
                AdiNugraha Novice

                Hi,

                 

                not that I can tell, the only thing I notices was that exporting the WIndows settings was taking around 1 minute each starting from Internet explorer settings and IE Passwords, and this is only happened on that 1 rds host, the other two would log off normally within 1 minute

                • 5. Re: DEM taking 20 minute to log off
                  AdiNugraha Novice

                  the logs as mentioned before

                   

                  this server logs off in around 1 minute

                  FlexEngine.121.log

                   

                  While this server takes 20 minutes to log off

                   

                  FlexEngine.124.log

                  • 6. Re: DEM taking 20 minute to log off
                    DEMdev Master
                    VMware Employees

                    Hi AdiNugraha,

                     

                    Thank you for the logs. The following is an excerpt from the "slow" log, where I've calculated how much time is spent "between" two subsequent log lines, and prefixed the "slow" lines with time-since-previous-line-in-milliseconds:

                     

                            2020-06-09 19:56:39.331 [INFO ] Exporting profile using config file 'Calculator.INI' (<General>\Applications\Calculator.INI)
                            [...]
                            2020-06-09 19:56:39.340 [INFO ] Exported Registry information successfully
                      44120 2020-06-09 19:57:23.460 [DEBUG] No profile information exported -- not creating profile archive
                    
                            2020-06-09 19:57:23.634 [INFO ] Exporting profile using config file 'Default Applications.INI' (<General>\Windows Settings\Default Applications.INI)
                            [...]
                            2020-06-09 19:57:23.671 [INFO ] Exported default applications configuration
                      82268 2020-06-09 19:58:45.939 [DEBUG] Stored 2 entries in profile archive (size: 437280; compressed: 25727)
                    
                            2020-06-09 19:58:45.958 [INFO ] Exporting profile using config file 'IE Passwords.INI' (<General>\Windows Settings\IE Passwords.INI)
                            [...]
                            2020-06-09 19:58:45.978 [INFO ] Exported file information successfully
                     103456 2020-06-09 20:00:29.434 [DEBUG] Stored 13 entries in profile archive (size: 4935; compressed: 4350)
                    
                            2020-06-09 20:00:29.466 [INFO ] Exporting profile using config file 'Internet Explorer.INI' (<General>\Windows Settings\Internet Explorer.INI)
                            [...]
                            2020-06-09 20:00:29.528 [INFO ] Exported file information successfully
                     615309 2020-06-09 20:10:44.837 [DEBUG] Stored 156 entries in profile archive (size: 162816; compressed: 48252)
                    
                            2020-06-09 20:10:44.862 [INFO ] Exporting profile using config file 'Personal Certificates.INI' (<General>\Windows Settings\Personal Certificates.INI)
                            [...]
                            2020-06-09 20:10:44.889 [INFO ] Exported file information successfully
                     103483 2020-06-09 20:12:28.372 [DEBUG] Stored 29 entries in profile archive (size: 47645; compressed: 22258)
                    
                            2020-06-09 20:12:28.392 [INFO ] Exporting profile using config file 'Regedit.INI' (<General>\Windows Settings\Regedit.INI)
                            [...]
                            2020-06-09 20:12:28.401 [INFO ] Exported Registry information successfully
                      44842 2020-06-09 20:13:13.243 [DEBUG] No profile information exported -- not creating profile archive
                    
                            2020-06-09 20:13:13.273 [INFO ] Exporting profile using config file 'Screensaver.INI' (<General>\Windows Settings\Screensaver.INI)
                            [...]
                            2020-06-09 20:13:13.282 [INFO ] Exported Registry information successfully
                      67001 2020-06-09 20:14:20.283 [DEBUG] Stored 1 entry in profile archive (size: 3222; compressed: 401)
                    
                            2020-06-09 20:14:20.301 [INFO ] Exporting profile using config file 'Taskbar.INI' (<General>\Windows Settings\Taskbar.INI)
                            [...]
                            2020-06-09 20:14:20.333 [INFO ] Exported file information successfully
                      69519 2020-06-09 20:15:29.852 [DEBUG] Stored 44 entries in profile archive (size: 140394; compressed: 24087)
                    
                            2020-06-09 20:15:29.871 [INFO ] Exporting profile using config file 'Typed History.INI' (<General>\Windows Settings\Typed History.INI)
                            [...]
                            2020-06-09 20:15:29.878 [INFO ] Exported Registry information successfully
                      66836 2020-06-09 20:16:36.714 [DEBUG] Stored 1 entry in profile archive (size: 1484; compressed: 526)
                    
                            2020-06-09 20:16:36.732 [INFO ] Exporting profile using config file 'Wallpaper.INI' (<General>\Windows Settings\Wallpaper.INI)
                            [...]
                            2020-06-09 20:16:36.760 [INFO ] Exported file information successfully
                      72079 2020-06-09 20:17:48.839 [DEBUG] Stored 2 entries in profile archive (size: 66855; compressed: 54892)
                    
                            2020-06-09 20:17:48.859 [INFO ] Exporting profile using config file 'Windows Explorer.INI' (<General>\Windows Settings\Windows Explorer.INI)
                            [...]
                            2020-06-09 20:17:48.884 [INFO ] Exported Registry information successfully
                      67355 2020-06-09 20:18:56.239 [DEBUG] Stored 1 entry in profile archive (size: 246436; compressed: 25084)
                    

                     

                    These 44-second to 10-minute delays occur consistently whenever the DEM agent has completed collecting all registry and file system information into a temporary zip file in the user's profile archive folder.

                     

                    This strongly points to anti-virus interfering with our I/O. Could that be the case here?

                    1 person found this helpful
                    • 7. Re: DEM taking 20 minute to log off
                      AdiNugraha Novice

                      I'll check again, but the servers are installed with the same antivirus and configuration, any specific configuration recommended (exclusions etc) for the antivirus ? and the configuration is for the RDS host right ?

                      • 8. Re: DEM taking 20 minute to log off
                        DEMdev Master
                        VMware Employees

                        Hi AdiNugraha,

                         

                        For this particular delay, you might want to look into excluding FlexService.exe and/or the configured profile archive path.

                         

                        Given that this is on RDSH, it would be relatively straightforward to see what's going on using Microsoft Process Monitor. Start two sessions on the same host, one as a test user and one as admin. In the admin session, launch ProcMon, and then log off your test user. The ProcMon trace will hopefully provide some insight into what's taking so long during logoff.

                        1 person found this helpful
                        • 10. Re: DEM taking 20 minute to log off
                          AdiNugraha Novice

                          Hi ijdemes and DEM Dev,

                           

                          thank you for the info and insights, running process explorer shows a process (edpa.exe) that looks like it might be symantec dlp agent installed on the server with issue and consuming 100 MBps on read I/O, currently asking the team in charge of the DLP config to allow the antivirus exceptions ot see if it helps

                          • 11. Re: DEM taking 20 minute to log off
                            DEMdev Master
                            VMware Employees

                            Hi AdiNugraha,

                             

                            Just wanted to check in to see whether DLP was indeed the culprit here.

                            • 12. Re: DEM taking 20 minute to log off
                              AdiNugraha Novice

                              Hi DEMDev,

                               

                              yes, after uninstalling the dlp agent logout was normal, thank you for the insights and help

                              • 13. Re: DEM taking 20 minute to log off
                                ijdemes Expert
                                vExpert

                                Good to hear.

                                 

                                Credits go to DEMdev in this case. He led you to the AV/DLP interference.