Thanks DEMdev, highly appreciate your help. We were planning to role DEM + FSLogix to production, so anything which will help us resolve this will be highly appreciated. We have a few users using this as a pilot project and they are facing this problem.
I tested this on Windows 10 1909 and 2004, floating desktops (non-persistent) and with FSLogix disabled, but the issue still persists.