You will require Horizon Advanced license at a minimum to use the VMware Published App feature.
The following links may be helpful.
I have this same question. I was able to use IE to launch File Explorer in Horizon, but I've read Microsoft does not recommend publishing File Explorer. So I'm not sure if implementing this is going to cause headaches down the road.