Found the issue - DelayVirtualizationType registry key for App Volumes had not been set on the golden image, as per the last line of Install App Volumes Agent

Subsequently App Volumes was not fully mounting the applications on startup which meant that Horizon couldn't find them.

*face-palm*