and as usual after asking the question I find the answer on my own
https://communities.vmware.com/message/1008552#1008552 It seems I need to apply the permissions on the top folder:
| my $host_view = Vim::find_entity_view( | ||
| view_type => 'Folder', | ||
| filter | => { 'name' => 'ha-folder-root' } | |
| ); |