Yes you can do without vCenter but not without a View Connection Server.
You need to install the agent with the option: /v"VDM_INSTALLER_CHECKS=0" and then point to the View Connection Broker when it asks.
Thanks for replying. I installed the agent with that option and manually created a pool but I'm not able to use the View Composer features. Am I doing something wrong or will I need a vCenter server to use the View Composer?
If you want to actively manage virtual machines with View then you need vCenter. You can set up individual unmanaged agents without it but they are treated in the same way as physical machines. I'd recommend reading through the architecture guide: http://pubs.vmware.com/view-51/topic/com.vmware.view.planning.doc/GUID-5CC0B95F-7B92-4C60-A2F2-B932F...