VMware Cloud Community
guy314567
Enthusiast
Enthusiast

out of resource issue DRS with resource pools

Hi

i have vcenter 6 environment with DRS enables and one big resource pool (about 900 vms) with 1 child small resource pool (about 50 vms)

lately machine gets "out of resource" errors. see attached

it seems that i have a lot of free memory on my esxi and i also gave a reservation to all resources to that big resource pool. see attached

am i missing something here?

Thanks in advanced.

0 Kudos
17 Replies
npadmani
Virtuoso
Virtuoso

please post screenshots of Resource Pool's resource allocation tab where your VMs are failing to power on, and VM's CPU/Memory reservation information. This will give us clear idea about if it's CPU or memory resource running short.

Please also include information about vSphere Flash Read Cache or NIOC 3.0 is being used in your environment or not.

Narendra Padmani VCIX6-DCV | VCIX7-CMA | VCI | TOGAF 9 Certified
0 Kudos
guy314567
Enthusiast
Enthusiast

i forgot to mention that i have about 20 esxi6 in the cluster

and i also receive randomly this message on them: see attached

0 Kudos
guy314567
Enthusiast
Enthusiast

here is screenshot of the resource pool allocation

0 Kudos
guy314567
Enthusiast
Enthusiast

sorry i dont know what is NIOC 3.0

how can i know if my environment is using it?

0 Kudos
npadmani
Virtuoso
Virtuoso

I can see huge amount of resource in terms of CPU and Memory is available in your resource pool from that screenshot you attached.


Network IO Control (NIOC 3.0) is an enhanced feature of Distributed Virtual Switch in vSphere 6 which is now capable to give us Per vNIC bandwidth reservation. and VM Admission control in terms of powering it on, might get affected if there are no enough network resources left.

Narendra Padmani VCIX6-DCV | VCIX7-CMA | VCI | TOGAF 9 Certified
0 Kudos
npadmani
Virtuoso
Virtuoso

regarding your out4.png warning message. Is that happening on multiple hosts at the same time or just one or two random hosts reporting this.

there's an official KB reporting similar issue

VMware KB: The Summary tab of the ESXi/ESX host reports the warning: Unable to apply DRS resource se...

where a line says, this warning message can safely be ignored.

Narendra Padmani VCIX6-DCV | VCIX7-CMA | VCI | TOGAF 9 Certified
0 Kudos
guy314567
Enthusiast
Enthusiast

i also deleted all child resource pools. now i have only one but still when i power on some vm machines i get an error: insufficient resources

how could this be?

0 Kudos
guy314567
Enthusiast
Enthusiast

i would gladly ignore it if i hasent suffer from "insufficient resources" error when powering on machines

0 Kudos
guy314567
Enthusiast
Enthusiast

it is happening on multiple hosts randomly each time a different one

0 Kudos
npadmani
Virtuoso
Virtuoso

Please remove that machine from inventory and register it again via browse datastore.

And then try to power on that VM.

Narendra Padmani VCIX6-DCV | VCIX7-CMA | VCI | TOGAF 9 Certified
0 Kudos
guy314567
Enthusiast
Enthusiast

thanks for your reply,

unfortunately i cannot do that as it is happening to many random machines it will take me forever, i have 1000 vm's on my environment

0 Kudos
npadmani
Virtuoso
Virtuoso

I am not offering that as Permanent solution, but just wanted to see if that work round solution works for you or not.

give it a go with at least one of the VMs where you are facing this issue.

is your DRS set on Fully Auto?

Narendra Padmani VCIX6-DCV | VCIX7-CMA | VCI | TOGAF 9 Certified
0 Kudos
guy314567
Enthusiast
Enthusiast

my DRS is set to "FULL AUTOMATED" and the bar is at the most conservative "apply only priority 1 recommendations"

0 Kudos
guy314567
Enthusiast
Enthusiast

see attached image

it is from the vpxd.log in vcenter... i guess it has something to do with my issue

0 Kudos
npadmani
Virtuoso
Virtuoso

Interpreting log entries is not always possible for us.

I would recommend raising a Support Request with vmware if you have active support subscription.

Narendra Padmani VCIX6-DCV | VCIX7-CMA | VCI | TOGAF 9 Certified
0 Kudos
vThinkBeyondVM
VMware Employee
VMware Employee

Did you happen to reduce memory reservation for any VM from vCenter?


----------------------------------------------------------------
Thanks & Regards
Vikas, VCP70, MCTS on AD, SCJP6.0, VCF, vSphere with Tanzu specialist.
https://vThinkBeyondVM.com/about
-----------------------------------------------------------------
Disclaimer: Any views or opinions expressed here are strictly my own. I am solely responsible for all content published here. Content published here is not read, reviewed or approved in advance by VMware and does not necessarily represent or reflect the views or opinions of VMware.

0 Kudos
vThinkBeyondVM
VMware Employee
VMware Employee

Hi guy314567 ,

Can you respond to my last response? That will help us to take this forward.


----------------------------------------------------------------
Thanks & Regards
Vikas, VCP70, MCTS on AD, SCJP6.0, VCF, vSphere with Tanzu specialist.
https://vThinkBeyondVM.com/about
-----------------------------------------------------------------
Disclaimer: Any views or opinions expressed here are strictly my own. I am solely responsible for all content published here. Content published here is not read, reviewed or approved in advance by VMware and does not necessarily represent or reflect the views or opinions of VMware.

0 Kudos