Hi Elliot,
Do the agent logs (located in agent-2.7.5/logs) on either of the unavailable machines show anything of use?
For clarification, when you setup an agent it contacts the server on port 7080 (or 7443 if you have ssl enabled), the server then responds back to the agent on port 2144, so you need to make sure both those communication channels are available.