VMware Cloud Community
tekhie
Contributor
Contributor

Setting up kernel mode debugging using virtual serial ports

i am trying to setup "kernel mode debugging" as requested by a software vendor. This involves setting up a named pipe between 2 VMs which talk via the serial port. We are attempting to use a "kernel mode debugger" application supplied by M$ one 1 VM to capture the output from the named pipe from another VM, both hosted on the same ESX host.

During an attempt to establish this, The app did not see any communication from the other VM.

I have seen some URLs pointing to "VMWare Workstation" usage but I need to establish this with Esxi3.5 / VCentre

Has anyone doen this before ? or have any good doc recommendations ?

0 Kudos
1 Reply
mark24
Enthusiast
Enthusiast

Connecting Two Virtual Machines

You can set up the virtual serial ports in two virtual machines to connect to each other. This is useful, for example, if you want to use an application in one virtual machine to capture debugging information sent from the other virtual machine's serial port.

To install a direct serial connection between two virtual machines (a server and a client), take the following steps:

Windows Host

In the server virtual machine

Open the Configuration Editor (Settings > Configuration Editor).

Click Add to start the Add Hardware Wizard.

Select Serial Port, then click Next.

Select Use named pipe.

Use the default pipe name, or enter another pipe name of your choice. The pipe name must follow the form
.\pipe\ - that is, it must begin with
.\pipe\.

Select This end is the server.

Select The other end is a virtual machine.

Click Finish, then click OK to close the Configuration Editor.

In the client virtual machine

Open the Configuration Editor (Settings > Configuration Editor).

Click Add to start the Add Hardware Wizard.

Select Serial Port, then click Next.

Select Use named pipe.

Use the default name, or enter another pipe name of your choice. The pipe name must follow the form
.\pipe\ - that is, it must begin with
.\pipe\. The pipe name must be the same on server and client.

Select This end is the client.

Select The other end is a virtual machine.

Click Finish, then click OK to close the Configuration Editor.

Best regards,

Mark Ramos VCP 3&4

If you find this or any other answer useful please consider awarding points by marking the answer correct or helpful

Best regards,
Mark Ramos VCP 3&4
0 Kudos