VMware Cloud Community
nitinsahi
Enthusiast
Enthusiast
Jump to solution

VMKernel Architecture

Hi,

Can somebody help me in finding some good book exculsivly on VMKernel Architecture. I want a pdf file which has explained VMKernel Architecture

in as much detail as possible.

I am looking for some hardcore learning of VMKernel.

Nitin Sahi

nitinnitin50@gmail.com

0 Kudos
1 Solution

Accepted Solutions
esiebert7625
Immortal
Immortal
Jump to solution

Here's some super techy guides that might get you some of what you are looking for...

ESX Server 3 Ready Time Observations - http://www.vmware.com/pdf/esx3_ready_time.pdf

A Performance Comparison of Hypervisors - http://www.vmware.com/pdf/hypervisor_performance.pdf

ESX Server CPU Scheduling - http://www.vmware-tsx.com/download.php?asset_id=39

A Comparison of Software and Hardware Techniques for x86 Virtualization - http://www.vmware.com/pdf/asplos235_adams.pdf

Virtualization-optimized architectures - http://www.vmware-tsx.com/download.php?asset_id=33

ESX Server 2 Architecture and Performance Implications - http://www.vmware.com/pdf/esx2_performance_implications.pdf

ESX Server 2 Performance and Resource Management for CPU-Intesive Workloads - http://www.vmware.com/pdf/ESX2_CPU_Performance.pdf

Security Design of the Vmware Infrastructure 3 Architecture - http://www.vmware.com/pdf/vi3_security_architecture_wp.pdf

Fyi…if you find this post helpful, please award points using the Helpful/Correct buttons.

-=-=-=-=-=-=-=-=-=-=-==-=-=-=-=-=-=-=-=-=-=-=-

Thanks, Eric

Visit my website: http://vmware-land.com

-=-=-=-=-=-=-=-=-=-=-==-=-=-=-=-=-=-=-=-=-=-=-

View solution in original post

0 Kudos
10 Replies
Texiwill
Leadership
Leadership
Jump to solution

Hello,

The only such document I have heard of is entirely within VMware and not available to the public. The structure and design of the VMkernel is fairly well guarded.

Best regards,

Edward

--
Edward L. Haletky
vExpert XIV: 2009-2023,
VMTN Community Moderator
vSphere Upgrade Saga: https://www.astroarch.com/blogs
GitHub Repo: https://github.com/Texiwill
kix1979
Immortal
Immortal
Jump to solution

The only way to get this is to become a member of their community source program, where they share architecture and source code. However, this is generally reserved for companies that are going to code products to integrate with ESX.

Thomas H. Bryant III
nitinsahi
Enthusiast
Enthusiast
Jump to solution

Thanks for your help guyz.......

Wel, I am actually not looking for source however just the VMKernel working will do at the moment.

Is there any document with anyone which has maximum knowledge on VmKernel.

I searched whole google but didn't find any effective document but yeah they gave me help in stepping up....

Thanks

Nitin

0 Kudos
Texiwill
Leadership
Leadership
Jump to solution

Hello,

Please explain then by what you mean 'how it works'? What aspect are you concerned about?

Best regards,

Edward

--
Edward L. Haletky
vExpert XIV: 2009-2023,
VMTN Community Moderator
vSphere Upgrade Saga: https://www.astroarch.com/blogs
GitHub Repo: https://github.com/Texiwill
0 Kudos
nitinsahi
Enthusiast
Enthusiast
Jump to solution

Points for VMkernel.

=>Commnication with Service Console

=>Managing resource managment

=>Capability and Flexibility of Vmkernel

=>How it is derived.

=>Is append to vmkernel is possible?

=>Is there any tool to monitor vmkernel ?

VMware ESX Server uses a Linux kernel that loads additional code: often referred to by VMware, Inc. as the "vmkernel". The VMware FAQ states 'ESX Server also incorporates a service console based on a Linux 2.4 kernel that is used to boot the ESX Server virtualization layer'. The Linux kernel runs before any other software on an ESX host, witness the console of a booting ESX machine. No VMkernel processes run on the system during the boot process. After the Linux kernel has loaded, the S90vmware script loads the vmkernel. VMware states that vmkernel does not derive from Linux. The Linux kernel continues running but under vmkernel, providing functions including the proc file system used by the ESX and an environment to run support applications.

In traditional systems, a given operating system runs a single kernel. The VMware FAQ mentions that ESX has both a Linux 2.4 kernel and vmkernel — hence confusion over whether ESX has a Linux base. An ESX system starts a Linux kernel first, but it loads vmkernel (also described by VMware as a kernel), which wraps around the linux kernel, and according to VMware does not derive from Linux.

The ESX userspace environment, known as the "Service Console" (or as "COS" or as "vmnix"), derives from a modified version of Red Hat Linux, (Red Hat 7.2 for ESX 2.x and Red Hat Enterprise Linux for ESX 3.x). In general, this Service Console provides management interfaces (CLI, webpage MUI, Remote Console). This VMware ESX hypervisor virtualization approach provides lower overhead and better control and granularity for allocating resources (CPU-time, disk-bandwidth, network-bandwidth, memory-utilization) to virtual machines. It also increases security, thus positioning VMware ESX as an enterprise-grade product.

As a further detail which differentiates the ESX from other VMware virtualization products: ESX supports the VMware proprietary cluster file system VMFS. VMFS enables multiple hosts to access the same SAN LUNs simultaneously, while file-level locking provides simple protection to file-system integrity.

Thanks

Nitin

0 Kudos
esiebert7625
Immortal
Immortal
Jump to solution

Here's some super techy guides that might get you some of what you are looking for...

ESX Server 3 Ready Time Observations - http://www.vmware.com/pdf/esx3_ready_time.pdf

A Performance Comparison of Hypervisors - http://www.vmware.com/pdf/hypervisor_performance.pdf

ESX Server CPU Scheduling - http://www.vmware-tsx.com/download.php?asset_id=39

A Comparison of Software and Hardware Techniques for x86 Virtualization - http://www.vmware.com/pdf/asplos235_adams.pdf

Virtualization-optimized architectures - http://www.vmware-tsx.com/download.php?asset_id=33

ESX Server 2 Architecture and Performance Implications - http://www.vmware.com/pdf/esx2_performance_implications.pdf

ESX Server 2 Performance and Resource Management for CPU-Intesive Workloads - http://www.vmware.com/pdf/ESX2_CPU_Performance.pdf

Security Design of the Vmware Infrastructure 3 Architecture - http://www.vmware.com/pdf/vi3_security_architecture_wp.pdf

Fyi…if you find this post helpful, please award points using the Helpful/Correct buttons.

-=-=-=-=-=-=-=-=-=-=-==-=-=-=-=-=-=-=-=-=-=-=-

Thanks, Eric

Visit my website: http://vmware-land.com

-=-=-=-=-=-=-=-=-=-=-==-=-=-=-=-=-=-=-=-=-=-=-

0 Kudos
Texiwill
Leadership
Leadership
Jump to solution

Hello,

Point of correction.

The VMkernel is not a Linux kernel. It does not get loaded by the linux kernel.

The Vmkernel is loaded during the first stage boot loader for ESX v3. It in turn loads via the second stage loader the linux kernel as a Virtual Machine which loads some 'late' drivers into the vmkernel.

Communication between the SC and Vmkernel is handled via a proprietary and undocumented path. However, we do know that it uses the /proc directory to expose items to the SC that the vmkernel controls. I would assume the communication is via this same mechanism.

VMkernel is derived from years of research and development. It is not possible to append to the vmkernel but it is possible to write drivers for it if you are part of their program for that.

Vmkernel is monitored via esxtop, VIC, esxCharter, etc.

The pointers Eric has are very fine ones.

Best regards,

Edward

--
Edward L. Haletky
vExpert XIV: 2009-2023,
VMTN Community Moderator
vSphere Upgrade Saga: https://www.astroarch.com/blogs
GitHub Repo: https://github.com/Texiwill
0 Kudos
larstr
Champion
Champion
Jump to solution

I guess you found this erroneous info on wikipedia. Read the discussion there too. The info in wikipedia desperately needs to get updated. Also read chapter 2 in VMware ESX Server: ATDG[/url]

The source code of the modified linux kernel used by the service console can be found here: http://www.vmware.com/download/open_source.html

Good luck!

Lars

0 Kudos
Texiwill
Leadership
Leadership
Jump to solution

Hello,

The information in the wikipedia is about ESX v2....

In v2 the vmkernel was loaded by the SC.... This is reversed in v2... There is an upcoming book that goes into detail about this.

Best regards,

Edward

--
Edward L. Haletky
vExpert XIV: 2009-2023,
VMTN Community Moderator
vSphere Upgrade Saga: https://www.astroarch.com/blogs
GitHub Repo: https://github.com/Texiwill
0 Kudos
nitinsahi
Enthusiast
Enthusiast
Jump to solution

Thanks for your help guyzz ..... That really helped me in understanding it more.

Yeah I found that information from wikipedia. Anywyz I just want to make my base clear and strong.

Thank you all to support me in finding enough related material.

Nitin

Message was edited by:

nitinsahi

0 Kudos