Mellanox would have to provide them. Ask them if they have beta drivers.
The link below is for Ethernet. I'm looking for Infiniband support.
I spoke with Mellanox support who lets me know apparently, IB drivers for ESXi 5.0 hasn't been release yet.
Mellanox support will not release the beta version of their driver to me.
Thanks for the update Bobby
Just to let you know that mellanox has released IB Ofed drivers for vSphere Esxi 5.0 initiators.
Sadly, i cannot find my cards as storage adapters, only listed as Ethernet 10Gbit. Where is SRP??
1 person found this helpful
No they dont work!!! NO SRP only ISCSI
I tried them a few times. wasted better part of 2 days.
got the driver working, and 20Gb ports on Ethernet, added them to Vswitch and enabled ISCSI
2 links via 2 nic's @ 20Gb/s vmk3&4 port group policy is compliant. but no iscsi link. see jpg's
i could then ping my SAN via IPOIB. BUT! could not see the iscsi storage.
i then connected via a 1GB link, no issues, so all the config was correct.
I could see on the target san active iscsi connections, but not on IB ports.
- this works on esx4 U1 same config. no probs connecting via ISCSI cept the awful performance... 5Gb/s compared to SRP where i get 18GB/s yes that’s correct 1800MB/s SAN! VARROOOMMM problem is its unstable and A/A MPIO doesnt improve bandwidth. When i say Unstable i get SRP sessions connect, but when more than 3 nodes in a cluster, if i add 4th the SRP connection wants to reformat the Lun! WTF!
FYI QDR Connectx2 with latest F/W applied.
then i noticed each IB Nic the MTU was 1500 instead of 2044 (2044 is supposed to be the default according to the manual, it seems to be wrong, no surprise there!)
so i changed the MTU, and everything FROZE!
a reboot reveals it's stuck booting iscsi_vmk, Geee didn’t we see this with esx 4.1, continual attempts to log onto iscsi target! yes we did... yawn... ZZZ 10 mins later. guess what
still no iscsi connections.!!! YAY
Frankly Mellanox are doing a very, very poor job with supporting their IB Products. Unless you pay them
do we see that attitude with other Nic vendors,,,,... NO WE DONT! GRIPE!
if anyone in Mellanox wants IB to get market acceptance then they should support this crap!
Any more news on this front?
My company is going to make a large effort to leverage Infiniband in our future designs in an effort to further converge/decouple managment of legacy I/O devices.
We have a lab where we are building a POC, and are speaking to Mellanox today at 2:30.
I would welcome your input prior to this call.
Feel free to reply or message me if you want to discuss.
i can't even get the driver installed properly...
I just heard from Mellanox that current (1.8.0) driver for vsphere 5 does not support SRP. there are plans to support SRP in the future but I don't have more details.
I agree with previous post, Mellanox is doing bad, almost 1 year after vsphere 5 released for a IB stack that does not support SRP. What we have to do with our brand new connectx-3 adapters? we have paid good money to get IB and now? only IPoIB with such slow performances?
What you guys think about?
I just ran across a presentation that spoke about compiling your own mellanox drivers for unsupported linux distros.
Here they are, are they helpful?www.hpcadvisorycouncil.com/.../9_OFED%20SW%20stack.pdf
File Format: PDF/Adobe Acrobat - Quick View
2009 MELLANOX TECHNOLOGIES. - CONFIDENTIAL -. 50. SRP in a Nut Shell. ▫ Maintain local disk access semantics. • Plugs to the bottom of SCSI mid-layer ...sonicostech.wordpress.com/.../howto-infiniband-srp-target-on-centos...
Jump to Rebuilding the Mellanox RPMs: We need to rebuild the Mellanox ISO to support our current kernel. We need to mount it up, run the scripts, and ...
yes using OFED u can recompile your linux kernel to integrate IB Stack, thats easy.
Ubuntu 10.4, 12.4. the drivers is al ready installed. Ive worked with www.Quantastor.com to help them integrate Infiniband into their SAN. It works great!!
the issues are VMWARE and Xen (Xen doesnt even support IB unless you recomile the CentOS kernel) anyone know how to write ESXi5 VIBS for OFED drivers? if so, then we need a comminity Vib driver for ESXi5 to integrate SRP driver for IB.
I think this may be the only way, forget Mellanox SRP and do it ourselves. So if anyone in VMWARE is willing to help a OFED port to VIB Driver which is open source, then please post here.
plz see me latest bandwidth test. 2 images in 1 left is SRP on ESXi 4.1 U2, right image is iSCSI on ESXi5 U1
also view this http://communities.vmware.com/docs/DOC-18796
implies that they have not given up, but they wont talk about it!!!
Im about ready to chuck it all in the Bin anyway!
becnhmark iscsi to srp.jpg 166.2 K