Friday, April 12, 2019

Hey i'm digging into Infiniband 10/20 and 40GBit/s or SDR/DDR and QDR. Currently i have two problems to solve to get everything working.

Problem 1: Speed negotiation issues with windows

Details:

A goold old HP ML150 M5 with Mellanox ConnectX-2 MHQH29-XTC and Server 2008 R2 running.
It shows physical link, but diagnostics says there are issues with speed negotiation (speed test failed, link test passed).
Port LED on switch flashes green.
I tried to do a firmware update but i cant find any matching ids for an update.
Device Manager lists Controller as MT26428.
The drivers used for installation are VPI_WinOF Version 5.35.

Problem 2: Connect IB-Switch with GBE-Switch

Details:

To be more precise we want to connect a Mellanox IS5022 with a HP ProCurve 2810-48G directly or with an adapter/converter
Protocol used is IPoverIB.
As far as i know we need to convert from QSFP+ QDR (or SDR/DDR) to a usual 1 GB Ethernet.
We already tried to connect these switches by ourself with no success:
IS5022 -> HP QSFP-SFP Adapter 655874-B21 -> GBIC HP SX-LC J4858C -> SX Multimode 850nm LC Cable -> HP GBIC HP SX-LC J4858C -> ProCurve 2810.
GBIC's and fibre cable are functional, I tried it with another GBE switch and they are fine.
Distributor said that our QSFP to SFP Adapter will work because they sell/use them quite often together with a IS5022.
Current error i would describe as: physical link led is off.

Additional Details

Infiniband is already working between some hosts. 2x HP DL360 Gen9 with ESXi 6.5 and Mellanox Connect-X 2 NICs connected to a Mellanox IS-5022 Switch.
I wanna use IB for usual IP/network communication between hosts and clients.
IS-5022 is a unmanaged switch for 40GBit/s / QDR IB
tried several drivers on windows machine- no success
controller port configuration changed to auto / ib or eth - no success
tried everything with both ports on nic and different ports on switch - no difference

Any ideas or advices?