I've a 40gbe Chelsio card running in a TrueNAS HA box. The card has 2x qsfp+ ports, and node 1 (primary) is attached to a switch via breakout cable. When hot plugging, the switch 'sees' the connection and TrueNAS recognizes the connection, but I can not send packets from the switch to the TrueNAS box.
These are all .40.
Either way, once the OS sees the 'carrier' the lagg0 connection still shows as 'down'. For the life of me I can't figure out how to get it active, and I'm beating my head into the wall to try. Their suggestion of going to get a new fibre qsfp+ to 4x sfp+ cable isn't going to happen in a day (much less 3 weeks if you knew my purchasing dept).
So what am I doing wrong here? The switch is set to simple STP, no vlans, no nothing crazy. Just can't send a packet from one .40 to another .40 (.40.9 to .40.52 to be exact).
Suggestions really welcome.
I reached out to their support (gold contract), and was told that 'We don't recommend copper cables as they usually don't work'. I'm a bit on the dumbfounded side since I was staring at racks of them plugged in and the same cables work on the Windows boxes and Linux and Solaris boxes just fine...
Edit: Gear:
Windows box: Running a Mellanox ConnectX-3 Pro Dual Port 40 GbE QSFP+ Switch: ProSAFE M4300 Intelligent Edge Series- M4300-24X24F (pretty cool option I think) Truenas box- I believe - Chelsio T580-SO-CR Truenas is running essentially Freenas latest (11.1)
Cables are Mellanox qsfp+ to 4x, Mellanox Hybrid Passive Copper (doing this from a google search, not work)
After that, not sure what else.
No comments:
Post a Comment