Just documenting a miscellaneous list of tips mostly do I don't forget where they are located, but also figured they could be useful for others. No particular rhyme or reason, just random notes.

Pro Tips

Mellanox CX3

1. Test for detection lspci |grep -i mellanox

2. Mellanox interface example naming
   
   Enp102s0 - top port on the card
Enp102s0d1 - bottom port

3. Card ONLY supports 128 VLANs, if you are using a config (proxmox) that defaults to being a trunk with thousands of VLANs you will need to specify in your /etc/network/interfaces file which vlanIDs you want to be present on the card.

4. Detect speed for port ethtool <devicename> | grep -i speed

Motherboard

1. The enterprise class motherboards have a built in BMC (IPMI), post 2019 they changed the default login and password. The password is now individually coded to the Mobo and is located on a sticker on the motherboard. Write this down in your secure password vault BEFORE assembling the server.