Overview
Try to use Chelsio T62100 for SW Router with 100G LR GBIC, but ❌ Failed
Supported GBIC modes
Chelsio T62100-LP-CR | Mellanox ConnectX-6 |
|---|---|
1000baseT/Full | 1000baseT/Full |
Chelsio T62100
HW info
# lspci | grep -i chel 8a:00.0 Ethernet controller: Chelsio Communications Inc T62100-LP-CR Unified Wire Ethernet Controller 8a:00.1 Ethernet controller: Chelsio Communications Inc T62100-LP-CR Unified Wire Ethernet Controller 8a:00.2 Ethernet controller: Chelsio Communications Inc T62100-LP-CR Unified Wire Ethernet Controller 8a:00.3 Ethernet controller: Chelsio Communications Inc T62100-LP-CR Unified Wire Ethernet Controller 8a:00.4 Ethernet controller: Chelsio Communications Inc T62100-LP-CR Unified Wire Ethernet Controller 8a:00.5 SCSI storage controller: Chelsio Communications Inc T62100-LP-CR Unified Wire Storage Controller 8a:00.6 Fibre Channel: Chelsio Communications Inc T62100-LP-CR Unified Wire Storage Controller # lshw -short -c net H/W path Device Class Description ====================================================== /0/100/1c/0 eno1 network Ethernet Controller 10G X550T /0/100/1c/0.1 eno2 network Ethernet Controller 10G X550T /0/103/2/0 network T62100-LP-CR Unified Wire Ethernet Controller /0/103/2/0.1 network T62100-LP-CR Unified Wire Ethernet Controller /0/103/2/0.2 network T62100-LP-CR Unified Wire Ethernet Controller /0/103/2/0.3 network T62100-LP-CR Unified Wire Ethernet Controller /0/103/2/0.4 ens1f4 network T62100-LP-CR Unified Wire Ethernet Controller /3 usb0 network Ethernet interface /4 ens1f4d1 network Ethernet interface # ethtool -i ens1f4 driver: cxgb4 version: 2.0.0-ko firmware-version: 1.24.11.0, TP 0.1.23.2 expansion-rom-version: bus-info: 0000:8a:00.4 supports-statistics: yes supports-test: no supports-eeprom-access: yes supports-register-dump: yes supports-priv-flags: yes
Test with 100G DAC (100000baseCR4)
# ethtool ens1f4 Settings for ens1f4: Supported ports: [ FIBRE ] Supported link modes: 1000baseT/Full 10000baseKR/Full 40000baseSR4/Full 25000baseCR/Full 50000baseCR2/Full 100000baseCR4/Full Supported pause frame use: Symmetric Receive-only Supports auto-negotiation: Yes Supported FEC modes: BaseR RS Advertised link modes: 40000baseSR4/Full 25000baseCR/Full 50000baseCR2/Full 100000baseCR4/Full Advertised pause frame use: Symmetric Advertised auto-negotiation: Yes Advertised FEC modes: RS Link partner advertised link modes: 100000baseCR4/Full Link partner advertised pause frame use: No Link partner advertised auto-negotiation: Yes Link partner advertised FEC modes: None Speed: 100000Mb/s Duplex: Full Port: Direct Attach Copper PHYAD: 255 Transceiver: internal Auto-negotiation: on Current message level: 0x000000ff (255) drv probe link timer ifdown ifup rx_err tx_err # ethtool -m ens1f4 Identifier : 0x11 (QSFP28) Extended identifier : 0x10 Extended identifier description : 1.5W max. Power consumption Extended identifier description : No CDR in TX, No CDR in RX Extended identifier description : High Power Class (> 3.5 W) not enabled Connector : 0x23 (No separable connector) Transceiver codes : 0x80 0x00 0x00 0x00 0x00 0x00 0x00 0x00 Transceiver type : 100G Ethernet: 100G Base-CR4 or 25G Base-CR CA-L Encoding : 0x05 (64B/66B) BR, Nominal : 25500Mbps Rate identifier : 0x00 Length (SMF,km) : 0km Length (OM3 50um) : 0m Length (OM2 50um) : 0m Length (OM1 62.5um) : 0m Length (Copper or Active cable) : 1m Transmitter technology : 0xa0 (Copper cable unequalized) Attenuation at 2.5GHz : 4db Attenuation at 5.0GHz : 6db Attenuation at 7.0GHz : 8db Attenuation at 12.9GHz : 11db Vendor name : OEM Vendor OUI : 00:00:00 Vendor PN : CAB-ZQP/ZQP-P1M Vendor rev : 5 Vendor SN : CSC230806540021 Date code : 230814 Revision Compliance : SFF-8636 Rev 2.5/2.6/2.7 Module temperature : 27.98 degrees C / 82.37 degrees F Module voltage : 3.3328 V Alarm/warning flags implemented : No Laser tx bias current (Channel 1) : 0.000 mA Laser tx bias current (Channel 2) : 0.000 mA Laser tx bias current (Channel 3) : 0.000 mA Laser tx bias current (Channel 4) : 0.000 mA Transmit avg optical power (Channel 1) : 0.0000 mW / -inf dBm Transmit avg optical power (Channel 2) : 0.0000 mW / -inf dBm Transmit avg optical power (Channel 3) : 0.0000 mW / -inf dBm Transmit avg optical power (Channel 4) : 0.0000 mW / -inf dBm Receiver signal OMA(Channel 1) : 0.0000 mW / -inf dBm Receiver signal OMA(Channel 2) : 0.0000 mW / -inf dBm Receiver signal OMA(Channel 3) : 0.0000 mW / -inf dBm Receiver signal OMA(Channel 4) : 0.0000 mW / -inf dBm
Test with 100G LR
# ethtool ens1f4 Settings for ens1f4: Supported ports: [ FIBRE ] Supported link modes: 1000baseT/Full 10000baseKR/Full 40000baseSR4/Full 25000baseCR/Full 50000baseCR2/Full 100000baseCR4/Full Supported pause frame use: Symmetric Receive-only Supports auto-negotiation: No Supported FEC modes: BaseR RS Advertised link modes: 100000baseCR4/Full Advertised pause frame use: Symmetric Advertised auto-negotiation: No Advertised FEC modes: None Link partner advertised link modes: Not reported Link partner advertised pause frame use: Symmetric Link partner advertised auto-negotiation: No Link partner advertised FEC modes: None Speed: Unknown! Duplex: Full Port: FIBRE PHYAD: 255 Transceiver: internal Auto-negotiation: off Current message level: 0x000000ff (255) drv probe link timer ifdown ifup rx_err tx_err Link detected: no
Mellanox ConnectX-6
HW info
# lspci | grep -i mel 8a:00.0 Ethernet controller: Mellanox Technologies MT28908 Family [ConnectX-6] 8a:00.1 Ethernet controller: Mellanox Technologies MT28908 Family [ConnectX-6] # lshw -short -c net H/W path Device Class Description ====================================================== /0/100/1c/0 eno1 network Ethernet Controller 10G X550T /0/100/1c/0.1 eno2 network Ethernet Controller 10G X550T /0/103/2/0 ens1f0 network MT28908 Family [ConnectX-6] /0/103/2/0.1 ens1f1 network MT28908 Family [ConnectX-6]
Test with 100G LR (100G-LR4)
# ethtool ens1f0 Settings for ens1f0: Supported ports: [ FIBRE ] Supported link modes: 1000baseT/Full 1000baseKX/Full 10000baseT/Full 10000baseKR/Full 10000baseR_FEC 40000baseKR4/Full 40000baseCR4/Full 40000baseSR4/Full 40000baseLR4/Full 25000baseCR/Full 25000baseKR/Full 25000baseSR/Full 50000baseCR2/Full 50000baseKR2/Full 100000baseKR4/Full 100000baseSR4/Full 100000baseCR4/Full 100000baseLR4_ER4/Full 50000baseSR2/Full 1000baseX/Full 10000baseCR/Full 10000baseSR/Full 10000baseLR/Full 10000baseER/Full 50000baseKR/Full 50000baseSR/Full 50000baseCR/Full 50000baseLR_ER_FR/Full 50000baseDR/Full 100000baseKR2/Full 100000baseSR2/Full 100000baseCR2/Full 100000baseLR2_ER2_FR2/Full 100000baseDR2/Full 200000baseKR4/Full 200000baseSR4/Full 200000baseLR4_ER4_FR4/Full 200000baseDR4/Full 200000baseCR4/Full Supported pause frame use: Symmetric Supports auto-negotiation: Yes Supported FEC modes: None RS Advertised link modes: 1000baseT/Full 1000baseKX/Full 10000baseT/Full 10000baseKR/Full 10000baseR_FEC 40000baseKR4/Full 40000baseCR4/Full 40000baseSR4/Full 40000baseLR4/Full 25000baseCR/Full 25000baseKR/Full 25000baseSR/Full 50000baseCR2/Full 50000baseKR2/Full 100000baseKR4/Full 100000baseSR4/Full 100000baseCR4/Full 100000baseLR4_ER4/Full 50000baseSR2/Full 1000baseX/Full 10000baseCR/Full 10000baseSR/Full 10000baseLR/Full 10000baseER/Full 50000baseKR/Full 50000baseSR/Full 50000baseCR/Full 50000baseLR_ER_FR/Full 50000baseDR/Full 100000baseKR2/Full 100000baseSR2/Full 100000baseCR2/Full 100000baseLR2_ER2_FR2/Full 100000baseDR2/Full 200000baseKR4/Full 200000baseSR4/Full 200000baseLR4_ER4_FR4/Full 200000baseDR4/Full 200000baseCR4/Full Advertised pause frame use: Symmetric Advertised auto-negotiation: Yes Advertised FEC modes: None Speed: 100000Mb/s Duplex: Full Port: FIBRE PHYAD: 0 Transceiver: internal Auto-negotiation: on Supports Wake-on: d Wake-on: d Current message level: 0x00000004 (4) link Link detected: yes # ethtool -m ens1f0 Identifier : 0x11 (QSFP28) Extended identifier : 0x1d Extended identifier description : 1.5W max. Power consumption Extended identifier description : CDR present in TX, CDR present in RX Extended identifier description : 4.0W max. Power consumption, High Power Class (> 3.5 W) enabled Connector : 0x07 (LC) Transceiver codes : 0x80 0x00 0x00 0x00 0x00 0x00 0x00 0x00 Transceiver type : 100G Ethernet: 100G Base-LR4 Encoding : 0x05 (64B/66B) BR, Nominal : 25500Mbps Rate identifier : 0x00 Length (SMF,km) : 10km Length (OM3 50um) : 0m Length (OM2 50um) : 0m Length (OM1 62.5um) : 0m Length (Copper or Active cable) : 0m Transmitter technology : 0x40 (1310 nm DFB) Laser wavelength : 1302.350nm Laser wavelength tolerance : 1.030nm Vendor name : CISCO-OEM Vendor OUI : 44:7c:7f Vendor PN : QSFP28-100G-LR4 Vendor rev : 1A Vendor SN : MT240510001 Date code : 240304 Revision Compliance : Unallocated Module temperature : 36.38 degrees C / 97.48 degrees F Module voltage : 3.3774 V Alarm/warning flags implemented : Yes Laser tx bias current (Channel 1) : 53.740 mA Laser tx bias current (Channel 2) : 53.684 mA Laser tx bias current (Channel 3) : 53.758 mA Laser tx bias current (Channel 4) : 54.022 mA Transmit avg optical power (Channel 1) : 1.2598 mW / 1.00 dBm Transmit avg optical power (Channel 2) : 1.3736 mW / 1.38 dBm Transmit avg optical power (Channel 3) : 1.3614 mW / 1.34 dBm Transmit avg optical power (Channel 4) : 1.4224 mW / 1.53 dBm Rcvr signal avg optical power(Channel 1) : 1.6439 mW / 2.16 dBm Rcvr signal avg optical power(Channel 2) : 1.8218 mW / 2.61 dBm Rcvr signal avg optical power(Channel 3) : 1.8312 mW / 2.63 dBm Rcvr signal avg optical power(Channel 4) : 1.9450 mW / 2.89 dBm Laser bias current high alarm (Chan 1) : Off Laser bias current low alarm (Chan 1) : Off Laser bias current high warning (Chan 1) : Off Laser bias current low warning (Chan 1) : Off Laser bias current high alarm (Chan 2) : Off Laser bias current low alarm (Chan 2) : Off Laser bias current high warning (Chan 2) : Off Laser bias current low warning (Chan 2) : Off Laser bias current high alarm (Chan 3) : Off Laser bias current low alarm (Chan 3) : Off Laser bias current high warning (Chan 3) : Off Laser bias current low warning (Chan 3) : Off Laser bias current high alarm (Chan 4) : Off Laser bias current low alarm (Chan 4) : Off Laser bias current high warning (Chan 4) : Off Laser bias current low warning (Chan 4) : Off Module temperature high alarm : Off Module temperature low alarm : Off Module temperature high warning : Off Module temperature low warning : Off Module voltage high alarm : Off Module voltage low alarm : Off Module voltage high warning : Off Module voltage low warning : Off Laser tx power high alarm (Channel 1) : Off Laser tx power low alarm (Channel 1) : Off Laser tx power high warning (Channel 1) : Off Laser tx power low warning (Channel 1) : Off Laser tx power high alarm (Channel 2) : Off Laser tx power low alarm (Channel 2) : Off Laser tx power high warning (Channel 2) : Off Laser tx power low warning (Channel 2) : Off Laser tx power high alarm (Channel 3) : Off Laser tx power low alarm (Channel 3) : Off Laser tx power high warning (Channel 3) : Off Laser tx power low warning (Channel 3) : Off Laser tx power high alarm (Channel 4) : Off Laser tx power low alarm (Channel 4) : Off Laser tx power high warning (Channel 4) : Off Laser tx power low warning (Channel 4) : Off Laser rx power high alarm (Channel 1) : Off Laser rx power low alarm (Channel 1) : Off Laser rx power high warning (Channel 1) : Off Laser rx power low warning (Channel 1) : Off Laser rx power high alarm (Channel 2) : Off Laser rx power low alarm (Channel 2) : Off Laser rx power high warning (Channel 2) : Off Laser rx power low warning (Channel 2) : Off Laser rx power high alarm (Channel 3) : Off Laser rx power low alarm (Channel 3) : Off Laser rx power high warning (Channel 3) : Off Laser rx power low warning (Channel 3) : Off Laser rx power high alarm (Channel 4) : Off Laser rx power low alarm (Channel 4) : Off Laser rx power high warning (Channel 4) : Off Laser rx power low warning (Channel 4) : Off Laser bias current high alarm threshold : 110.000 mA Laser bias current low alarm threshold : 10.000 mA Laser bias current high warning threshold : 100.000 mA Laser bias current low warning threshold : 20.000 mA Laser output power high alarm threshold : 4.4668 mW / 6.50 dBm Laser output power low alarm threshold : 0.2344 mW / -6.30 dBm Laser output power high warning threshold : 3.5481 mW / 5.50 dBm Laser output power low warning threshold : 0.3715 mW / -4.30 dBm Module temperature high alarm threshold : 75.00 degrees C / 167.00 degrees F Module temperature low alarm threshold : -5.00 degrees C / 23.00 degrees F Module temperature high warning threshold : 70.00 degrees C / 158.00 degrees F Module temperature low warning threshold : 0.00 degrees C / 32.00 degrees F Module voltage high alarm threshold : 3.6300 V Module voltage low alarm threshold : 2.9700 V Module voltage high warning threshold : 3.4650 V Module voltage low warning threshold : 3.1349 V Laser rx power high alarm threshold : 3.5481 mW / 5.50 dBm Laser rx power low alarm threshold : 0.0436 mW / -13.61 dBm Laser rx power high warning threshold : 2.8183 mW / 4.50 dBm Laser rx power low warning threshold : 0.0870 mW / -10.60 dBm