On Mon, Feb 03, 2025 at 02:33:59PM +0000, Stuart Henderson wrote:
>On 2025-02-03, Julian Huhn <julian@huhn.dev> wrote:
>> Moin!
>>
>> I'm trying to connect to an Internet exchange with a bnxt(4) interface, but I
>> only get 10GbaseSR as the media type, not 10GbaseLR as expected. When I try to
>> set the media type manually, it fails with an "Invalid argument". In fact,
>> 10GbaseLR isn't listed as a supported media type for the interface. Is this
>> correct? Is SR the only supported mode on this type of network card?
>
>You can't switch between SR and LR in software, it's dependent on
>the transceiver.
Ok, but the transceiver is LR as far as I can see, so it was misidentified by
bnxt(4), right?
>Is it working OK anyway? (i.e. is this just a cosmetic issue?)
Unfortunately, I cannot establish connectivity with the interface. However, both
sides claim that the interfaces are active.
>> I'm not a good programmer, but in sys/dev/pci/if_bnxt.c I see no indication
>> that 10GbaseLR is not supported.
>>
>> To provide some more context: The system is a VM on Proxmox with the network
>> card passed through. The network card is a Broadcom P225p. The SFP module is
>> made for 10G SFP+ LR.
>>
>> I hope I have attached all the necessary information.
>>
>> --Huhn
>>
>> # ifconfig bnxt0 media 10GbaseLR
>> ifconfig: bnxt0: SIOCSIFMEDIA: Invalid argument
>>
>> # ifconfig bnxt0 media
>> bnxt0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
>> lladdr 6c:92:cf:12:94:e0
>> index 1 priority 0 llprio 3
>> media: Ethernet autoselect (10GbaseSR full-duplex)
>> status: active
>> supported media:
>> media 1000baseSX
>> media 10GbaseSR
>> media 25GbaseSR
>> media autoselect
>>
>> # ifconfig bnxt0 transceiver
>> bnxt0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
>> lladdr 6c:92:cf:12:94:e0
>> index 1 priority 0 llprio 3
>> media: Ethernet autoselect (10GbaseSR full-duplex)
>> status: active
>> transceiver: SFP LC, 1310 nm, 10.0km SMF
>> model: FLEXOPTIX P.1396.10 rev A
>> serial: F78R35W, date: 2018-07-09
>> voltage: 3.16 V, bias current: 35.16 mA
>> temp: 35.59 C (low -25.00 C, high 90.00 C)
>> tx: -2.16 dBm (low -7.00 dBm, high 2.50 dBm)
>> rx: -5.12 dBm (low -16.00 dBm, high 1.00 dBm)
>>
>> # pcidump -v 1:0:0
>> 1:0:0: Broadcom BCM57414
>> 0x0000: Vendor ID: 14e4, Product ID: 16d7
>> 0x0004: Command: 0006, Status: 0010
>> 0x0008: Class: 02 Network, Subclass: 00 Ethernet,
>> Interface: 00, Revision: 01
>> 0x000c: BIST: 00, Header Type: 00, Latency Timer: 00,
>> Cache Line Size: 00
>> 0x0010: BAR mem prefetchable 64bit addr: 0x00000000c2000000/0x00010000
>> 0x0018: BAR mem prefetchable 64bit addr: 0x00000000c2100000/0x00100000
>> 0x0020: BAR mem prefetchable 64bit addr: 0x0000000000000000/0x00002000
>> 0x0028: Cardbus CIS: 00000000
>> 0x002c: Subsystem Vendor ID: 14e4 Product ID: 1402
>> 0x0030: Expansion ROM Base Address: 00000000
>> 0x0038: 00000000
>> 0x003c: Interrupt Pin: 01 Line: 0a Min Gnt: 00 Max Lat: 00
>> 0x0048: Capability 0x01: Power Management
>> State: D0
>> 0x0050: Capability 0x03: Vital Product Data (VPD)
>> Product Name: Broadcom P225p NetXtreme-E Dual-port 10Gb/25Gb Ethernet PCIe Adapter
>> [|vpd]
>> 0x00a0: Capability 0x11: Extended Message Signalled Interrupts (MSI-X)
>> Enabled: yes; table size 148 (BAR 4:0)
>> 0x00ac: Capability 0x10: PCI Express
>> Max Payload Size: 512 / 512 bytes
>> Max Read Request Size: 512 bytes
>> Link Speed: 8.0 / 8.0 GT/s
>> Link Width: x8 / x8
>> 0x0100: Enhanced Capability 0x01: Advanced Error Reporting
>> 0x013c: Enhanced Capability 0x03: Device Serial Number
>> Serial Number: 6c92cffffe1294e0
>> 0x0150: Enhanced Capability 0x04: Power Budgeting
>> 0x0160: Enhanced Capability 0x02: Virtual Channel Capability
>> 0x0180: Enhanced Capability 0x0b: Vendor-Specific
>> 0x01b0: Enhanced Capability 0x18: Latency Tolerance Reporting
>> 0x0230: Enhanced Capability 0x17: TPH Requester
>>
>> # dmesg
>> OpenBSD 7.6 (GENERIC.MP) #0: Thu Jan 9 07:32:40 MST 2025
>> root@syspatch-76-amd64.openbsd.org:/usr/src/sys/arch/amd64/compile/GENERIC.MP
>> real mem = 17144750080 (16350MB)
>> avail mem = 16601751552 (15832MB)
>> random: good seed from bootblocks
>> mpath0 at root
>> scsibus0 at mpath0: 256 targets
>> mainbus0 at root
>> bios0 at mainbus0: SMBIOS rev. 2.8 @ 0x7f917000 (10 entries)
>> bios0:
>> bios0: QEMU Standard PC (Q35 + ICH9, 2009)
>> efi0 at bios0: UEFI 2.7
>> efi0: EFI Development Kit II / OVMF rev 0x10000
>> acpi0 at bios0: ACPI 3.0
>> acpi0: sleep states S3 S4 S5
>> acpi0: tables DSDT FACP APIC SSDT HPET MCFG WAET BGRT
>> acpi0: wakeup devices
>> acpitimer0 at acpi0: 3579545 Hz, 24 bits
>> acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
>> cpu0 at mainbus0: apid 0 (boot processor)
>> cpu0: AMD Ryzen 7 9700X 8-Core Processor, 3793.05 MHz, 1a-44-00
>> cpu0: cpuid 1 edx=178bfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,HTT> ecx=f7f83203<SSE3,PCLMUL,SSSE3,FMA3,CX16,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,HV>
>> cpu0: cpuid 6 eax=4<ARAT>
>> cpu0: cpuid 7.0 ebx=f1bf07ab<FSGSBASE,TSC_ADJUST,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,AVX512F,AVX512DQ,RDSEED,ADX,SMAP,AVX512IFMA,CLFLUSHOPT,CLWB,AVX512CD,SHA,AVX512BW,AVX512VL> ecx=18405f4e<AVX512VBMI,UMIP,PKU> edx=bc000110<IBRS,IBPB,STIBP,L1DF,SSBD>
>> cpu0: cpuid d.1 eax=f<XSAVEOPT,XSAVEC,XGETBV1,XSAVES>
>> cpu0: cpuid 80000001 edx=2fd3fbff<NXE,MMXX,FFXSR,PAGE1GB,RDTSCP,LONG> ecx=8003f7<LAHF,CMPLEG,SVM,AMCR8,ABM,SSE4A,MASSE,3DNOWP,OSVW,CPCTR>
>> cpu0: cpuid 80000008 ebx=1302d205<IBPB,IBRS,STIBP,STIBP_ALL,SSBD,VIRTSSBD>
>> cpu0: 64KB 64b/line 2-way D-cache, 64KB 64b/line 2-way I-cache
>> cpu0: 512KB 64b/line 16-way L2 cache
>> cpu0: smt 0, core 0, package 0
>> mtrr: Pentium Pro MTRR support, 8 var ranges, 88 fixed ranges
>> cpu0: apic clock running at 1000MHz
>> cpu1 at mainbus0: apid 1 (application processor)
>> cpu1: AMD Ryzen 7 9700X 8-Core Processor, 3792.96 MHz, 1a-44-00
>> cpu1: smt 0, core 1, package 0
>> cpu2 at mainbus0: apid 2 (application processor)
>> cpu2: AMD Ryzen 7 9700X 8-Core Processor, 3793.01 MHz, 1a-44-00
>> cpu2: smt 0, core 2, package 0
>> cpu3 at mainbus0: apid 3 (application processor)
>> cpu3: AMD Ryzen 7 9700X 8-Core Processor, 3793.03 MHz, 1a-44-00
>> cpu3: smt 0, core 3, package 0
>> ioapic0 at mainbus0: apid 0 pa 0xfec00000, version 11, 24 pins
>> acpihpet0 at acpi0: 100000000 Hz
>> acpimcfg0 at acpi0
>> acpimcfg0: addr 0xb0000000, bus 0-255
>> acpiprt0 at acpi0: bus 0 (PCI0)
>> "ACPI0006" at acpi0 not configured
>> acpipci0 at acpi0 PCI0: 0x00000010 0x00000011 0x00000000
>> "PNP0A06" at acpi0 not configured
>> "PNP0A06" at acpi0 not configured
>> "PNP0A06" at acpi0 not configured
>> "QEMU0002" at acpi0 not configured
>> acpicmos0 at acpi0
>> "ACPI0010" at acpi0 not configured
>> "QEMUVGID" at acpi0 not configured
>> acpicpu0 at acpi0: C1(@1 halt!)
>> acpicpu1 at acpi0: C1(@1 halt!)
>> acpicpu2 at acpi0: C1(@1 halt!)
>> acpicpu3 at acpi0: C1(@1 halt!)
>> pvbus0 at mainbus0: KVM
>> pvclock0 at pvbus0
>> pci0 at mainbus0 bus 0
>> 0:28:0: bridge io address conflict 0xd000/0x1000
>> 0:28:0: bridge mem address conflict 0x380000000000/0x800000000
>> 0:28:1: bridge mem address conflict 0x380800000000/0x800000000
>> 0:28:2: bridge mem address conflict 0x381000000000/0x800000000
>> 0:28:3: bridge mem address conflict 0x381800000000/0x800000000
>> 0:30:0: bridge mem address conflict 0x382000000000/0x2000000000
>> pchb0 at pci0 dev 0 function 0 "Intel 82G33 Host" rev 0x00
>> "Bochs VGA" rev 0x02 at pci0 dev 1 function 0 not configured
>> uhci0 at pci0 dev 26 function 0 "Intel 82801I USB" rev 0x03: apic 0 int 16
>> uhci1 at pci0 dev 26 function 1 "Intel 82801I USB" rev 0x03: apic 0 int 17
>> uhci2 at pci0 dev 26 function 2 "Intel 82801I USB" rev 0x03: apic 0 int 18
>> ehci0 at pci0 dev 26 function 7 "Intel 82801I USB" rev 0x03: apic 0 int 19
>> usb0 at ehci0: USB revision 2.0
>> uhub0 at usb0 configuration 1 interface 0 "Intel EHCI root hub" rev 2.00/1.00 addr 1
>> azalia0 at pci0 dev 27 function 0 "Intel 82801I HD Audio" rev 0x03: msi
>> azalia0: no HD-Audio codecs
>> ppb0 at pci0 dev 28 function 0 "Red Hat PCIE" rev 0x00: apic 0 int 16
>> pci1 at ppb0 bus 1
>> 1:0:0: mem address conflict 0x380000100000/0x10000
>> 1:0:0: mem address conflict 0x380000000000/0x100000
>> 1:0:0: mem address conflict 0x380000110000/0x2000
>> bnxt0 at pci1 dev 0 function 0 "Broadcom BCM57414" rev 0x01: fw ver 231.0.153, msix, 4 queues, address 6c:92:cf:12:94:e0
>> ppb1 at pci0 dev 28 function 1 "Red Hat PCIE" rev 0x00: apic 0 int 16
>> pci2 at ppb1 bus 2
>> ppb2 at pci0 dev 28 function 2 "Red Hat PCIE" rev 0x00: apic 0 int 16
>> pci3 at ppb2 bus 3
>> ppb3 at pci0 dev 28 function 3 "Red Hat PCIE" rev 0x00: apic 0 int 16
>> pci4 at ppb3 bus 4
>> uhci3 at pci0 dev 29 function 0 "Intel 82801I USB" rev 0x03: apic 0 int 16
>> uhci4 at pci0 dev 29 function 1 "Intel 82801I USB" rev 0x03: apic 0 int 17
>> uhci5 at pci0 dev 29 function 2 "Intel 82801I USB" rev 0x03: apic 0 int 18
>> ehci1 at pci0 dev 29 function 7 "Intel 82801I USB" rev 0x03: apic 0 int 19
>> usb1 at ehci1: USB revision 2.0
>> uhub1 at usb1 configuration 1 interface 0 "Intel EHCI root hub" rev 2.00/1.00 addr 1
>> ppb4 at pci0 dev 30 function 0 "Intel 82801BA Hub-to-PCI" rev 0x92
>> pci5 at ppb4 bus 5
>> 5:1:0: bridge mem address conflict 0x383800000000/0x800000000
>> 5:4:0: bridge mem address conflict 0x382000000000/0x800000000
>> ppb5 at pci5 dev 1 function 0 "Red Hat Qemu PCI-PCI" rev 0x00
>> pci6 at ppb5 bus 6
>> 6:3:0: mem address conflict 0x383800004000/0x4000
>> 6:18:0: mem address conflict 0x383800000000/0x4000
>> virtio0 at pci6 dev 3 function 0 "Qumranet Virtio Memory Balloon" rev 0x00
>> viomb0 at virtio0
>> virtio0: apic 0 int 20
>> virtio1 at pci6 dev 18 function 0 "Qumranet Virtio Network" rev 0x00
>> vio0 at virtio1, address bc:24:11:7d:0d:c8
>> virtio1: msix per-VQ
>> ppb6 at pci5 dev 2 function 0 "Red Hat Qemu PCI-PCI" rev 0x00
>> pci7 at ppb6 bus 7
>> ppb7 at pci5 dev 3 function 0 "Red Hat Qemu PCI-PCI" rev 0x00
>> pci8 at ppb7 bus 8
>> ppb8 at pci5 dev 4 function 0 "Red Hat Qemu PCI-PCI" rev 0x00
>> pci9 at ppb8 bus 9
>> 9:1:0: mem address conflict 0x382000000000/0x4000
>> virtio2 at pci9 dev 1 function 0 "Qumranet Virtio SCSI" rev 0x00
>> vioscsi0 at virtio2: qsize 256
>> scsibus1 at vioscsi0: 255 targets
>> sd0 at scsibus1 targ 0 lun 0: <QEMU, QEMU HARDDISK, 2.5+>
>> sd0: 40960MB, 512 bytes/sector, 83886080 sectors, thin
>> virtio2: msix per-VQ
>> pcib0 at pci0 dev 31 function 0 "Intel 82801IB LPC" rev 0x02
>> ahci0 at pci0 dev 31 function 2 "Intel 82801I AHCI" rev 0x02: msi, AHCI 1.0
>> ahci0: port 1: 1.5Gb/s
>> scsibus2 at ahci0: 32 targets
>> cd0 at scsibus2 targ 1 lun 0: <QEMU, QEMU DVD-ROM, 2.5+> removable
>> ichiic0 at pci0 dev 31 function 3 "Intel 82801I SMBus" rev 0x02: SMBus disabled
>> usb2 at uhci0: USB revision 1.0
>> uhub2 at usb2 configuration 1 interface 0 "Intel UHCI root hub" rev 1.00/1.00 addr 1
>> usb3 at uhci1: USB revision 1.0
>> uhub3 at usb3 configuration 1 interface 0 "Intel UHCI root hub" rev 1.00/1.00 addr 1
>> usb4 at uhci2: USB revision 1.0
>> uhub4 at usb4 configuration 1 interface 0 "Intel UHCI root hub" rev 1.00/1.00 addr 1
>> usb5 at uhci3: USB revision 1.0
>> uhub5 at usb5 configuration 1 interface 0 "Intel UHCI root hub" rev 1.00/1.00 addr 1
>> usb6 at uhci4: USB revision 1.0
>> uhub6 at usb6 configuration 1 interface 0 "Intel UHCI root hub" rev 1.00/1.00 addr 1
>> usb7 at uhci5: USB revision 1.0
>> uhub7 at usb7 configuration 1 interface 0 "Intel UHCI root hub" rev 1.00/1.00 addr 1
>> isa0 at pcib0
>> isadma0 at isa0
>> pckbc0 at isa0 port 0x60/5 irq 1 irq 12
>> pckbd0 at pckbc0 (kbd slot)
>> wskbd0 at pckbd0: console keyboard
>> pms0 at pckbc0 (aux slot)
>> wsmouse0 at pms0 mux 0
>> pcppi0 at isa0 port 0x61
>> spkr0 at pcppi0
>> vmm0 at mainbus0: SVM/RVI
>> efifb0 at mainbus0: 2048x2048, 32bpp
>> wsdisplay0 at efifb0 mux 1: console (std, vt100 emulation), using wskbd0
>> wsdisplay0: screen 1-5 added (std, vt100 emulation)
>> uhidev0 at uhub1 port 1 configuration 1 interface 0 "QEMU QEMU USB Tablet" rev 2.00/0.00 addr 2
>> uhidev0: iclass 3/0
>> ums0 at uhidev0: 3 buttons, Z dir
>> wsmouse1 at ums0 mux 0
>> vscsi0 at root
>> scsibus3 at vscsi0: 256 targets
>> softraid0 at root
>> scsibus4 at softraid0: 256 targets
>> sd1 at scsibus4 targ 1 lun 0: <OPENBSD, SR CRYPTO, 006>
>> sd1: 40699MB, 512 bytes/sector, 83352975 sectors
>> root on sd1a (c1f30a94afa98bd1.a) swap on sd1b dump on sd1b
>>
>>
>
>
>--
>Please keep replies on the mailing list.
>
No comments:
Post a Comment