Re: Queuing faster than 4 Gbps

Some more info :
* This firewall used to run OpenBSD 5.7, with a similar performance. CPU0 was around 10% idle. If I sent more traffic, I saw IFQ drops
* It just has been upgraded to 6.2. 3 cores are loaded now, the busiest is around 50% idle. If I send more traffic, I see out discards on my IX interfaces.

Maybe it is related to the output buffer ? Is there a way to increase it ?
Just in case, here is the output of netstat -m, vmstat -m and systat mbufs.
I don't understand what the output of those commands mean... If someone has a link to some documentation about these, that would help
885 mbufs in use:
834 mbufs allocated to data
4 mbufs allocated to packet headers
47 mbufs allocated to socket names and addresses
72/256/64 mbuf 2048 byte clusters in use (current/peak/max)
670/17640/120 mbuf 2112 byte clusters in use (current/peak/max)
0/48/64 mbuf 4096 byte clusters in use (current/peak/max)
0/120/64 mbuf 8192 byte clusters in use (current/peak/max)
34/70/112 mbuf 9216 byte clusters in use (current/peak/max)
0/40/80 mbuf 12288 byte clusters in use (current/peak/max)
0/40/64 mbuf 16384 byte clusters in use (current/peak/max)
0/56/64 mbuf 65536 byte clusters in use (current/peak/max)
48936 Kbytes allocated to network (4% in use)
0 requests for memory denied
0 requests for memory delayed
0 calls to protocol drain routines

###########################################

Memory statistics by bucket size
Size In Use Free Requests HighWater Couldfree
16 471 553 112564 1280 0
32 417 607 131271 640 0
64 1511 25 33005 320 12
128 3178 22 49040 160 8
256 664 24 225183 80 0
512 238 2 113984 40 0
1024 2212 4 32615 20 0
2048 547 5 4047 10 244
4096 55 2 12158 5 0
8192 207 1 216 5 0
16384 5 0 54156 5 0
32768 6 0 13 5 0
65536 3 0 10151 5 0
131072 2 0 2 5 0
262144 1 0 1 5 0
524288 1 0 1 5 0

Memory usage type by bucket size
Size Type(s)
16 devbuf, pcb, rtable, ifaddr, dirhash, ACPI, exec, VM swap, UVM amap,
UVM aobj, USB, USB device, temp
32 devbuf, pcb, rtable, ifaddr, sysctl, sem, dirhash, ACPI, in_multi,
ether_multi, exec, UVM amap, USB, USB device, NDP, temp
64 devbuf, rtable, ifaddr, counters, vnodes, dirhash, ACPI, proc,
in_multi, VM swap, UVM amap, USB, USB device, temp
128 devbuf, pcb, rtable, ifaddr, sysctl, counters, vnodes, UFS mount, sem,
dirhash, ACPI, NFS srvsock, ip_moptions, in_multi, UVM amap, USB,
USB device, USB HC, temp
256 devbuf, rtable, ifaddr, counters, ioctlops, iov, vnodes, shm, VM map,
dirhash, ACPI, exec, UVM amap, USB, USB device, temp
512 devbuf, ifaddr, counters, ioctlops, iov, UFS mount, dirhash,
file desc, ttys, newblk, UVM amap, temp
1024 devbuf, pcb, sysctl, counters, ioctlops, mount, UFS mount, shm, proc,
ttys, exec, USB device, crypto data, temp
2048 devbuf, ioctlops, UFS mount, ACPI, VM swap, UVM aobj, USB, temp
4096 devbuf, ifaddr, counters, ioctlops, proc, ttys, USB, memdesc, temp
8192 devbuf, counters, ttys, pagedep, USB, temp, SYN cache
16384 devbuf, UFS mount, NFS daemon, MSDOSFS mount, temp
32768 devbuf, UFS quota, UFS mount, ISOFS mount, inodedep
65536 devbuf, temp
131072 devbuf, VM swap
262144 VM swap
524288 temp

Memory statistics by type Type Kern
Type InUse MemUse HighUse Limit Requests Limit Limit Size(s)
devbuf 5343 3971K 4044K 78644K 14813 0 0 16,32,64,128,256,512,1024,2048,4096,8192,16384,32768,65536,131072
pcb 78 17K 17K 78644K 525 0 0 16,32,128,1024
rtable 116 7K 34K 78644K 279840 0 0 16,32,64,128,256
ifaddr 94 16K 17K 78644K 118 0 0 16,32,64,128,256,512,4096
sysctl 3 2K 2K 78644K 3 0 0 32,128,1024
counters 59 63K 63K 78644K 59 0 0 64,128,256,512,1024,4096,8192
ioctlops 0 0K 4K 78644K 117337 0 0 256,512,1024,2048,4096
iov 0 0K 1K 78644K 10 0 0 256,512
mount 2 2K 2K 78644K 2 0 0 1024
vnodes 1225 78K 78K 78644K 2379 0 0 64,128,256
UFS quota 1 32K 32K 78644K 1 0 0 32768
UFS mount 9 53K 53K 78644K 9 0 0 128,512,1024,2048,16384,32768
shm 2 2K 2K 78644K 2 0 0 256,1024
VM map 2 1K 1K 78644K 2 0 0 256
sem 2 1K 1K 78644K 2 0 0 32,128
dirhash 186 37K 37K 78644K 210 0 0 16,32,64,128,256,512
ACPI 1233 150K 167K 78644K 42863 0 0 16,32,64,128,256,2048
file desc 1 1K 1K 78644K 3 0 0 512
proc 18 14K 14K 78644K 18 0 0 64,1024,4096
NFS srvsock 1 1K 1K 78644K 1 0 0 128
NFS daemon 1 16K 16K 78644K 1 0 0 16384
ip_moptions 5 1K 1K 78644K 5 0 0 128
in_multi 13 1K 2K 78644K 45 0 0 32,64,128
ether_multi 26 1K 1K 78644K 33 0 0 32
ISOFS mount 1 32K 32K 78644K 1 0 0 32768
MSDOSFS mount 1 16K 16K 78644K 1 0 0 16384
ttys 414 1751K 1751K 78644K 414 0 0 512,1024,4096,8192
exec 0 0K 2K 78644K 8398 0 0 16,32,256,1024
pagedep 1 8K 8K 78644K 1 0 0 8192
inodedep 1 32K 32K 78644K 1 0 0 32768
newblk 1 1K 1K 78644K 1 0 0 512
VM swap 7 291K 291K 78644K 7 0 0 16,64,2048,131072,262144
UVM amap 326 16K 30K 78644K 166275 0 0 16,32,64,128,256,512
UVM aobj 2 3K 3K 78644K 2 0 0 16,2048
USB 89 43K 45K 78644K 121 0 0 16,32,64,128,256,2048,4096,8192
USB device 29 3K 3K 78644K 32 0 0 16,32,64,128,256,1024
USB HC 0 0K 1K 78644K 1 0 0 128
memdesc 1 4K 4K 78644K 1 0 0 4096
crypto data 1 1K 1K 78644K 1 0 0 1024
NDP 16 1K 1K 78644K 16 0 0 32
temp 207 2121K 2249K 78644K 144852 0 0 16,32,64,128,256,512,1024,2048,4096,8192,16384,65536,524288
SYN cache 2 16K 16K 78644K 2 0 0 8192

Memory Totals: In Use Free Requests
8792K 69K 778408
Memory resource pool statistics
Name Size Requests Fail InUse Pgreq Pgrel Npage Hiwat Minpg Maxpg Idle
phpool 112 15296 0 4408 136 7 129 129 0 8 0
extentpl 40 122 0 60 1 0 1 1 0 8 0
pmappl 176 9030 0 42 3 0 3 3 0 8 0
pvpl 32 12099843 0 18662 1712 1549 163 399 0 265 0
pdppl 4096 9030 0 42 22 16 6 7 0 8 0
vmsppl 256 9030 0 42 19 16 3 4 0 8 0
vmmpepl 168 4660299 0 4221 5740 5550 190 776 0 357 6
vmmpekpl 168 969440 0 42 2 0 2 2 0 8 0
uaddr 24 9031 0 43 1 0 1 1 0 8 0
uaddrbest 32 2 0 2 1 0 1 1 0 8 0
uaddrrnd 24 9031 0 43 1 0 1 1 0 8 0
aobjpl 64 1 0 1 1 0 1 1 0 8 0
dma32 32 7 0 0 1 1 0 1 0 8 0
dma64 64 2 0 0 1 1 0 1 0 8 0
dma256 256 8 0 0 1 1 0 1 0 8 0
dma4096 4096 1 0 0 1 1 0 1 0 8 0
amappl 72 55247 0 120 34 31 3 12 0 75 0
amappl1 72 1203764 0 1702 2585 2544 41 139 0 8 0
amappl2 80 117989 0 644 250 236 14 29 0 8 0
amappl3 88 104405 0 30 48 45 3 13 0 8 0
amappl4 96 55318 0 62 110 106 4 13 0 8 0
amappl5 104 32787 0 66 8 5 3 8 0 8 0
amappl6 112 8333 0 8 5 4 1 5 0 8 0
amappl7 120 10460 0 47 9 7 2 7 0 8 0
amappl8 128 20208 0 12 59 58 1 33 0 8 0
amappl9 136 11456 0 5 29 28 1 6 0 8 0
amappl10 144 7930 0 4 5 4 1 5 0 8 0
amappl11 152 6557 0 47 6 3 3 5 0 8 0
amappl12 160 7355 0 2 4 3 1 4 0 8 0
amappl13 168 1302 0 4 3 2 1 3 0 8 0
amappl14 176 4771 0 8 3 2 1 3 0 8 0
amappl15 184 5138 0 18 21 20 1 3 0 8 0
amappl16 192 13438 0 34 12 9 3 9 0 8 0
amapchunkpl 152 217045 0 274 186 174 12 71 0 158 0
anonpl 16 4441511 0 7029 638 602 36 165 0 244 0
bufpl 256 35884 0 25634 1605 0 1605 1605 0 8 0
mbufpl 256 15545323842 0 10629 1753 639 1114 1114 0 8 0
mcl2k 2048 81219446 0 73 303 282 21 32 0 8 0
mcl2k2 2112 15437698227 0 10424 1867 691 1176 1176 0 8 0
mcl4k 4096 9250 0 0 6 0 6 6 0 8 0
mcl8k 8192 95946 0 0 15 1 14 15 0 8 0
mcl9k 9216 1612 0 34 5 0 5 5 0 8 0
mcl12k 12288 1664 0 0 4 0 4 4 0 8 0
mcl16k 16384 2833 0 0 5 0 5 5 0 8 0
mcl64k 65536 73262 0 0 7 0 7 7 0 8 0
sockpl 376 3735 0 81 22 13 9 11 0 8 0
srpgc 64 81 0 0 4 4 0 1 0 8 0
procpl 568 9051 0 63 16 11 5 6 0 8 0
processpl 736 9051 0 63 7 0 7 7 0 8 0
zombiepl 144 8988 0 0 182 181 1 1 0 8 1
ucredpl 96 2494 0 31 1 0 1 1 0 8 0
pgrppl 40 1381 0 30 1 0 1 1 0 8 0
sessionpl 112 1192 0 26 1 0 1 1 0 8 0
lockfpl 88 330 0 0 24 24 0 1 0 8 0
filepl 112 924056 0 158 19 14 5 6 0 8 0
fdescpl 440 9031 0 43 6 0 6 6 0 8 0
pipepl 112 19444 0 8 2 1 1 1 0 8 0
kqueuepl 312 20 0 14 2 0 2 2 0 8 0
knotepl 112 925 0 83 3 0 3 3 0 8 0
sigapl 432 9030 0 42 6 0 6 6 0 8 0
scxspl 192 55950 0 0 4689 4688 1 7 0 8 1
xhcixfer 240 73 0 2 1 0 1 1 0 8 0
ehcixfer 264 82 0 4 1 0 1 1 0 8 0
uhcixfer 264 46 0 1 1 0 1 1 0 8 0
percpumem 32 25 0 25 1 0 1 1 0 8 0
namei 1024 1376010 0 0 1369 1368 1 2 0 8 1
vnodes 192 24474 0 24474 1224 0 1224 1224 0 8 0
uvmvnodes 72 24474 0 24474 445 0 445 445 0 8 0
nchpl 144 204477 0 5924 264 44 220 220 0 8 0
ffsino 240 41434 0 24342 1441 8 1433 1433 0 8 0
dino1pl 128 41434 0 24342 789 3 786 786 0 8 0
dirhash 1024 341 0 307 39 0 39 39 0 8 0
art_node 16 40754 0 34 164 163 1 3 0 8 0
art_table 32 2483 0 34 1 0 1 1 0 8 0
art_heap4 256 2482 0 33 12 7 5 8 0 8 0
art_heap8 4096 1 0 1 1 0 1 1 0 8 0
pfrule 1360 411 0 70 17 7 10 10 0 8 0
pfstate 312 320417 0 835 8665 8539 126 244 0 8 0
pfstkey 112 324193 0 832 1991 1916 75 90 0 8 0
pfstitem 24 324191 0 832 151 133 18 19 0 8 0
pfqueue 264 37 0 6 2 1 1 1 0 8 0
pftag 88 9 0 9 1 0 1 1 0 8 0
hfscclass 592 49 0 7 5 3 2 2 0 8 0
hfscintsc 48 62 0 8 3 2 1 1 0 8 0
pfrktable 1344 71 0 5 2 0 2 2 0 8 0
pfrke_plain 160 272 0 26 6 3 3 3 0 8 0
pfosfpen 112 7854 0 714 21 0 21 21 0 8 0
pfosfp 40 4653 0 423 5 0 5 5 0 8 0
tcpcb 560 221 0 7 3 1 2 2 0 8 0
tcpqe 32 1163 0 0 38 38 0 7 0 8 0
sackhl 24 3213 0 0 1641 1641 0 1 0 8 0
syncache 264 62 0 0 33 33 0 1 0 8 0
rtentry 112 40755 0 42 1079 1076 3 16 0 8 0
plcache 128 40 0 40 2 0 2 2 0 8 0
plimitpl 152 1177 0 24 4 3 1 2 0 8 0
inpcbpl 288 3224 0 17 5 3 2 3 0 8 0
arp 56 40682 0 20 518 516 2 8 0 8 0
pfsync 72 416 0 0 1 1 0 1 0 8 0

###########################################

IFACE LIVELOCKS SIZE ALIVE LWM HWM CWM
System 0 256 10300 1114
2048 71 32
2112 10093 1176
9216 34 5
lo0
ix0 2050 256 10 256 256
ix1 2050 256 10 256 256
bge0 2048 34 17 512 34
9032 17 17 256 17
bge1 2048 23 17 512 23
9032 17 17 256 17
enc0
trunk0
vlan3202
vlan3203
vlan4027
carp1
carp2
carp3
carp4
pfsync0
pflog0

--
Cordialement,
Pierre BARDOU


-----Message d'origine-----
De : BARDOU Pierre
Envoyé : mardi 27 février 2018 13:52
À : misc@openbsd.org
Objet : RE: Queuing faster than 4 Gbps

Hello,

I reached this conclusion like Stuart says : if I configure a bandwidth above 4G, like for instance 5000000000, pfctl says "number too big".
I checked in parse.y, the limit is UINT_MAX.

If I use 5G instead, it parses OK, but pfctl -sq shows another number. I guess 5000000000 - UINT_MAX.

By the way, with this hardware (dmesg below) I can only get around 2.5 Gbps of firewalled traffic (around 350 kpps)...
If you have some tuning advices to pump that up, that would be great.
I only tuned ifq.maxlen to 8192 and qlimit to the same value.


OpenBSD 6.2 (GENERIC.MP) #5: Fri Feb 2 23:02:19 CET 2018
root@syspatch-62-amd64.openbsd.org:/usr/src/sys/arch/amd64/compile/GENERIC.MP
real mem = 4108201984 (3917MB)
avail mem = 3976663040 (3792MB)
mpath0 at root
scsibus0 at mpath0: 256 targets
mainbus0 at root
bios0 at mainbus0: SMBIOS rev. 2.8 @ 0xb7fcb000 (82 entries)
bios0: vendor HP version "P80" date 04/02/2015
bios0: HP ProLiant DL320e Gen8 v2
acpi0 at bios0: rev 2
acpi0: sleep states S0 S4 S5
acpi0: tables DSDT FACP SPCR MCFG HPET FFFF SPMI ERST APIC FFFF BERT HEST DMAR FFFF SSDT SSDT SSDT SSDT SSDT
acpi0: wakeup devices PCI0(S4)
acpitimer0 at acpi0: 3579545 Hz, 24 bits
acpimcfg0 at acpi0 addr 0xb8000000, bus 0-63
acpihpet0 at acpi0: 14318179 Hz
acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
cpu0 at mainbus0: apid 0 (boot processor)
cpu0: Intel(R) Xeon(R) CPU E3-1271 v3 @ 3.60GHz, 3592.17 MHz
cpu0: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,PERF,ITSC,FSGSBASE,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,SENSOR,ARAT
cpu0: 256KB 64b/line 8-way L2 cache
cpu0: TSC frequency 3592174860 Hz
cpu0: smt 0, core 0, package 0
mtrr: Pentium Pro MTRR support, 10 var ranges, 88 fixed ranges
cpu0: apic clock running at 99MHz
cpu0: mwait min=64, max=64, C-substates=0.2.1.2.4, IBE
cpu1 at mainbus0: apid 2 (application processor)
cpu1: Intel(R) Xeon(R) CPU E3-1271 v3 @ 3.60GHz, 3591.68 MHz
cpu1: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,PERF,ITSC,FSGSBASE,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,SENSOR,ARAT
cpu1: 256KB 64b/line 8-way L2 cache
cpu1: smt 0, core 1, package 0
cpu2 at mainbus0: apid 4 (application processor)
cpu2: Intel(R) Xeon(R) CPU E3-1271 v3 @ 3.60GHz, 3591.68 MHz
cpu2: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,PERF,ITSC,FSGSBASE,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,SENSOR,ARAT
cpu2: 256KB 64b/line 8-way L2 cache
cpu2: smt 0, core 2, package 0
cpu3 at mainbus0: apid 6 (application processor)
cpu3: Intel(R) Xeon(R) CPU E3-1271 v3 @ 3.60GHz, 3591.68 MHz
cpu3: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,PERF,ITSC,FSGSBASE,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,SENSOR,ARAT
cpu3: 256KB 64b/line 8-way L2 cache
cpu3: smt 0, core 3, package 0
ioapic0 at mainbus0: apid 8 pa 0xfec00000, version 20, 24 pins , remapped to apid 8
acpiprt0 at acpi0: bus 10 (IPT1)
acpiprt1 at acpi0: bus -1 (IPT2)
acpiprt2 at acpi0: bus -1 (IPT3)
acpiprt3 at acpi0: bus -1 (IPT4)
acpiprt4 at acpi0: bus -1 (IPT5)
acpiprt5 at acpi0: bus 3 (IPT6)
acpiprt6 at acpi0: bus -1 (IPT7)
acpiprt7 at acpi0: bus 1 (IPT8)
acpiprt8 at acpi0: bus 4 (PT02)
acpiprt9 at acpi0: bus 7 (PT03)
acpiprt10 at acpi0: bus 2 (PT04)
acpiprt11 at acpi0: bus 0 (PCI0)
acpicpu0 at acpi0: C1(1000@1 mwait.1)
acpicpu1 at acpi0: C1(1000@1 mwait.1)
acpicpu2 at acpi0: C1(1000@1 mwait.1)
acpicpu3 at acpi0: C1(1000@1 mwait.1)
acpitz0 at acpi0: critical temperature is 31 degC "IPI0001" at acpi0 not configured "PNP0A06" at acpi0 not configured "PNP0F13" at acpi0 not configured "ACPI000D" at acpi0 not configured ipmi at mainbus0 not configured
pci0 at mainbus0 bus 0
pchb0 at pci0 dev 0 function 0 "Intel Xeon E3-1200 v3 Host" rev 0x06
ppb0 at pci0 dev 1 function 0 "Intel Core 4G PCIE" rev 0x06: msi
pci1 at ppb0 bus 4
ciss0 at pci1 dev 0 function 0 "Hewlett-Packard Smart Array" rev 0x01: apic 8 int 16
ciss0: 1 LD, HW rev 1, FW 6.64/6.64, 64bit fifo rro
scsibus1 at ciss0: 1 targets
sd0 at scsibus1 targ 0 lun 0: <HP, LOGICAL VOLUME, 6.64> SCSI3 0/direct fixed
sd0: 139979MB, 512 bytes/sector, 286677120 sectors
ppb1 at pci0 dev 1 function 1 "Intel Core 4G PCIE" rev 0x06: msi
pci2 at ppb1 bus 7
ix0 at pci2 dev 0 function 0 "Intel 82599" rev 0x01: msi, address 00:11:0a:67:9e:ec
ix1 at pci2 dev 0 function 1 "Intel 82599" rev 0x01: msi, address 00:11:0a:67:9e:ed
ppb2 at pci0 dev 1 function 2 "Intel Core 4G PCIE" rev 0x06: msi
pci3 at ppb2 bus 2
unknown vendor 0x1590 product 0x005f (class memory subclass miscellaneous, rev 0x00) at pci3 dev 0 function 0 not configured
xhci0 at pci0 dev 20 function 0 "Intel 8 Series xHCI" rev 0x04: msi
usb0 at xhci0: USB revision 3.0
uhub0 at usb0 configuration 1 interface 0 "Intel xHCI root hub" rev 3.00/1.00 addr 1
ehci0 at pci0 dev 26 function 0 "Intel 8 Series USB" rev 0x04: apic 8 int 21
usb1 at ehci0: USB revision 2.0
uhub1 at usb1 configuration 1 interface 0 "Intel EHCI root hub" rev 2.00/1.00 addr 1
ppb3 at pci0 dev 28 function 0 "Intel 8 Series PCIE" rev 0xd4
pci4 at ppb3 bus 10
ppb4 at pci0 dev 28 function 5 "Intel 8 Series PCIE" rev 0xd4
pci5 at ppb4 bus 3
bge0 at pci5 dev 0 function 0 "Broadcom BCM5720" rev 0x00, BCM5720 A0 (0x5720000), APE firmware NCSI 1.3.7.0: msi, address 50:65:f3:f0:9d:58
brgphy0 at bge0 phy 1: BCM5720C 10/100/1000baseT PHY, rev. 0
bge1 at pci5 dev 0 function 1 "Broadcom BCM5720" rev 0x00, BCM5720 A0 (0x5720000), APE firmware NCSI 1.3.7.0: msi, address 50:65:f3:f0:9d:59
brgphy1 at bge1 phy 2: BCM5720C 10/100/1000baseT PHY, rev. 0
ppb5 at pci0 dev 28 function 7 "Intel 8 Series PCIE" rev 0xd4
pci6 at ppb5 bus 1
"Hewlett-Packard iLO3 Slave" rev 0x05 at pci6 dev 0 function 0 not configured
vga1 at pci6 dev 0 function 1 "Matrox MGA G200eH" rev 0x00
wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation)
wsdisplay0: screen 1-5 added (80x25, vt100 emulation) "Hewlett-Packard iLO3 Management" rev 0x05 at pci6 dev 0 function 2 not configured
uhci0 at pci6 dev 0 function 4 "Hewlett-Packard USB" rev 0x02: apic 8 int 16
usb2 at uhci0: USB revision 1.0
uhub2 at usb2 configuration 1 interface 0 "Hewlett-Packard UHCI root hub" rev 1.00/1.00 addr 1
ehci1 at pci0 dev 29 function 0 "Intel 8 Series USB" rev 0x04: apic 8 int 20
usb3 at ehci1: USB revision 2.0
uhub3 at usb3 configuration 1 interface 0 "Intel EHCI root hub" rev 2.00/1.00 addr 1
pcib0 at pci0 dev 31 function 0 "Intel C222 LPC" rev 0x04 "Intel 8 Series RAID" rev 0x04 at pci0 dev 31 function 2 not configured
isa0 at pcib0
isadma0 at isa0
com1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifo
com1: probed fifo depth: 0 bytes
pckbc0 at isa0 port 0x60/5 irq 1 irq 12
pckbd0 at pckbc0 (kbd slot)
wskbd0 at pckbd0: console keyboard, using wsdisplay0
pcppi0 at isa0 port 0x61
spkr0 at pcppi0
vmm0 at mainbus0: VMX/EPT
uhub4 at uhub0 port 3 configuration 1 interface 0 "Standard Microsystems product 0x2660" rev 2.00/8.01 addr 2
uhub5 at uhub1 port 1 configuration 1 interface 0 "Intel Rate Matching Hub" rev 2.00/0.04 addr 2
uhub6 at uhub3 port 1 configuration 1 interface 0 "Intel Rate Matching Hub" rev 2.00/0.04 addr 2
uhidev0 at uhub2 port 1 configuration 1 interface 0 "BMC Virtual Keyboard" rev 1.10/0.02 addr 2
uhidev0: iclass 3/1
ukbd0 at uhidev0: 8 variable keys, 6 key codes, country code 33
wskbd1 at ukbd0 mux 1
wskbd1: connecting to wsdisplay0
uhidev1 at uhub2 port 1 configuration 1 interface 1 "BMC Virtual Keyboard" rev 1.10/0.02 addr 2
uhidev1: iclass 3/1
ums0 at uhidev1: 3 buttons
wsmouse0 at ums0 mux 0
vscsi0 at root
scsibus2 at vscsi0: 256 targets
softraid0 at root
scsibus3 at softraid0: 256 targets
root on sd0a (e4426d30edab0280.a) swap on sd0b dump on sd0b
--
Cordialement,
Pierre BARDOU

-----Message d'origine-----
De : Peter N. M. Hansteen [mailto:peter@bsdly.net] Envoyé : lundi 26 février 2018 18:43 À : misc@openbsd.org Objet : Re: Queuing faster than 4 Gbps

On 02/26/18 17:50, BARDOU Pierre wrote:
> Hello,
>
> I'm trying to use queuing on a 10 Gbps interface.
> I remind of a conversation on tech@ or misc@ which was about queuing values being stored in a UINT which prevented configuring values > 4 Gbps.
> I can't find it in the mailing list archive logs though. Wasn't the discussion about using long integers and so remove this limitation ?

If I remember correctly, the bandwidth values were 32-bit in ALTQ, effectively limiting the upper bandwidth value to something like what you suggest. The current queueing code is quite different in most respects.

> As of today current, it seem to be still present. Any plans to upgrade this in the (near) future ?

I'm a bit curious as to how you reached this conclusion. You're hitting one or more limits in your environment, but how do you identify which one?

--
Peter N. M. Hansteen, member of the first RFC 1149 implementation team http://bsdly.blogspot.com/ http://www.bsdly.net/ http://www.nuug.no/ "Remember to set the evil bit on all malicious network traffic"
delilah spamd[29949]: 85.152.224.147: disconnected after 42673 seconds.