Messages

Same problem but with a different GPON stick (LEOX LXT-010S-H).
Did you find any solution?

Pie works on the latest version now, great job Franco!

Everything fine so far, did not get to test pie again due to xmas movies 😂

Next year maybe!

I cant revert to fq_pie atm, as i need this to run somewhat stable.
But i will give this a shot next week and see if i can get any more info out of it.

I do have multiple wg interfaces assigned without any problems, can you try getting rid of these OpenVPN interfaces and checking then?

The error you posted seems somewhat odd.

Check MTU and MSS.

This does not look particulary non standard to me, besides the custom values for some codel parameters.
Im running a somewhat similar setup.

Weird, maybe Franco or someone else can figure out whats going on here.
Can you monitor CPU Usage during the shaping?

Maybe the overhead increased for some reason and the appliance / host is not capable of dealing with this stress.

Yup, it should!

I did the following:
1) Disable shared forwarding
2) Switch to dev.
3) Upgrade the kernel locally with no ethernet cables attached just to make sure (should not be needed)
4) Re-Enable shared forwarding after the new kernel is installed and active (reboot)
5) Success

Try locally upgrading to https://forum.opnsense.org/index.php?topic=25541.msg122782#msg122782.

Transfer the files starting with kernel-22.1.b1_57 from here: https://pkg.opnsense.org/FreeBSD:13:amd64/snapshots/sets/ to an usb stick, mount it on the machine and then run:

Code Select Expand

opnsense-update -zkr 22.1.b1_57 -l /mnt/<your usb stick mount point>/

Might be unrelated to the driver after all, worth a try.
Alternatively you can disable shared forwarding in the advanced firewall settings (this is fixed with the aforementioned kernel update)

If this still happens after this, grab the contents of /var/crash and upload them here.

Try reproducing it on this kernel first:

https://forum.opnsense.org/index.php?topic=25541.msg122782#msg122782

fq_codel works fine for me on a quad core machine with RSS enabled.
Imma spot for oddities, the only thing completely broken is fq_pie, it crashes my machine.

How did you configure the shaper?

Mine is shaping downstream from ~400 Mbit/s to 380 Mbit/s (real world: 365 Mbit/s) and upstream 210 Mbit/s to 195 Mbit/s (real world: 186 Mbit/s)

[Though: there is an new kernel panic with the fq_pie module if traffic shaping is configured to use it]

@Franco
This seems to work now after updating the kernel and enabling the shared forwarding again, great job!

Though: there is an new kernel panic with the fq_pie module if traffic shaping is configured to use it

Code Select Expand

db:0:kdb.enter.default>  bt
Tracing pid 12 tid 100040 td 0xfffffe00205e6ac0
kdb_enter() at kdb_enter+0x37/frame 0xfffffe00c61b4a20
vpanic() at vpanic+0x1b8/frame 0xfffffe00c61b4a80
panic() at panic+0x43/frame 0xfffffe00c61b4ae0
trap_fatal() at trap_fatal+0x387/frame 0xfffffe00c61b4b40
trap_pfault() at trap_pfault+0x4f/frame 0xfffffe00c61b4ba0
trap() at trap+0x26a/frame 0xfffffe00c61b4cb0
calltrap() at calltrap+0x8/frame 0xfffffe00c61b4cb0
--- trap 0xc, rip = 0xffffffff827a5b59, rsp = 0xfffffe00c61b4d80, rbp = 0xfffffe00c61b4da0 ---
fqpie_callout_cleanup() at fqpie_callout_cleanup+0x59/frame 0xfffffe00c61b4da0
softclock_call_cc() at softclock_call_cc+0x155/frame 0xfffffe00c61b4e40
softclock() at softclock+0x79/frame 0xfffffe00c61b4e60
ithread_loop() at ithread_loop+0x25a/frame 0xfffffe00c61b4ef0
fork_exit() at fork_exit+0x8a/frame 0xfffffe00c61b4f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00c61b4f30
--- trap 0x82557fe0, rip = 0xffffffff80c4944f, rsp = 0, rbp = 0x2554000 ---
mi_startup() at mi_startup+0xdf/frame 0x2554000
db:0:kdb.enter.default>  ps

If you need the textdump hit me up.

Traffic shaper settings:

This should be it: https://github.com/opnsense/src/commit/730eb40ce9

You can try the snapshot kernel like so:

# opnsense-update -zkr 22.1.b1_57

Isn't the Odroid using the 2.5G Realteks? Are you using the os-realtek-re plugin for that?

Thanks for testing the beta!


Cheers,
Franco

Thanks for looking into this.
Imma try to update later tonight and see if its fixed.

Yeah i have to use the vendor kmod from the package! (RTL8125B)
The interfaces worked fine from the start but the shared forwarding panic caused it to somehow reboot into a "plain" freebsd (changed boot logo) right after. This did not have the kmod loaded which killed the interface assignments from the config. So thats probably sth that should be noted. Could have been a fluke but maybe some recovery logic needs to be adjusted.

Thanks again!

Hey there,

the test-upgrade worked fine but as soon as the network interfaces get some traffic the system crashes.

Code Select Expand

Fatal trap 12: page fault while in kernel mode
cpuid = 0; apic id = 00
fault virtual address = 0x4
fault code = supervisor read data, page not present
instruction pointer = 0x20:0xffffffff80e74823
stack pointer         = 0x0:0xfffffe00c6179cb0
frame pointer         = 0x0:0xfffffe00c6179d60
code segment = base 0x0, limit 0xfffff, type 0x1b
= DPL 0, pres 1, long 1, def32 0, gran 1
processor eflags = interrupt enabled, resume, IOPL = 0
current process = 12 (swi1: netisr 0)
trap number = 12
panic: page fault
cpuid = 0
time = 1636661506
KDB: stack backtrace:
db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00c6179950
vpanic() at vpanic+0x187/frame 0xfffffe00c61799b0
panic() at panic+0x43/frame 0xfffffe00c6179a10
trap_fatal() at trap_fatal+0x387/frame 0xfffffe00c6179a70
trap_pfault() at trap_pfault+0x4f/frame 0xfffffe00c6179ad0
trap() at trap+0x26a/frame 0xfffffe00c6179be0
calltrap() at calltrap+0x8/frame 0xfffffe00c6179be0
--- trap 0xc, rip = 0xffffffff80e74823, rsp = 0xfffffe00c6179cb0, rbp = 0xfffffe00c6179d60 ---
ip_tryforward() at ip_tryforward+0x213/frame 0xfffffe00c6179d60
ip_input() at ip_input+0x382/frame 0xfffffe00c6179df0
swi_net() at swi_net+0x12b/frame 0xfffffe00c6179e60
ithread_loop() at ithread_loop+0x25a/frame 0xfffffe00c6179ef0
fork_exit() at fork_exit+0x8a/frame 0xfffffe00c6179f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00c6179f30
--- trap 0x80386000, rip = 0xffffffff80c4944f, rsp = 0, rbp = 0x2475000 ---
mi_startup() at mi_startup+0xdf/frame 0x2475000
KDB: enter: panic

Was the realtek-vendor-kmod if_re.ko compiled with the correct kernel sources or is there any incompatible changes?
If i use any other usb network interface it works just fine.
Nevermind it just happened with an USB network interface too, something else must be broken here.

I first though its related to me having RSS enabled but i disabled the sysctl in the config.xml and it still happens.

The textdump.tar file is attached to this post.

HWPROBE for 22.1 on odroid-h2+: https://bsd-hardware.info/?probe=9268d91d01

Edit: Beware, this happens when trying to switch to the development version aka 22.1, it alters the url incorrectly.

Hey there, not sure how and why this happened but i just wanted to report it, in case it happens to someone else.

Code Select Expand

pkg-static: Error parsing: '/usr/local/etc/pkg/repos//OPNsense.conf': error while parsing <unknown>: line: 3, column: 55 - 'unexpected newline', character: '0x0a'

Code Select Expand


OPNsense: {
  fingerprints: "/usr/local/etc/pkg/fingerprints/OPNsense",
  url: "pkg+https://pkg.opnsense.org/${ABI}/21.7/latest
  signature_type: "fingerprints",
  mirror_type: "srv",
  priority: 11,
  enabled: yes
}


Its obviously missing an

Code Select Expand

", but im not sure if that happened bcs i searched for updates and then switched to Development before installing 21.7.5.