dpinger fails to restart after a PPPoE link recycle

[cpw]

Hi
I have an annoyingly unreliable DSL/PPPoE link to upstream. It loses signal fairly regularly and needs to reauthenticate and rebuild the interface.

DPinger does NOT like this. Every time, since about the 23.7 series, I have to manually restart the dpinger processes (ipv4 and ipv6 monitors) monitoring the status of the link. The link itself comes back very reliably - a blessing I suppose - but dpinger is convinced its dead. I have previously solved this by monitoring the dpinger processes - but those don't seem to actually terminate anymore, just the monitoring.

Log file:

Code Select Expand


2024-01-05T16:52:27-05:00 Notice dpinger ALERT: DSL_DHCP6 (Addr: 2607:xxxx Alarm: down -> none RTT: 11.6 ms RTTd: 3.2 ms Loss: 0.0 %)
2024-01-05T16:52:15-05:00 Notice dpinger ALERT: DSL_PPPOE (Addr: 206.x.x.x Alarm: down -> none RTT: 11.5 ms RTTd: 1.3 ms Loss: 0.0 %)
2024-01-05T16:52:15-05:00 Notice dpinger Reloaded gateway watcher configuration on SIGHUP
2024-01-05T16:52:15-05:00 Notice dpinger Reloaded gateway watcher configuration on SIGHUP
2024-01-05T16:52:14-05:00 Warning dpinger send_interval 1000ms loss_interval 4000ms time_period 60000ms report_interval 0ms data_len 0 alert_interval 1000ms latency_alarm 0ms loss_alarm 0% alarm_hold 10000ms dest_addr 2607:xxxx bind_addr 2607:x:x:x:x identifier "DSL_DHCP6 "
2024-01-05T16:52:14-05:00 Warning dpinger exiting on signal 15
2024-01-05T16:52:05-05:00 Warning dpinger send_interval 1000ms loss_interval 4000ms time_period 60000ms report_interval 0ms data_len 0 alert_interval 1000ms latency_alarm 0ms loss_alarm 0% alarm_hold 10000ms dest_addr 206.x.x.x bind_addr 69.x.x.x identifier "DSL_PPPOE "
2024-01-05T16:52:05-05:00 Warning dpinger exiting on signal 15
2024-01-05T16:20:58-05:00 Notice dpinger Reloaded gateway watcher configuration on SIGHUP
2024-01-05T16:20:57-05:00 Warning dpinger exiting on signal 15
2024-01-05T16:20:37-05:00 Notice dpinger Reloaded gateway watcher configuration on SIGHUP
2024-01-05T16:20:37-05:00 Warning dpinger send_interval 1000ms loss_interval 4000ms time_period 60000ms report_interval 0ms data_len 0 alert_interval 1000ms latency_alarm 0ms loss_alarm 0% alarm_hold 10000ms dest_addr 206.x.x.x bind_addr 69.x.x.x identifier "DSL_PPPOE "
2024-01-05T16:20:37-05:00 Warning dpinger exiting on signal 15
2024-01-05T16:20:36-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:20:35-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:20:35-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:20:34-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:20:34-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:20:33-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:20:33-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:20:32-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:20:32-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:20:31-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:20:31-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:20:30-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:20:30-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:20:29-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:20:29-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:20:28-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:20:28-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:20:27-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:20:27-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:20:26-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:20:26-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:20:25-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:20:25-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:20:24-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:20:24-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:20:23-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:20:23-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:20:22-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:20:22-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:20:21-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:20:21-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:20:20-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:20:20-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:20:19-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:20:19-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:20:18-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:20:18-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:20:17-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:20:17-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:20:16-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:20:16-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:20:15-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:20:15-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:20:14-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:20:14-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:20:13-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:20:13-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:20:12-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:20:12-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:20:11-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:20:11-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:20:10-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:20:10-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:20:09-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:20:09-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:20:08-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:20:08-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:20:07-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:20:07-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:20:06-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:20:06-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:20:05-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:20:05-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:20:04-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:20:04-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:20:03-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:20:03-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:20:02-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:20:02-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:20:01-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:20:01-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:20:00-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:20:00-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:19:59-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:19:59-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:19:58-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:19:58-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:19:57-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:19:57-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:19:56-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:19:56-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:19:55-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:19:55-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:19:54-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:19:54-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:19:53-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:19:53-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:19:52-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:19:52-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:19:51-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:19:51-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:19:50-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:19:50-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:19:49-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:19:49-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:19:48-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:19:48-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:19:47-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:19:47-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:19:46-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:19:45-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:19:45-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:19:44-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:19:44-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:19:43-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:19:43-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:19:42-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:19:42-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:19:41-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:19:41-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:19:40-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:19:40-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:19:39-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:19:39-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:19:38-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:19:38-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:19:37-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:19:37-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:19:36-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:19:36-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:19:35-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:19:35-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:19:34-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:19:34-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:19:33-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:19:33-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:19:32-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:19:32-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:19:31-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:19:31-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:19:30-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:19:30-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:19:29-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:19:29-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:19:28-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:19:28-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:19:27-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:19:27-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:19:26-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:19:26-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:19:25-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:19:25-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:19:24-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:19:24-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:19:23-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:19:23-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:19:22-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:19:22-05:00 Warning dpinger DSL_DHCP6 2607:xxxx: sendto error: 50
2024-01-05T16:19:21-05:00 Warning dpinger DSL_PPPOE 206.x.x.x: sendto error: 50
2024-01-05T16:18:39-05:00 Notice dpinger ALERT: DSL_PPPOE (Addr: 206.x.x.x Alarm: loss -> down RTT: 11.2 ms RTTd: 0.9 ms Loss: 33.0 %)
2024-01-05T16:18:39-05:00 Notice dpinger ALERT: DSL_DHCP6 (Addr: 2607:xxxx Alarm: loss -> down RTT: 10.6 ms RTTd: 0.2 ms Loss: 32.0 %)
2024-01-05T16:18:28-05:00 Notice dpinger ALERT: DSL_PPPOE (Addr: 206.x.x.x Alarm: none -> loss RTT: 11.3 ms RTTd: 1.6 ms Loss: 12.0 %)
2024-01-05T16:18:28-05:00 Notice dpinger MONITOR: DSL_DHCP6 (Addr: 2607:xxxx Alarm: none -> loss RTT: 10.6 ms RTTd: 0.2 ms Loss: 12.0 %)
2024-01-05T13:05:42-05:00 Notice dpinger ALERT: DSL_PPPOE (Addr: 206.x.x.x Alarm: down -> none RTT: 10.6 ms RTTd: 0.1 ms Loss: 0.0 %)
2024-01-05T13:05:42-05:00 Notice dpinger ALERT: DSL_DHCP6 (Addr: 2607:xxxx Alarm: down -> none RTT: 10.7 ms RTTd: 0.2 ms Loss: 0.0 %)



At 16:19 the DSL link went down and recycled - it came up at 16:20:36 - right before both dpinger processes died. Except they were still running - monit failed to detect that they had changed state at all.

It seems that dpinger is wedging somehow. How would I go about debugging this situation - I'm pretty sure I can cause this problem fairly easily by just unplugging the phone cable from the DSL modem, but I don't know how to debug. I have "debugging" turned on in the log file but nothing shows up.

[Nigloo]

Hello,

I have same problem with 40 FW and Multi WAN (principal link  FTTx and second link rescue 4G)
The ISP interupt PPPoE session in the nigth (for a link maintenance on FTTx) and after that link is up the gateway is always down.
I have to restart the gateway manually.
Otherwise the principal gateway never goes back to up.

Did you find a solution for you please ?

Best regards.

PS : Our version Business 24.4.2