NTP stopped after WAN went down briefly

Started by 134, August 27, 2021, 03:03:46 PM

Previous topic - Next topic
I restarted the ISP-provided modem (in bridge mode), Opnsense then get new WAN address as usual but NTP daemon stopped permanently and could not be manually started unless I have to reboot the firewall.

My guess is that it was listening on an interface that track WAN for IPv6 address, and somehow WAN going down caused this.

Here's the full log:


2021-08-27T00:36:15 ntpd[70683] daemon child exited with code 1
2021-08-27T00:36:15 ntpd[91311] unable to bind to wildcard address :: - another process may be running - EXITING
2021-08-27T00:36:15 ntpd[91311] restrict: 'monitor' cannot be disabled while 'limited' is enabled
2021-08-27T00:36:15 ntpd[91311] gps base set to 2021-07-11 (week 2166)
2021-08-27T00:36:15 ntpd[91311] basedate set to 2021-07-10
2021-08-27T00:36:15 ntpd[91311] proto: precision = 0.134 usec (-23)
2021-08-27T00:36:15 ntpd[70683] ----------------------------------------------------
2021-08-27T00:36:15 ntpd[70683] available at https://www.nwtime.org/support
2021-08-27T00:36:15 ntpd[70683] corporation. Support and training for ntp-4 are
2021-08-27T00:36:15 ntpd[70683] Inc. (NTF), a non-profit 501(c)(3) public-benefit
2021-08-27T00:36:15 ntpd[70683] ntp-4 is maintained by Network Time Foundation,
2021-08-27T00:36:15 ntpd[70683] ----------------------------------------------------
2021-08-27T00:36:15 ntpd[70683] Command line: /usr/local/sbin/ntpd -g -c /var/etc/ntpd.conf -p /var/run/ntpd.pid
2021-08-27T00:36:15 ntpd[70683] ntpd 4.2.8p15@1.3728-o Thu Jul 22 12:42:44 UTC 2021 (1): Starting
2021-08-27T00:36:06 ntpd[27532] daemon child exited with code 1
2021-08-27T00:36:06 ntpd[39687] unable to bind to wildcard address :: - another process may be running - EXITING
2021-08-27T00:36:06 ntpd[39687] restrict: 'monitor' cannot be disabled while 'limited' is enabled
2021-08-27T00:36:06 ntpd[39687] gps base set to 2021-07-11 (week 2166)
2021-08-27T00:36:06 ntpd[39687] basedate set to 2021-07-10
2021-08-27T00:36:06 ntpd[39687] proto: precision = 0.134 usec (-23)
2021-08-27T00:36:06 ntpd[39687] proto: precision = 0.134 usec (-23)
2021-08-27T00:36:06 ntpd[27532] ----------------------------------------------------
2021-08-27T00:36:06 ntpd[27532] available at https://www.nwtime.org/support
2021-08-27T00:36:06 ntpd[27532] corporation. Support and training for ntp-4 are
2021-08-27T00:36:06 ntpd[27532] Inc. (NTF), a non-profit 501(c)(3) public-benefit
2021-08-27T00:36:06 ntpd[27532] ntp-4 is maintained by Network Time Foundation,
2021-08-27T00:36:06 ntpd[27532] ----------------------------------------------------
2021-08-27T00:36:06 ntpd[27532] Command line: /usr/local/sbin/ntpd -g -c /var/etc/ntpd.conf -p /var/run/ntpd.pid
2021-08-27T00:36:06 ntpd[27532] ntpd 4.2.8p15@1.3728-o Thu Jul 22 12:42:44 UTC 2021 (1): Starting
2021-08-27T00:35:49 ntpd[70489] daemon child exited with code 1
2021-08-27T00:35:49 ntpd[81772] unable to bind to wildcard address :: - another process may be running - EXITING
2021-08-27T00:35:49 ntpd[81772] restrict: 'monitor' cannot be disabled while 'limited' is enabled
2021-08-27T00:35:49 ntpd[81772] gps base set to 2021-07-11 (week 2166)
2021-08-27T00:35:49 ntpd[81772] basedate set to 2021-07-10
2021-08-27T00:35:49 ntpd[81772] proto: precision = 0.136 usec (-23)
2021-08-27T00:35:49 ntpd[70489] ----------------------------------------------------
2021-08-27T00:35:49 ntpd[70489] available at https://www.nwtime.org/support
2021-08-27T00:35:49 ntpd[70489] corporation. Support and training for ntp-4 are
2021-08-27T00:35:49 ntpd[70489] Inc. (NTF), a non-profit 501(c)(3) public-benefit
2021-08-27T00:35:49 ntpd[70489] ntp-4 is maintained by Network Time Foundation,
2021-08-27T00:35:49 ntpd[70489] ----------------------------------------------------
2021-08-27T00:35:49 ntpd[70489] Command line: /usr/local/sbin/ntpd -g -c /var/etc/ntpd.conf -p /var/run/ntpd.pid
2021-08-27T00:35:49 ntpd[70489] ntpd 4.2.8p15@1.3728-o Thu Jul 22 12:42:44 UTC 2021 (1): Starting
2021-08-27T00:35:34 ntpd[76094] daemon child exited with code 1
2021-08-27T00:35:34 ntpd[88905] unable to bind to wildcard address :: - another process may be running - EXITING
2021-08-27T00:35:34 ntpd[88905] restrict: 'monitor' cannot be disabled while 'limited' is enabled
2021-08-27T00:35:34 ntpd[88905] gps base set to 2021-07-11 (week 2166)
2021-08-27T00:35:34 ntpd[88905] basedate set to 2021-07-10
2021-08-27T00:35:34 ntpd[88905] proto: precision = 0.134 usec (-23)
2021-08-27T00:35:34 ntpd[76094] ----------------------------------------------------
2021-08-27T00:35:34 ntpd[76094] available at https://www.nwtime.org/support
2021-08-27T00:35:34 ntpd[76094] corporation. Support and training for ntp-4 are
2021-08-27T00:35:34 ntpd[76094] Inc. (NTF), a non-profit 501(c)(3) public-benefit
2021-08-27T00:35:34 ntpd[76094] ntp-4 is maintained by Network Time Foundation,
2021-08-27T00:35:34 ntpd[76094] ----------------------------------------------------
2021-08-27T00:35:34 ntpd[76094] Command line: /usr/local/sbin/ntpd -g -c /var/etc/ntpd.conf -p /var/run/ntpd.pid
2021-08-27T00:35:34 ntpd[76094] ntpd 4.2.8p15@1.3728-o Thu Jul 22 12:42:44 UTC 2021 (1): Starting
2021-08-27T00:35:34 ntpd[27324] daemon child exited with code 1
2021-08-27T00:35:34 ntpd[59351] unable to bind to wildcard address :: - another process may be running - EXITING
2021-08-27T00:35:34 ntpd[59351] restrict: 'monitor' cannot be disabled while 'limited' is enabled
2021-08-27T00:35:34 ntpd[59351] gps base set to 2021-07-11 (week 2166)
2021-08-27T00:35:34 ntpd[59351] basedate set to 2021-07-10
2021-08-27T00:35:34 ntpd[59351] proto: precision = 0.135 usec (-23)
2021-08-27T00:35:34 ntpd[38070] kernel reports TIME_ERROR: 0x2041: Clock Unsynchronized
2021-08-27T00:35:34 ntpd[38070] kernel reports TIME_ERROR: 0x2041: Clock Unsynchronized
2021-08-27T00:35:34 ntpd[38070] Listening on routing socket on fd #43 for interface updates
2021-08-27T00:35:34 ntpd[38070] Listen normally on 22 ix0_vlan99 10.0.99.1:123
2021-08-27T00:35:34 ntpd[38070] Listen normally on 21 ix0_vlan99 [fe80::3333:44ff:fe55:6666%19]:123
2021-08-27T00:35:34 ntpd[38070] Listen normally on 20 ix0_vlan98 10.0.98.1:123
2021-08-27T00:35:34 ntpd[38070] Listen normally on 19 ix0_vlan98 [fe80::3333:44ff:fe55:6666%18]:123
2021-08-27T00:35:34 ntpd[38070] Listen normally on 18 ix0_vlan60 10.0.60.1:123
2021-08-27T00:35:34 ntpd[38070] Listen normally on 17 ix0_vlan60 [fe80::3333:44ff:fe55:6666%17]:123
2021-08-27T00:35:34 ntpd[38070] Listen normally on 16 ix0_vlan40 10.0.40.1:123
2021-08-27T00:35:34 ntpd[38070] Listen normally on 15 ix0_vlan40 [fe80::3333:44ff:fe55:6666%15]:123
2021-08-27T00:35:34 ntpd[38070] Listen normally on 14 ix0_vlan30 10.0.30.1:123
2021-08-27T00:35:34 ntpd[38070] Listen normally on 13 ix0_vlan30 [fe80::3333:44ff:fe55:6666%14]:123
2021-08-27T00:35:34 ntpd[38070] Listen normally on 12 ix0_vlan20 10.0.20.1:123
2021-08-27T00:35:34 ntpd[38070] Listen normally on 11 ix0_vlan20 [fe80::3333:44ff:fe55:6666%13]:123
2021-08-27T00:35:34 ntpd[38070] Listen normally on 10 ix0_vlan10 [2001:ee0:4161:a5ce:3333:44ff:fe55:6666]:123
2021-08-27T00:35:34 ntpd[38070] Listen normally on 9 ix0_vlan10 10.0.10.1:123
2021-08-27T00:35:34 ntpd[38070] Listen normally on 8 ix0_vlan10 [fe80::3333:44ff:fe55:6666%12]:123
2021-08-27T00:35:34 ntpd[38070] Listen normally on 7 ix0_vlan9 10.0.9.1:123
2021-08-27T00:35:34 ntpd[38070] Listen normally on 6 ix0_vlan9 [fe80::3333:44ff:fe55:6666%11]:123
2021-08-27T00:35:34 ntpd[38070] Listen normally on 5 lo0 127.0.0.1:123
2021-08-27T00:35:34 ntpd[38070] Listen normally on 4 lo0 [::1]:123
2021-08-27T00:35:34 ntpd[38070] Listen normally on 3 ix2 [fe80::aaaa:bbff:fecc:dddd%5]:123
2021-08-27T00:35:34 ntpd[27324] ----------------------------------------------------
2021-08-27T00:35:34 ntpd[27324] available at https://www.nwtime.org/support
2021-08-27T00:35:34 ntpd[27324] corporation. Support and training for ntp-4 are
2021-08-27T00:35:34 ntpd[27324] Inc. (NTF), a non-profit 501(c)(3) public-benefit
2021-08-27T00:35:34 ntpd[27324] ntp-4 is maintained by Network Time Foundation,
2021-08-27T00:35:34 ntpd[27324] ----------------------------------------------------
2021-08-27T00:35:34 ntpd[27324] Command line: /usr/local/sbin/ntpd -g -c /var/etc/ntpd.conf -p /var/run/ntpd.pid
2021-08-27T00:35:34 ntpd[27324] ntpd 4.2.8p15@1.3728-o Thu Jul 22 12:42:44 UTC 2021 (1): Starting
2021-08-27T00:35:34 ntpd[38070] Listen normally on 2 ix2 192.168.1.1:123
2021-08-27T00:35:34 ntpd[38070] Listen and drop on 1 v4wildcard 0.0.0.0:123
2021-08-27T00:35:34 ntpd[38070] Listen and drop on 0 v6wildcard [::]:123
2021-08-27T00:35:34 ntpd[38070] restrict: 'monitor' cannot be disabled while 'limited' is enabled
2021-08-27T00:35:34 ntpd[38070] gps base set to 2021-07-11 (week 2166)
2021-08-27T00:35:34 ntpd[38070] basedate set to 2021-07-10
2021-08-27T00:35:34 ntpd[38070] proto: precision = 0.135 usec (-23)
2021-08-27T00:35:34 ntpd[19683] ----------------------------------------------------
2021-08-27T00:35:34 ntpd[19683] available at https://www.nwtime.org/support
2021-08-27T00:35:34 ntpd[19683] corporation. Support and training for ntp-4 are
2021-08-27T00:35:34 ntpd[19683] Inc. (NTF), a non-profit 501(c)(3) public-benefit
2021-08-27T00:35:34 ntpd[19683] ntp-4 is maintained by Network Time Foundation,
2021-08-27T00:35:34 ntpd[19683] ----------------------------------------------------
2021-08-27T00:35:34 ntpd[19683] Command line: /usr/local/sbin/ntpd -g -c /var/etc/ntpd.conf -p /var/run/ntpd.pid
2021-08-27T00:35:34 ntpd[19683] ntpd 4.2.8p15@1.3728-o Thu Jul 22 12:42:44 UTC 2021 (1): Starting
2021-08-27T00:35:30 ntpd[51659] 20.43.94.199 local addr 192.168.1.1 -> <null>
2021-08-27T00:35:30 ntpd[51659] 17.253.68.125 local addr 192.168.1.1 -> <null>
2021-08-27T00:35:30 ntpd[51659] 2606:4700:f1::1 local addr 2001:ee0:4161:a5ce:3333:44ff:fe55:6666 -> <null>
2021-08-27T00:35:30 ntpd[51659] 2001:4860:4806:4:: local addr 2001:ee0:4161:a5ce:3333:44ff:fe55:6666 -> <null>
2021-08-27T00:35:30 ntpd[51659] ntpd exiting on signal 15 (Terminated)
2021-08-27T00:35:23 ntpd[51659] kernel reports TIME_ERROR: 0x2041: Clock Unsynchronized
2021-08-27T00:35:23 ntpd[51659] kernel reports TIME_ERROR: 0x2041: Clock Unsynchronized
2021-08-27T00:35:23 ntpd[51659] Listening on routing socket on fd #43 for interface updates
2021-08-27T00:35:23 ntpd[51659] Listen normally on 22 ix0_vlan99 10.0.99.1:123
2021-08-27T00:35:23 ntpd[51659] Listen normally on 21 ix0_vlan99 [fe80::3333:44ff:fe55:6666%19]:123
2021-08-27T00:35:23 ntpd[51659] Listen normally on 20 ix0_vlan98 10.0.98.1:123
2021-08-27T00:35:23 ntpd[51659] Listen normally on 19 ix0_vlan98 [fe80::3333:44ff:fe55:6666%18]:123
2021-08-27T00:35:23 ntpd[51659] Listen normally on 18 ix0_vlan60 10.0.60.1:123
2021-08-27T00:35:23 ntpd[51659] Listen normally on 17 ix0_vlan60 [fe80::3333:44ff:fe55:6666%17]:123
2021-08-27T00:35:23 ntpd[51659] Listen normally on 16 ix0_vlan40 10.0.40.1:123
2021-08-27T00:35:23 ntpd[51659] Listen normally on 15 ix0_vlan40 [fe80::3333:44ff:fe55:6666%15]:123
2021-08-27T00:35:23 ntpd[51659] Listen normally on 14 ix0_vlan30 10.0.30.1:123
2021-08-27T00:35:23 ntpd[51659] Listen normally on 13 ix0_vlan30 [fe80::3333:44ff:fe55:6666%14]:123
2021-08-27T00:35:23 ntpd[51659] Listen normally on 12 ix0_vlan20 10.0.20.1:123
2021-08-27T00:35:23 ntpd[51659] Listen normally on 11 ix0_vlan20 [fe80::3333:44ff:fe55:6666%13]:123
2021-08-27T00:35:23 ntpd[51659] Listen normally on 10 ix0_vlan10 [2001:ee0:4161:a5ce:3333:44ff:fe55:6666]:123
2021-08-27T00:35:23 ntpd[51659] Listen normally on 9 ix0_vlan10 10.0.10.1:123
2021-08-27T00:35:23 ntpd[51659] Listen normally on 8 ix0_vlan10 [fe80::3333:44ff:fe55:6666%12]:123
2021-08-27T00:35:23 ntpd[51659] Listen normally on 7 ix0_vlan9 10.0.9.1:123
2021-08-27T00:35:23 ntpd[51659] Listen normally on 6 ix0_vlan9 [fe80::3333:44ff:fe55:6666%11]:123
2021-08-27T00:35:23 ntpd[51659] Listen normally on 5 lo0 127.0.0.1:123
2021-08-27T00:35:23 ntpd[51659] Listen normally on 4 lo0 [::1]:123
2021-08-27T00:35:23 ntpd[51659] Listen normally on 3 ix2 [fe80::aaaa:bbff:fecc:dddd%5]:123
2021-08-27T00:35:23 ntpd[51659] Listen normally on 2 ix2 192.168.1.1:123
2021-08-27T00:35:23 ntpd[51659] Listen and drop on 1 v4wildcard 0.0.0.0:123
2021-08-27T00:35:23 ntpd[51659] Listen and drop on 0 v6wildcard [::]:123
2021-08-27T00:35:23 ntpd[51659] restrict: 'monitor' cannot be disabled while 'limited' is enabled
2021-08-27T00:35:23 ntpd[51659] gps base set to 2021-07-11 (week 2166)
2021-08-27T00:35:23 ntpd[51659] basedate set to 2021-07-10
2021-08-27T00:35:23 ntpd[51659] proto: precision = 0.135 usec (-23)
2021-08-27T00:35:23 ntpd[46990] ----------------------------------------------------
2021-08-27T00:35:23 ntpd[46990] available at https://www.nwtime.org/support
2021-08-27T00:35:23 ntpd[46990] corporation. Support and training for ntp-4 are
2021-08-27T00:35:23 ntpd[46990] Inc. (NTF), a non-profit 501(c)(3) public-benefit
2021-08-27T00:35:23 ntpd[46990] ntp-4 is maintained by Network Time Foundation,
2021-08-27T00:35:23 ntpd[46990] ----------------------------------------------------
2021-08-27T00:35:23 ntpd[46990] Command line: /usr/local/sbin/ntpd -g -c /var/etc/ntpd.conf -p /var/run/ntpd.pid
2021-08-27T00:35:23 ntpd[46990] ntpd 4.2.8p15@1.3728-o Thu Jul 22 12:42:44 UTC 2021 (1): Starting
2021-08-27T00:35:23 ntpd[93283] 139.59.112.6 local addr 192.168.1.1 -> <null>
2021-08-27T00:35:23 ntpd[93283] 124.108.20.1 local addr 192.168.1.1 -> <null>
2021-08-27T00:35:23 ntpd[93283] 2001:470:19:301::123 local addr fe80::3333:44ff:fe55:6666%11 -> <null>
2021-08-27T00:35:23 ntpd[93283] 118.143.17.82 local addr 192.168.1.1 -> <null>
2021-08-27T00:35:23 ntpd[93283] 20.189.79.72 local addr 192.168.1.1 -> <null>
2021-08-27T00:35:23 ntpd[93283] 17.253.84.253 local addr 192.168.1.1 -> <null>
2021-08-27T00:35:23 ntpd[93283] 2606:4700:f1::1 local addr fe80::3333:44ff:fe55:6666%11 -> <null>
2021-08-27T00:35:23 ntpd[93283] 2001:4860:4806:4:: local addr fe80::3333:44ff:fe55:6666%11 -> <null>
2021-08-27T00:35:23 ntpd[93283] ntpd exiting on signal 15 (Terminated)
2021-08-27T00:31:09 ntpd[93283] 2001:4860:4806:4:: local addr fe80::3333:44ff:fe55:6666%11 -> <null>
2021-08-27T00:31:09 ntpd[93283] 2606:4700:f1::1 local addr fe80::3333:44ff:fe55:6666%11 -> <null>
2021-08-27T00:31:09 ntpd[93283] 2001:470:19:301::123 local addr fe80::3333:44ff:fe55:6666%11 -> <null>
2021-08-27T00:31:06 ntpd[93283] 17.253.84.253 local addr 10.0.99.1 -> <null>
2021-08-27T00:31:06 ntpd[93283] 20.189.79.72 local addr 10.0.99.1 -> <null>
2021-08-27T00:31:06 ntpd[93283] 118.143.17.82 local addr 10.0.99.1 -> <null>
2021-08-27T00:31:06 ntpd[93283] 124.108.20.1 local addr 10.0.99.1 -> <null>
2021-08-27T00:31:06 ntpd[93283] 139.59.112.6 local addr 10.0.99.1 -> <null>
2021-08-27T00:31:06 ntpd[93283] 2001:4860:4806:4:: local addr 2001:db8:1111:2222:3333:44ff:fe55:6666 -> <null>
2021-08-27T00:31:06 ntpd[93283] 2606:4700:f1::1 local addr 2001:db8:1111:2222:3333:44ff:fe55:6666 -> <null>
2021-08-27T00:31:06 ntpd[93283] 2001:470:19:301::123 local addr 2001:db8:1111:2222:3333:44ff:fe55:6666 -> <null>
2021-08-27T00:31:06 ntpd[93283] Deleting interface #10 ix0_vlan10, 2001:db8:1111:2222:3333:44ff:fe55:6666#123, interface stats: received=5839, sent=5882, dropped=0, active_time=983992 secs

Quote from: 134 on August 27, 2021, 03:03:46 PM


2021-08-27T00:36:15 ntpd[70683] daemon child exited with code 1
2021-08-27T00:36:15 ntpd[91311] unable to bind to wildcard address :: - another process may be running - EXITING


I have the same issue happening. Unfortunately, I do not know how to permanently fix it, as this happens everytime the WAN goes down. The issue is that a second process is running but it is not seen by the GUI. You can check by using
ps ax | grep ntp on the shell.
If you kill that process killall ntpd then you are able to start the ntp from the GUI again and it is recognized as running (icon goes green). There is no reboot required.