Menu

Show posts

This section allows you to view all posts made by this member. Note that you can only see posts made in areas you currently have access to.

Show posts Menu

Messages - Mynetworkinglife

#1
High availability / Re: Wierd CARP issue
January 21, 2021, 02:20:46 AM
issue solved by following this guide from vmware

https://kb.vmware.com/s/article/59235

#2
High availability / Wierd CARP issue
January 20, 2021, 12:32:44 PM
Hi All,

i have 2 virtual OpnSense 20.7.8 boxes running in esxi.

when using carp, both boxes in the gui display backup for their status for the carp addresses


running clog -f /var/log/system.log on both boxes reveals the following
on box 1

Jan 20 22:17:59 AuDiOpnSFW-01 opnsense[68751]: /usr/local/etc/rc.filter_synchronize: Filter sync successfully completed with https://10.99.99.253/xmlrpc.php.                                                               
Jan 20 22:19:01 AuDiOpnSFW-01 configctl[60170]: event @ 1611141540.64 msg: Jan 20 22:19:00 AuDiOpnSFW-01.di.local config[60044]: config-event: new_config /co                                                                nf/backup/config-1611141540.6393.xml
Jan 20 22:19:01 AuDiOpnSFW-01 configctl[60170]: event @ 1611141540.64 exec: system event config_changed
Jan 20 22:19:02 AuDiOpnSFW-01 kernel: vmx6: promiscuous mode enabled
Jan 20 22:19:02 AuDiOpnSFW-01 kernel: carp: 12@vmx6: INIT -> BACKUP (initialization complete)
Jan 20 22:19:02 AuDiOpnSFW-01 opnsense[91487]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed t                                                                he state "BACKUP" for vhid 12
Jan 20 22:19:03 AuDiOpnSFW-01 kernel: pflog0: promiscuous mode disabled
Jan 20 22:19:03 AuDiOpnSFW-01 kernel: pflog0: promiscuous mode enabled
Jan 20 22:19:05 AuDiOpnSFW-01 kernel: carp: 12@vmx6: BACKUP -> MASTER (master timed out)
Jan 20 22:19:05 AuDiOpnSFW-01 kernel: carp: 12@vmx6: MASTER -> BACKUP (more frequent advertisement received)
Jan 20 22:19:05 AuDiOpnSFW-01 kernel: vmx6: deletion failed: 3
Jan 20 22:19:05 AuDiOpnSFW-01 opnsense[27329]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed t                                                                he state "MASTER" for vhid 12
Jan 20 22:19:05 AuDiOpnSFW-01 opnsense[58664]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed t                                                                he state "BACKUP" for vhid 12
Jan 20 22:19:08 AuDiOpnSFW-01 kernel: carp: 12@vmx6: BACKUP -> MASTER (master timed out)
Jan 20 22:19:08 AuDiOpnSFW-01 kernel: carp: 12@vmx6: MASTER -> BACKUP (more frequent advertisement received)
Jan 20 22:19:08 AuDiOpnSFW-01 kernel: vmx6: deletion failed: 3
Jan 20 22:19:08 AuDiOpnSFW-01 opnsense[58221]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed t                                                                he state "MASTER" for vhid 12
Jan 20 22:19:08 AuDiOpnSFW-01 opnsense[28837]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed t                                                                he state "BACKUP" for vhid 12
Jan 20 22:19:11 AuDiOpnSFW-01 kernel: carp: 12@vmx6: BACKUP -> MASTER (master timed out)
Jan 20 22:19:11 AuDiOpnSFW-01 kernel: carp: 12@vmx6: MASTER -> BACKUP (more frequent advertisement received)
Jan 20 22:19:11 AuDiOpnSFW-01 kernel: vmx6: deletion failed: 3
Jan 20 22:19:11 AuDiOpnSFW-01 opnsense[64058]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed t                                                                he state "MASTER" for vhid 12
Jan 20 22:19:11 AuDiOpnSFW-01 opnsense[97110]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed t                                                                he state "BACKUP" for vhid 12
Jan 20 22:19:14 AuDiOpnSFW-01 kernel: carp: 12@vmx6: BACKUP -> MASTER (master timed out)
Jan 20 22:19:14 AuDiOpnSFW-01 kernel: carp: 12@vmx6: MASTER -> BACKUP (more frequent advertisement received)
Jan 20 22:19:14 AuDiOpnSFW-01 kernel: vmx6: deletion failed: 3
Jan 20 22:19:14 AuDiOpnSFW-01 opnsense[27298]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed t                                                                he state "MASTER" for vhid 12
Jan 20 22:19:14 AuDiOpnSFW-01 opnsense[77062]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed t                                                                he state "BACKUP" for vhid 12
Jan 20 22:19:17 AuDiOpnSFW-01 kernel: carp: 12@vmx6: BACKUP -> MASTER (master timed out)
Jan 20 22:19:17 AuDiOpnSFW-01 kernel: carp: 12@vmx6: MASTER -> BACKUP (more frequent advertisement received)
Jan 20 22:19:17 AuDiOpnSFW-01 kernel: vmx6: deletion failed: 3
Jan 20 22:19:17 AuDiOpnSFW-01 opnsense[30615]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed t                                                                he state "MASTER" for vhid 12
Jan 20 22:19:17 AuDiOpnSFW-01 opnsense[91508]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed t                                                                he state "BACKUP" for vhid 12
Jan 20 22:19:20 AuDiOpnSFW-01 kernel: carp: 12@vmx6: BACKUP -> MASTER (master timed out)
Jan 20 22:19:20 AuDiOpnSFW-01 kernel: carp: 12@vmx6: MASTER -> BACKUP (more frequent advertisement received)
Jan 20 22:19:20 AuDiOpnSFW-01 kernel: vmx6: deletion failed: 3
Jan 20 22:19:20 AuDiOpnSFW-01 opnsense[50819]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed t                                                                he state "MASTER" for vhid 12
Jan 20 22:19:20 AuDiOpnSFW-01 opnsense[81340]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed t                                                                he state "BACKUP" for vhid 12
Jan 20 22:19:23 AuDiOpnSFW-01 kernel: carp: 12@vmx6: BACKUP -> MASTER (master timed out)
Jan 20 22:19:23 AuDiOpnSFW-01 kernel: carp: 12@vmx6: MASTER -> BACKUP (more frequent advertisement received)
Jan 20 22:19:23 AuDiOpnSFW-01 kernel: vmx6: deletion failed: 3
Jan 20 22:19:23 AuDiOpnSFW-01 opnsense[96466]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed t                                                                he state "MASTER" for vhid 12
Jan 20 22:19:23 AuDiOpnSFW-01 opnsense[19799]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed t                                                                he state "BACKUP" for vhid 12
Jan 20 22:19:26 AuDiOpnSFW-01 kernel: carp: 12@vmx6: BACKUP -> MASTER (master timed out)
Jan 20 22:19:26 AuDiOpnSFW-01 kernel: carp: 12@vmx6: MASTER -> BACKUP (more frequent advertisement received)
Jan 20 22:19:26 AuDiOpnSFW-01 kernel: vmx6: deletion failed: 3
Jan 20 22:19:26 AuDiOpnSFW-01 opnsense[68103]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed t                                                                he state "MASTER" for vhid 12
Jan 20 22:19:26 AuDiOpnSFW-01 opnsense[18003]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed t                                                                he state "BACKUP" for vhid 12
Jan 20 22:19:29 AuDiOpnSFW-01 kernel: carp: 12@vmx6: BACKUP -> MASTER (master timed out)
Jan 20 22:19:29 AuDiOpnSFW-01 kernel: carp: 12@vmx6: MASTER -> BACKUP (more frequent advertisement received)
Jan 20 22:19:29 AuDiOpnSFW-01 kernel: vmx6: deletion failed: 3
Jan 20 22:19:29 AuDiOpnSFW-01 opnsense[55439]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed t                                                                he state "MASTER" for vhid 12
Jan 20 22:19:30 AuDiOpnSFW-01 opnsense[80675]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed t                                                                he state "BACKUP" for vhid 12
Jan 20 22:19:32 AuDiOpnSFW-01 kernel: carp: 12@vmx6: BACKUP -> MASTER (master timed out)
Jan 20 22:19:32 AuDiOpnSFW-01 kernel: carp: 12@vmx6: MASTER -> BACKUP (more frequent advertisement received)
Jan 20 22:19:32 AuDiOpnSFW-01 kernel: vmx6: deletion failed: 3
Jan 20 22:19:32 AuDiOpnSFW-01 opnsense[21843]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed t                                                                he state "MASTER" for vhid 12
Jan 20 22:19:33 AuDiOpnSFW-01 opnsense[65993]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed t                                                                he state "BACKUP" for vhid 12
Jan 20 22:19:35 AuDiOpnSFW-01 kernel: carp: 12@vmx6: BACKUP -> MASTER (master timed out)
Jan 20 22:19:35 AuDiOpnSFW-01 kernel: carp: 12@vmx6: MASTER -> BACKUP (more frequent advertisement received)
Jan 20 22:19:35 AuDiOpnSFW-01 kernel: vmx6: deletion failed: 3
Jan 20 22:19:35 AuDiOpnSFW-01 opnsense[31583]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed t                                                                he state "MASTER" for vhid 12
Jan 20 22:19:36 AuDiOpnSFW-01 opnsense[79813]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed t                                                                he state "BACKUP" for vhid 12
Jan 20 22:19:38 AuDiOpnSFW-01 kernel: carp: 12@vmx6: BACKUP -> MASTER (master timed out)
Jan 20 22:19:38 AuDiOpnSFW-01 kernel: carp: 12@vmx6: MASTER -> BACKUP (more frequent advertisement received)
Jan 20 22:19:38 AuDiOpnSFW-01 kernel: vmx6: deletion failed: 3
Jan 20 22:19:38 AuDiOpnSFW-01 opnsense[28325]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed t                                                                he state "MASTER" for vhid 12
Jan 20 22:19:39 AuDiOpnSFW-01 opnsense[84109]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed t                                                                he state "BACKUP" for vhid 12
Jan 20 22:19:40 AuDiOpnSFW-01 configctl[60170]: event @ 1611141579.76 msg: Jan 20 22:19:39 AuDiOpnSFW-01.di.local config[60044]: config-event: new_config /co                                                                nf/backup/config-1611141579.7594.xml
Jan 20 22:19:40 AuDiOpnSFW-01 configctl[60170]: event @ 1611141579.76 exec: system event config_changed
Jan 20 22:19:41 AuDiOpnSFW-01 kernel: carp: 12@vmx6: BACKUP -> MASTER (master timed out)
Jan 20 22:19:41 AuDiOpnSFW-01 kernel: carp: 12@vmx6: MASTER -> BACKUP (more frequent advertisement received)
Jan 20 22:19:41 AuDiOpnSFW-01 kernel: vmx6: deletion failed: 3
Jan 20 22:19:41 AuDiOpnSFW-01 opnsense[48703]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed t                                                                he state "MASTER" for vhid 12
Jan 20 22:19:42 AuDiOpnSFW-01 opnsense[71558]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed t                                                                he state "BACKUP" for vhid 12
Jan 20 22:19:42 AuDiOpnSFW-01 kernel: carp: 13@vmx6: INIT -> BACKUP (initialization complete)
Jan 20 22:19:42 AuDiOpnSFW-01 opnsense[44679]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.254 - VOIP .254 (13@vmx6)" has resum                                                                ed the state "BACKUP" for vhid 13
Jan 20 22:19:43 AuDiOpnSFW-01 kernel: pflog0: promiscuous mode disabled
Jan 20 22:19:43 AuDiOpnSFW-01 kernel: pflog0: promiscuous mode enabled
Jan 20 22:19:44 AuDiOpnSFW-01 kernel: carp: 12@vmx6: BACKUP -> MASTER (master timed out)
Jan 20 22:19:44 AuDiOpnSFW-01 kernel: carp: 12@vmx6: MASTER -> BACKUP (more frequent advertisement received)
Jan 20 22:19:44 AuDiOpnSFW-01 kernel: vmx6: deletion failed: 3
Jan 20 22:19:45 AuDiOpnSFW-01 opnsense[33535]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed t                                                                he state "MASTER" for vhid 12
Jan 20 22:19:45 AuDiOpnSFW-01 opnsense[87370]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed t                                                                he state "BACKUP" for vhid 12
Jan 20 22:19:45 AuDiOpnSFW-01 kernel: carp: 13@vmx6: BACKUP -> MASTER (master timed out)
Jan 20 22:19:45 AuDiOpnSFW-01 kernel: carp: 13@vmx6: MASTER -> BACKUP (more frequent advertisement received)
Jan 20 22:19:45 AuDiOpnSFW-01 kernel: vmx6: deletion failed: 3
Jan 20 22:19:45 AuDiOpnSFW-01 opnsense[13285]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.254 - VOIP .254 (13@vmx6)" has resum                                                                ed the state "MASTER" for vhid 13
Jan 20 22:19:46 AuDiOpnSFW-01 opnsense[63099]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.254 - VOIP .254 (13@vmx6)" has resum                                                                ed the state "BACKUP" for vhid 13
Jan 20 22:19:47 AuDiOpnSFW-01 kernel: carp: 12@vmx6: BACKUP -> MASTER (master timed out)
Jan 20 22:19:47 AuDiOpnSFW-01 kernel: carp: 12@vmx6: MASTER -> BACKUP (more frequent advertisement received)
Jan 20 22:19:47 AuDiOpnSFW-01 kernel: vmx6: deletion failed: 3
Jan 20 22:19:48 AuDiOpnSFW-01 opnsense[20921]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed the state "MASTER" for vhid 12
Jan 20 22:19:48 AuDiOpnSFW-01 opnsense[69583]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed the state "BACKUP" for vhid 12
Jan 20 22:19:48 AuDiOpnSFW-01 kernel: carp: 13@vmx6: BACKUP -> MASTER (master timed out)
Jan 20 22:19:48 AuDiOpnSFW-01 kernel: carp: 13@vmx6: MASTER -> BACKUP (more frequent advertisement received)
Jan 20 22:19:48 AuDiOpnSFW-01 kernel: vmx6: deletion failed: 3
Jan 20 22:19:49 AuDiOpnSFW-01 opnsense[3198]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.254 - VOIP .254 (13@vmx6)" has resumed the state "MASTER" for vhid 13
Jan 20 22:19:49 AuDiOpnSFW-01 opnsense[40065]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.254 - VOIP .254 (13@vmx6)" has resumed the state "BACKUP" for vhid 13
Jan 20 22:19:50 AuDiOpnSFW-01 kernel: carp: 12@vmx6: BACKUP -> MASTER (master timed out)
Jan 20 22:19:50 AuDiOpnSFW-01 kernel: carp: 12@vmx6: MASTER -> BACKUP (more frequent advertisement received)
Jan 20 22:19:50 AuDiOpnSFW-01 kernel: vmx6: deletion failed: 3
Jan 20 22:19:51 AuDiOpnSFW-01 opnsense[79736]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed the state "MASTER" for vhid 12
Jan 20 22:19:51 AuDiOpnSFW-01 opnsense[26139]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed the state "BACKUP" for vhid 12
Jan 20 22:19:51 AuDiOpnSFW-01 kernel: carp: 13@vmx6: BACKUP -> MASTER (master timed out)
Jan 20 22:19:51 AuDiOpnSFW-01 kernel: carp: 13@vmx6: MASTER -> BACKUP (more frequent advertisement received)
Jan 20 22:19:51 AuDiOpnSFW-01 kernel: vmx6: deletion failed: 3
Jan 20 22:19:52 AuDiOpnSFW-01 opnsense[59942]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.254 - VOIP .254 (13@vmx6)" has resumed the state "MASTER" for vhid 13
Jan 20 22:19:52 AuDiOpnSFW-01 opnsense[9755]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.254 - VOIP .254 (13@vmx6)" has resumed the state "BACKUP" for vhid 13
Jan 20 22:19:53 AuDiOpnSFW-01 kernel: carp: 12@vmx6: BACKUP -> MASTER (master timed out)
Jan 20 22:19:53 AuDiOpnSFW-01 kernel: carp: 12@vmx6: MASTER -> BACKUP (more frequent advertisement received)
Jan 20 22:19:53 AuDiOpnSFW-01 kernel: vmx6: deletion failed: 3
Jan 20 22:19:53 AuDiOpnSFW-01 opnsense[82625]: /usr/local/etc/rc.filter_synchronize: Filter sync successfully completed with https://10.99.99.253/xmlrpc.php.                                                               
Jan 20 22:19:54 AuDiOpnSFW-01 opnsense[50747]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed the state "MASTER" for vhid 12
Jan 20 22:19:54 AuDiOpnSFW-01 opnsense[97087]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed the state "BACKUP" for vhid 12
Jan 20 22:19:54 AuDiOpnSFW-01 kernel: carp: 13@vmx6: BACKUP -> MASTER (master timed out)
Jan 20 22:19:54 AuDiOpnSFW-01 kernel: carp: 13@vmx6: MASTER -> BACKUP (more frequent advertisement received)
Jan 20 22:19:54 AuDiOpnSFW-01 kernel: vmx6: deletion failed: 3
Jan 20 22:19:55 AuDiOpnSFW-01 opnsense[19560]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.254 - VOIP .254 (13@vmx6)" has resumed the state "MASTER" for vhid 13
Jan 20 22:19:55 AuDiOpnSFW-01 opnsense[63657]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.254 - VOIP .254 (13@vmx6)" has resumed the state "BACKUP" for vhid 13
Jan 20 22:19:57 AuDiOpnSFW-01 kernel: carp: 12@vmx6: BACKUP -> MASTER (master timed out)
Jan 20 22:19:57 AuDiOpnSFW-01 kernel: carp: 12@vmx6: MASTER -> BACKUP (more frequent advertisement received)
Jan 20 22:19:57 AuDiOpnSFW-01 kernel: vmx6: deletion failed: 3
Jan 20 22:19:57 AuDiOpnSFW-01 opnsense[91455]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed the state "MASTER" for vhid 12
Jan 20 22:19:57 AuDiOpnSFW-01 opnsense[43404]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed the state "BACKUP" for vhid 12
Jan 20 22:19:57 AuDiOpnSFW-01 kernel: carp: 13@vmx6: BACKUP -> MASTER (master timed out)
Jan 20 22:19:57 AuDiOpnSFW-01 kernel: carp: 13@vmx6: MASTER -> BACKUP (more frequent advertisement received)
Jan 20 22:19:57 AuDiOpnSFW-01 kernel: vmx6: deletion failed: 3
Jan 20 22:19:58 AuDiOpnSFW-01 opnsense[91563]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.254 - VOIP .254 (13@vmx6)" has resumed the state "MASTER" for vhid 13
Jan 20 22:19:58 AuDiOpnSFW-01 opnsense[15047]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.254 - VOIP .254 (13@vmx6)" has resumed the state "BACKUP" for vhid 13
Jan 20 22:20:00 AuDiOpnSFW-01 kernel: carp: 12@vmx6: BACKUP -> MASTER (master timed out)
Jan 20 22:20:00 AuDiOpnSFW-01 kernel: carp: 12@vmx6: MASTER -> BACKUP (more frequent advertisement received)
Jan 20 22:20:00 AuDiOpnSFW-01 kernel: vmx6: deletion failed: 3
Jan 20 22:20:00 AuDiOpnSFW-01 opnsense[65054]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed the state "MASTER" for vhid 12
Jan 20 22:20:00 AuDiOpnSFW-01 opnsense[91121]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed the state "BACKUP" for vhid 12
Jan 20 22:20:00 AuDiOpnSFW-01 kernel: carp: 13@vmx6: BACKUP -> MASTER (master timed out)
Jan 20 22:20:00 AuDiOpnSFW-01 kernel: carp: 13@vmx6: MASTER -> BACKUP (more frequent advertisement received)
Jan 20 22:20:00 AuDiOpnSFW-01 kernel: vmx6: deletion failed: 3
Jan 20 22:20:01 AuDiOpnSFW-01 opnsense[42116]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.254 - VOIP .254 (13@vmx6)" has resumed the state "MASTER" for vhid 13
Jan 20 22:20:01 AuDiOpnSFW-01 opnsense[94865]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.254 - VOIP .254 (13@vmx6)" has resumed the state "BACKUP" for vhid 13
Jan 20 22:20:03 AuDiOpnSFW-01 kernel: carp: 12@vmx6: BACKUP -> MASTER (master timed out)
Jan 20 22:20:03 AuDiOpnSFW-01 kernel: carp: 12@vmx6: MASTER -> BACKUP (more frequent advertisement received)
Jan 20 22:20:03 AuDiOpnSFW-01 kernel: vmx6: deletion failed: 3
Jan 20 22:20:03 AuDiOpnSFW-01 opnsense[36807]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed the state "MASTER" for vhid 12
Jan 20 22:20:03 AuDiOpnSFW-01 opnsense[75643]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed the state "BACKUP" for vhid 12
Jan 20 22:20:03 AuDiOpnSFW-01 kernel: carp: 13@vmx6: BACKUP -> MASTER (master timed out)
Jan 20 22:20:03 AuDiOpnSFW-01 kernel: carp: 13@vmx6: MASTER -> BACKUP (more frequent advertisement received)
Jan 20 22:20:03 AuDiOpnSFW-01 kernel: vmx6: deletion failed: 3
Jan 20 22:20:04 AuDiOpnSFW-01 opnsense[21538]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.254 - VOIP .254 (13@vmx6)" has resumed the state "MASTER" for vhid 13
Jan 20 22:20:04 AuDiOpnSFW-01 opnsense[68095]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.254 - VOIP .254 (13@vmx6)" has resumed the state "BACKUP" for vhid 13
Jan 20 22:20:06 AuDiOpnSFW-01 kernel: carp: 12@vmx6: BACKUP -> MASTER (master timed out)
Jan 20 22:20:06 AuDiOpnSFW-01 kernel: carp: 12@vmx6: MASTER -> BACKUP (more frequent advertisement received)
Jan 20 22:20:06 AuDiOpnSFW-01 kernel: vmx6: deletion failed: 3



on box 2
Jan 20 22:19:47 AuDiOpnSFW-02 kernel: vmx6: promiscuous mode enabled
Jan 20 22:19:47 AuDiOpnSFW-02 kernel: carp: 12@vmx6: INIT -> BACKUP (initialization complete)
Jan 20 22:19:47 AuDiOpnSFW-02 kernel: carp: 13@vmx6: INIT -> BACKUP (initialization complete)
Jan 20 22:19:47 AuDiOpnSFW-02 kernel: carp: demoted by 240 to 240 (pfsync bulk start)
Jan 20 22:19:47 AuDiOpnSFW-02 opnsense[13005]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed the state "BACKUP" for vhid 12
Jan 20 22:19:47 AuDiOpnSFW-02 opnsense[13005]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Resyncing OpenVPN instances for interface 10.8.12.1 - VOIP .1.
Jan 20 22:19:47 AuDiOpnSFW-02 opnsense[79354]: /xmlrpc.php: ROUTING: entering configure using defaults
Jan 20 22:19:47 AuDiOpnSFW-02 opnsense[79354]: /xmlrpc.php: ROUTING: IPv4 default gateway set to wan
Jan 20 22:19:47 AuDiOpnSFW-02 opnsense[79354]: /xmlrpc.php: ROUTING: setting IPv4 default route to 10.20.25.79
Jan 20 22:19:47 AuDiOpnSFW-02 opnsense[79354]: /xmlrpc.php: ROUTING: keeping current default gateway '10.20.25.79'
Jan 20 22:19:47 AuDiOpnSFW-02 opnsense[79354]: /xmlrpc.php: ROUTING: IPv6 default gateway set to wan
Jan 20 22:19:47 AuDiOpnSFW-02 opnsense[79354]: /xmlrpc.php: ROUTING: setting IPv6 default route to fe80::b6de:31ff:feb5:ae40
Jan 20 22:19:47 AuDiOpnSFW-02 opnsense[79354]: /xmlrpc.php: ROUTING: keeping current default gateway 'fe80::b6de:31ff:feb5:ae40%vmx5'
Jan 20 22:19:47 AuDiOpnSFW-02 opnsense[67882]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.254 - VOIP .254 (13@vmx6)" has resumed the state "BACKUP" for vhid 13
Jan 20 22:19:47 AuDiOpnSFW-02 kernel: carp: demoted by -240 to 0 (pfsync bulk done)
Jan 20 22:19:47 AuDiOpnSFW-02 opnsense[67882]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Resyncing OpenVPN instances for interface 10.8.12.254 - VOIP .254.
Jan 20 22:19:47 AuDiOpnSFW-02 opnsense[79354]: plugins_configure monitor ()
Jan 20 22:19:47 AuDiOpnSFW-02 opnsense[79354]: plugins_configure monitor (execute task : dpinger_configure_do())
Jan 20 22:19:47 AuDiOpnSFW-02 opnsense[79354]: /xmlrpc.php: The WAN_DHCP6 monitor address is empty, skipping.
Jan 20 22:19:47 AuDiOpnSFW-02 opnsense[79354]: /xmlrpc.php: The WAN_PPPOE monitor address is empty, skipping.
Jan 20 22:19:47 AuDiOpnSFW-02 configctl[58786]: event @ 1611141587.39 msg: Jan 20 22:19:47 AuDiOpnSFW-02.di.local config[79354]: config-event: new_config /conf/backup/config-1611141587.3895.xml
Jan 20 22:19:47 AuDiOpnSFW-02 configctl[58786]: event @ 1611141587.39 exec: system event config_changed
Jan 20 22:19:48 AuDiOpnSFW-02 opnsense[79354]: plugins_configure hosts ()
Jan 20 22:19:48 AuDiOpnSFW-02 kernel: pflog0: promiscuous mode disabled
Jan 20 22:19:48 AuDiOpnSFW-02 kernel: pflog0: promiscuous mode enabled
Jan 20 22:19:48 AuDiOpnSFW-02 opnsense[79354]: plugins_configure hosts (execute task : dnsmasq_hosts_generate())
Jan 20 22:19:48 AuDiOpnSFW-02 opnsense[79354]: plugins_configure hosts (execute task : unbound_hosts_generate())
Jan 20 22:19:52 AuDiOpnSFW-02 opnsense[79354]: plugins_configure dhcp ()
Jan 20 22:19:52 AuDiOpnSFW-02 opnsense[79354]: plugins_configure dhcp (execute task : dhcpd_dhcp_configure())
Jan 20 22:19:52 AuDiOpnSFW-02 opnsense[79354]: /xmlrpc.php: Warning! dhcpd_radvd_configure(auto) found no suitable IPv6 address on vmx2
Jan 20 22:19:53 AuDiOpnSFW-02 opnsense[79354]: plugins_configure dns ()
Jan 20 22:19:53 AuDiOpnSFW-02 opnsense[79354]: plugins_configure dns (execute task : dnsmasq_configure_do())
Jan 20 22:19:53 AuDiOpnSFW-02 opnsense[79354]: plugins_configure dns (execute task : unbound_configure_do())
Jan 20 22:19:53 AuDiOpnSFW-02 opnsense[79354]: plugins_configure remote ()
Jan 20 22:19:53 AuDiOpnSFW-02 opnsense[79354]: plugins_configure remote (execute task : openvpn_configure_do())
Jan 20 22:19:53 AuDiOpnSFW-02 opnsense[79354]: /xmlrpc.php: Resyncing OpenVPN instances.

i have no openvpn instances defined.

does anyone have any suggestions? i have even built 2 new vms and reconfigured both vms to match my configuration to no avail