OPNsense Forum
English Forums => High availability => Topic started by: Mynetworkinglife on January 20, 2021, 12:32:44 pm
-
Hi All,
i have 2 virtual OpnSense 20.7.8 boxes running in esxi.
when using carp, both boxes in the gui display backup for their status for the carp addresses
running clog -f /var/log/system.log on both boxes reveals the following
on box 1
Jan 20 22:17:59 AuDiOpnSFW-01 opnsense[68751]: /usr/local/etc/rc.filter_synchronize: Filter sync successfully completed with https://10.99.99.253/xmlrpc.php.
Jan 20 22:19:01 AuDiOpnSFW-01 configctl[60170]: event @ 1611141540.64 msg: Jan 20 22:19:00 AuDiOpnSFW-01.di.local config[60044]: config-event: new_config /co nf/backup/config-1611141540.6393.xml
Jan 20 22:19:01 AuDiOpnSFW-01 configctl[60170]: event @ 1611141540.64 exec: system event config_changed
Jan 20 22:19:02 AuDiOpnSFW-01 kernel: vmx6: promiscuous mode enabled
Jan 20 22:19:02 AuDiOpnSFW-01 kernel: carp: 12@vmx6: INIT -> BACKUP (initialization complete)
Jan 20 22:19:02 AuDiOpnSFW-01 opnsense[91487]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed t he state "BACKUP" for vhid 12
Jan 20 22:19:03 AuDiOpnSFW-01 kernel: pflog0: promiscuous mode disabled
Jan 20 22:19:03 AuDiOpnSFW-01 kernel: pflog0: promiscuous mode enabled
Jan 20 22:19:05 AuDiOpnSFW-01 kernel: carp: 12@vmx6: BACKUP -> MASTER (master timed out)
Jan 20 22:19:05 AuDiOpnSFW-01 kernel: carp: 12@vmx6: MASTER -> BACKUP (more frequent advertisement received)
Jan 20 22:19:05 AuDiOpnSFW-01 kernel: vmx6: deletion failed: 3
Jan 20 22:19:05 AuDiOpnSFW-01 opnsense[27329]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed t he state "MASTER" for vhid 12
Jan 20 22:19:05 AuDiOpnSFW-01 opnsense[58664]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed t he state "BACKUP" for vhid 12
Jan 20 22:19:08 AuDiOpnSFW-01 kernel: carp: 12@vmx6: BACKUP -> MASTER (master timed out)
Jan 20 22:19:08 AuDiOpnSFW-01 kernel: carp: 12@vmx6: MASTER -> BACKUP (more frequent advertisement received)
Jan 20 22:19:08 AuDiOpnSFW-01 kernel: vmx6: deletion failed: 3
Jan 20 22:19:08 AuDiOpnSFW-01 opnsense[58221]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed t he state "MASTER" for vhid 12
Jan 20 22:19:08 AuDiOpnSFW-01 opnsense[28837]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed t he state "BACKUP" for vhid 12
Jan 20 22:19:11 AuDiOpnSFW-01 kernel: carp: 12@vmx6: BACKUP -> MASTER (master timed out)
Jan 20 22:19:11 AuDiOpnSFW-01 kernel: carp: 12@vmx6: MASTER -> BACKUP (more frequent advertisement received)
Jan 20 22:19:11 AuDiOpnSFW-01 kernel: vmx6: deletion failed: 3
Jan 20 22:19:11 AuDiOpnSFW-01 opnsense[64058]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed t he state "MASTER" for vhid 12
Jan 20 22:19:11 AuDiOpnSFW-01 opnsense[97110]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed t he state "BACKUP" for vhid 12
Jan 20 22:19:14 AuDiOpnSFW-01 kernel: carp: 12@vmx6: BACKUP -> MASTER (master timed out)
Jan 20 22:19:14 AuDiOpnSFW-01 kernel: carp: 12@vmx6: MASTER -> BACKUP (more frequent advertisement received)
Jan 20 22:19:14 AuDiOpnSFW-01 kernel: vmx6: deletion failed: 3
Jan 20 22:19:14 AuDiOpnSFW-01 opnsense[27298]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed t he state "MASTER" for vhid 12
Jan 20 22:19:14 AuDiOpnSFW-01 opnsense[77062]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed t he state "BACKUP" for vhid 12
Jan 20 22:19:17 AuDiOpnSFW-01 kernel: carp: 12@vmx6: BACKUP -> MASTER (master timed out)
Jan 20 22:19:17 AuDiOpnSFW-01 kernel: carp: 12@vmx6: MASTER -> BACKUP (more frequent advertisement received)
Jan 20 22:19:17 AuDiOpnSFW-01 kernel: vmx6: deletion failed: 3
Jan 20 22:19:17 AuDiOpnSFW-01 opnsense[30615]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed t he state "MASTER" for vhid 12
Jan 20 22:19:17 AuDiOpnSFW-01 opnsense[91508]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed t he state "BACKUP" for vhid 12
Jan 20 22:19:20 AuDiOpnSFW-01 kernel: carp: 12@vmx6: BACKUP -> MASTER (master timed out)
Jan 20 22:19:20 AuDiOpnSFW-01 kernel: carp: 12@vmx6: MASTER -> BACKUP (more frequent advertisement received)
Jan 20 22:19:20 AuDiOpnSFW-01 kernel: vmx6: deletion failed: 3
Jan 20 22:19:20 AuDiOpnSFW-01 opnsense[50819]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed t he state "MASTER" for vhid 12
Jan 20 22:19:20 AuDiOpnSFW-01 opnsense[81340]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed t he state "BACKUP" for vhid 12
Jan 20 22:19:23 AuDiOpnSFW-01 kernel: carp: 12@vmx6: BACKUP -> MASTER (master timed out)
Jan 20 22:19:23 AuDiOpnSFW-01 kernel: carp: 12@vmx6: MASTER -> BACKUP (more frequent advertisement received)
Jan 20 22:19:23 AuDiOpnSFW-01 kernel: vmx6: deletion failed: 3
Jan 20 22:19:23 AuDiOpnSFW-01 opnsense[96466]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed t he state "MASTER" for vhid 12
Jan 20 22:19:23 AuDiOpnSFW-01 opnsense[19799]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed t he state "BACKUP" for vhid 12
Jan 20 22:19:26 AuDiOpnSFW-01 kernel: carp: 12@vmx6: BACKUP -> MASTER (master timed out)
Jan 20 22:19:26 AuDiOpnSFW-01 kernel: carp: 12@vmx6: MASTER -> BACKUP (more frequent advertisement received)
Jan 20 22:19:26 AuDiOpnSFW-01 kernel: vmx6: deletion failed: 3
Jan 20 22:19:26 AuDiOpnSFW-01 opnsense[68103]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed t he state "MASTER" for vhid 12
Jan 20 22:19:26 AuDiOpnSFW-01 opnsense[18003]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed t he state "BACKUP" for vhid 12
Jan 20 22:19:29 AuDiOpnSFW-01 kernel: carp: 12@vmx6: BACKUP -> MASTER (master timed out)
Jan 20 22:19:29 AuDiOpnSFW-01 kernel: carp: 12@vmx6: MASTER -> BACKUP (more frequent advertisement received)
Jan 20 22:19:29 AuDiOpnSFW-01 kernel: vmx6: deletion failed: 3
Jan 20 22:19:29 AuDiOpnSFW-01 opnsense[55439]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed t he state "MASTER" for vhid 12
Jan 20 22:19:30 AuDiOpnSFW-01 opnsense[80675]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed t he state "BACKUP" for vhid 12
Jan 20 22:19:32 AuDiOpnSFW-01 kernel: carp: 12@vmx6: BACKUP -> MASTER (master timed out)
Jan 20 22:19:32 AuDiOpnSFW-01 kernel: carp: 12@vmx6: MASTER -> BACKUP (more frequent advertisement received)
Jan 20 22:19:32 AuDiOpnSFW-01 kernel: vmx6: deletion failed: 3
Jan 20 22:19:32 AuDiOpnSFW-01 opnsense[21843]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed t he state "MASTER" for vhid 12
Jan 20 22:19:33 AuDiOpnSFW-01 opnsense[65993]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed t he state "BACKUP" for vhid 12
Jan 20 22:19:35 AuDiOpnSFW-01 kernel: carp: 12@vmx6: BACKUP -> MASTER (master timed out)
Jan 20 22:19:35 AuDiOpnSFW-01 kernel: carp: 12@vmx6: MASTER -> BACKUP (more frequent advertisement received)
Jan 20 22:19:35 AuDiOpnSFW-01 kernel: vmx6: deletion failed: 3
Jan 20 22:19:35 AuDiOpnSFW-01 opnsense[31583]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed t he state "MASTER" for vhid 12
Jan 20 22:19:36 AuDiOpnSFW-01 opnsense[79813]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed t he state "BACKUP" for vhid 12
Jan 20 22:19:38 AuDiOpnSFW-01 kernel: carp: 12@vmx6: BACKUP -> MASTER (master timed out)
Jan 20 22:19:38 AuDiOpnSFW-01 kernel: carp: 12@vmx6: MASTER -> BACKUP (more frequent advertisement received)
Jan 20 22:19:38 AuDiOpnSFW-01 kernel: vmx6: deletion failed: 3
Jan 20 22:19:38 AuDiOpnSFW-01 opnsense[28325]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed t he state "MASTER" for vhid 12
Jan 20 22:19:39 AuDiOpnSFW-01 opnsense[84109]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed t he state "BACKUP" for vhid 12
Jan 20 22:19:40 AuDiOpnSFW-01 configctl[60170]: event @ 1611141579.76 msg: Jan 20 22:19:39 AuDiOpnSFW-01.di.local config[60044]: config-event: new_config /co nf/backup/config-1611141579.7594.xml
Jan 20 22:19:40 AuDiOpnSFW-01 configctl[60170]: event @ 1611141579.76 exec: system event config_changed
Jan 20 22:19:41 AuDiOpnSFW-01 kernel: carp: 12@vmx6: BACKUP -> MASTER (master timed out)
Jan 20 22:19:41 AuDiOpnSFW-01 kernel: carp: 12@vmx6: MASTER -> BACKUP (more frequent advertisement received)
Jan 20 22:19:41 AuDiOpnSFW-01 kernel: vmx6: deletion failed: 3
Jan 20 22:19:41 AuDiOpnSFW-01 opnsense[48703]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed t he state "MASTER" for vhid 12
Jan 20 22:19:42 AuDiOpnSFW-01 opnsense[71558]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed t he state "BACKUP" for vhid 12
Jan 20 22:19:42 AuDiOpnSFW-01 kernel: carp: 13@vmx6: INIT -> BACKUP (initialization complete)
Jan 20 22:19:42 AuDiOpnSFW-01 opnsense[44679]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.254 - VOIP .254 (13@vmx6)" has resum ed the state "BACKUP" for vhid 13
Jan 20 22:19:43 AuDiOpnSFW-01 kernel: pflog0: promiscuous mode disabled
Jan 20 22:19:43 AuDiOpnSFW-01 kernel: pflog0: promiscuous mode enabled
Jan 20 22:19:44 AuDiOpnSFW-01 kernel: carp: 12@vmx6: BACKUP -> MASTER (master timed out)
Jan 20 22:19:44 AuDiOpnSFW-01 kernel: carp: 12@vmx6: MASTER -> BACKUP (more frequent advertisement received)
Jan 20 22:19:44 AuDiOpnSFW-01 kernel: vmx6: deletion failed: 3
Jan 20 22:19:45 AuDiOpnSFW-01 opnsense[33535]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed t he state "MASTER" for vhid 12
Jan 20 22:19:45 AuDiOpnSFW-01 opnsense[87370]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed t he state "BACKUP" for vhid 12
Jan 20 22:19:45 AuDiOpnSFW-01 kernel: carp: 13@vmx6: BACKUP -> MASTER (master timed out)
Jan 20 22:19:45 AuDiOpnSFW-01 kernel: carp: 13@vmx6: MASTER -> BACKUP (more frequent advertisement received)
Jan 20 22:19:45 AuDiOpnSFW-01 kernel: vmx6: deletion failed: 3
Jan 20 22:19:45 AuDiOpnSFW-01 opnsense[13285]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.254 - VOIP .254 (13@vmx6)" has resum ed the state "MASTER" for vhid 13
Jan 20 22:19:46 AuDiOpnSFW-01 opnsense[63099]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.254 - VOIP .254 (13@vmx6)" has resum ed the state "BACKUP" for vhid 13
Jan 20 22:19:47 AuDiOpnSFW-01 kernel: carp: 12@vmx6: BACKUP -> MASTER (master timed out)
Jan 20 22:19:47 AuDiOpnSFW-01 kernel: carp: 12@vmx6: MASTER -> BACKUP (more frequent advertisement received)
Jan 20 22:19:47 AuDiOpnSFW-01 kernel: vmx6: deletion failed: 3
Jan 20 22:19:48 AuDiOpnSFW-01 opnsense[20921]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed the state "MASTER" for vhid 12
Jan 20 22:19:48 AuDiOpnSFW-01 opnsense[69583]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed the state "BACKUP" for vhid 12
Jan 20 22:19:48 AuDiOpnSFW-01 kernel: carp: 13@vmx6: BACKUP -> MASTER (master timed out)
Jan 20 22:19:48 AuDiOpnSFW-01 kernel: carp: 13@vmx6: MASTER -> BACKUP (more frequent advertisement received)
Jan 20 22:19:48 AuDiOpnSFW-01 kernel: vmx6: deletion failed: 3
Jan 20 22:19:49 AuDiOpnSFW-01 opnsense[3198]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.254 - VOIP .254 (13@vmx6)" has resumed the state "MASTER" for vhid 13
Jan 20 22:19:49 AuDiOpnSFW-01 opnsense[40065]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.254 - VOIP .254 (13@vmx6)" has resumed the state "BACKUP" for vhid 13
Jan 20 22:19:50 AuDiOpnSFW-01 kernel: carp: 12@vmx6: BACKUP -> MASTER (master timed out)
Jan 20 22:19:50 AuDiOpnSFW-01 kernel: carp: 12@vmx6: MASTER -> BACKUP (more frequent advertisement received)
Jan 20 22:19:50 AuDiOpnSFW-01 kernel: vmx6: deletion failed: 3
Jan 20 22:19:51 AuDiOpnSFW-01 opnsense[79736]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed the state "MASTER" for vhid 12
Jan 20 22:19:51 AuDiOpnSFW-01 opnsense[26139]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed the state "BACKUP" for vhid 12
Jan 20 22:19:51 AuDiOpnSFW-01 kernel: carp: 13@vmx6: BACKUP -> MASTER (master timed out)
Jan 20 22:19:51 AuDiOpnSFW-01 kernel: carp: 13@vmx6: MASTER -> BACKUP (more frequent advertisement received)
Jan 20 22:19:51 AuDiOpnSFW-01 kernel: vmx6: deletion failed: 3
Jan 20 22:19:52 AuDiOpnSFW-01 opnsense[59942]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.254 - VOIP .254 (13@vmx6)" has resumed the state "MASTER" for vhid 13
Jan 20 22:19:52 AuDiOpnSFW-01 opnsense[9755]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.254 - VOIP .254 (13@vmx6)" has resumed the state "BACKUP" for vhid 13
Jan 20 22:19:53 AuDiOpnSFW-01 kernel: carp: 12@vmx6: BACKUP -> MASTER (master timed out)
Jan 20 22:19:53 AuDiOpnSFW-01 kernel: carp: 12@vmx6: MASTER -> BACKUP (more frequent advertisement received)
Jan 20 22:19:53 AuDiOpnSFW-01 kernel: vmx6: deletion failed: 3
Jan 20 22:19:53 AuDiOpnSFW-01 opnsense[82625]: /usr/local/etc/rc.filter_synchronize: Filter sync successfully completed with https://10.99.99.253/xmlrpc.php.
Jan 20 22:19:54 AuDiOpnSFW-01 opnsense[50747]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed the state "MASTER" for vhid 12
Jan 20 22:19:54 AuDiOpnSFW-01 opnsense[97087]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed the state "BACKUP" for vhid 12
Jan 20 22:19:54 AuDiOpnSFW-01 kernel: carp: 13@vmx6: BACKUP -> MASTER (master timed out)
Jan 20 22:19:54 AuDiOpnSFW-01 kernel: carp: 13@vmx6: MASTER -> BACKUP (more frequent advertisement received)
Jan 20 22:19:54 AuDiOpnSFW-01 kernel: vmx6: deletion failed: 3
Jan 20 22:19:55 AuDiOpnSFW-01 opnsense[19560]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.254 - VOIP .254 (13@vmx6)" has resumed the state "MASTER" for vhid 13
Jan 20 22:19:55 AuDiOpnSFW-01 opnsense[63657]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.254 - VOIP .254 (13@vmx6)" has resumed the state "BACKUP" for vhid 13
Jan 20 22:19:57 AuDiOpnSFW-01 kernel: carp: 12@vmx6: BACKUP -> MASTER (master timed out)
Jan 20 22:19:57 AuDiOpnSFW-01 kernel: carp: 12@vmx6: MASTER -> BACKUP (more frequent advertisement received)
Jan 20 22:19:57 AuDiOpnSFW-01 kernel: vmx6: deletion failed: 3
Jan 20 22:19:57 AuDiOpnSFW-01 opnsense[91455]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed the state "MASTER" for vhid 12
Jan 20 22:19:57 AuDiOpnSFW-01 opnsense[43404]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed the state "BACKUP" for vhid 12
Jan 20 22:19:57 AuDiOpnSFW-01 kernel: carp: 13@vmx6: BACKUP -> MASTER (master timed out)
Jan 20 22:19:57 AuDiOpnSFW-01 kernel: carp: 13@vmx6: MASTER -> BACKUP (more frequent advertisement received)
Jan 20 22:19:57 AuDiOpnSFW-01 kernel: vmx6: deletion failed: 3
Jan 20 22:19:58 AuDiOpnSFW-01 opnsense[91563]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.254 - VOIP .254 (13@vmx6)" has resumed the state "MASTER" for vhid 13
Jan 20 22:19:58 AuDiOpnSFW-01 opnsense[15047]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.254 - VOIP .254 (13@vmx6)" has resumed the state "BACKUP" for vhid 13
Jan 20 22:20:00 AuDiOpnSFW-01 kernel: carp: 12@vmx6: BACKUP -> MASTER (master timed out)
Jan 20 22:20:00 AuDiOpnSFW-01 kernel: carp: 12@vmx6: MASTER -> BACKUP (more frequent advertisement received)
Jan 20 22:20:00 AuDiOpnSFW-01 kernel: vmx6: deletion failed: 3
Jan 20 22:20:00 AuDiOpnSFW-01 opnsense[65054]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed the state "MASTER" for vhid 12
Jan 20 22:20:00 AuDiOpnSFW-01 opnsense[91121]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed the state "BACKUP" for vhid 12
Jan 20 22:20:00 AuDiOpnSFW-01 kernel: carp: 13@vmx6: BACKUP -> MASTER (master timed out)
Jan 20 22:20:00 AuDiOpnSFW-01 kernel: carp: 13@vmx6: MASTER -> BACKUP (more frequent advertisement received)
Jan 20 22:20:00 AuDiOpnSFW-01 kernel: vmx6: deletion failed: 3
Jan 20 22:20:01 AuDiOpnSFW-01 opnsense[42116]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.254 - VOIP .254 (13@vmx6)" has resumed the state "MASTER" for vhid 13
Jan 20 22:20:01 AuDiOpnSFW-01 opnsense[94865]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.254 - VOIP .254 (13@vmx6)" has resumed the state "BACKUP" for vhid 13
Jan 20 22:20:03 AuDiOpnSFW-01 kernel: carp: 12@vmx6: BACKUP -> MASTER (master timed out)
Jan 20 22:20:03 AuDiOpnSFW-01 kernel: carp: 12@vmx6: MASTER -> BACKUP (more frequent advertisement received)
Jan 20 22:20:03 AuDiOpnSFW-01 kernel: vmx6: deletion failed: 3
Jan 20 22:20:03 AuDiOpnSFW-01 opnsense[36807]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed the state "MASTER" for vhid 12
Jan 20 22:20:03 AuDiOpnSFW-01 opnsense[75643]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed the state "BACKUP" for vhid 12
Jan 20 22:20:03 AuDiOpnSFW-01 kernel: carp: 13@vmx6: BACKUP -> MASTER (master timed out)
Jan 20 22:20:03 AuDiOpnSFW-01 kernel: carp: 13@vmx6: MASTER -> BACKUP (more frequent advertisement received)
Jan 20 22:20:03 AuDiOpnSFW-01 kernel: vmx6: deletion failed: 3
Jan 20 22:20:04 AuDiOpnSFW-01 opnsense[21538]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.254 - VOIP .254 (13@vmx6)" has resumed the state "MASTER" for vhid 13
Jan 20 22:20:04 AuDiOpnSFW-01 opnsense[68095]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.254 - VOIP .254 (13@vmx6)" has resumed the state "BACKUP" for vhid 13
Jan 20 22:20:06 AuDiOpnSFW-01 kernel: carp: 12@vmx6: BACKUP -> MASTER (master timed out)
Jan 20 22:20:06 AuDiOpnSFW-01 kernel: carp: 12@vmx6: MASTER -> BACKUP (more frequent advertisement received)
Jan 20 22:20:06 AuDiOpnSFW-01 kernel: vmx6: deletion failed: 3
on box 2
Jan 20 22:19:47 AuDiOpnSFW-02 kernel: vmx6: promiscuous mode enabled
Jan 20 22:19:47 AuDiOpnSFW-02 kernel: carp: 12@vmx6: INIT -> BACKUP (initialization complete)
Jan 20 22:19:47 AuDiOpnSFW-02 kernel: carp: 13@vmx6: INIT -> BACKUP (initialization complete)
Jan 20 22:19:47 AuDiOpnSFW-02 kernel: carp: demoted by 240 to 240 (pfsync bulk start)
Jan 20 22:19:47 AuDiOpnSFW-02 opnsense[13005]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.1 - VOIP .1 (12@vmx6)" has resumed the state "BACKUP" for vhid 12
Jan 20 22:19:47 AuDiOpnSFW-02 opnsense[13005]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Resyncing OpenVPN instances for interface 10.8.12.1 - VOIP .1.
Jan 20 22:19:47 AuDiOpnSFW-02 opnsense[79354]: /xmlrpc.php: ROUTING: entering configure using defaults
Jan 20 22:19:47 AuDiOpnSFW-02 opnsense[79354]: /xmlrpc.php: ROUTING: IPv4 default gateway set to wan
Jan 20 22:19:47 AuDiOpnSFW-02 opnsense[79354]: /xmlrpc.php: ROUTING: setting IPv4 default route to 10.20.25.79
Jan 20 22:19:47 AuDiOpnSFW-02 opnsense[79354]: /xmlrpc.php: ROUTING: keeping current default gateway '10.20.25.79'
Jan 20 22:19:47 AuDiOpnSFW-02 opnsense[79354]: /xmlrpc.php: ROUTING: IPv6 default gateway set to wan
Jan 20 22:19:47 AuDiOpnSFW-02 opnsense[79354]: /xmlrpc.php: ROUTING: setting IPv6 default route to fe80::b6de:31ff:feb5:ae40
Jan 20 22:19:47 AuDiOpnSFW-02 opnsense[79354]: /xmlrpc.php: ROUTING: keeping current default gateway 'fe80::b6de:31ff:feb5:ae40%vmx5'
Jan 20 22:19:47 AuDiOpnSFW-02 opnsense[67882]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "10.8.12.254 - VOIP .254 (13@vmx6)" has resumed the state "BACKUP" for vhid 13
Jan 20 22:19:47 AuDiOpnSFW-02 kernel: carp: demoted by -240 to 0 (pfsync bulk done)
Jan 20 22:19:47 AuDiOpnSFW-02 opnsense[67882]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Resyncing OpenVPN instances for interface 10.8.12.254 - VOIP .254.
Jan 20 22:19:47 AuDiOpnSFW-02 opnsense[79354]: plugins_configure monitor ()
Jan 20 22:19:47 AuDiOpnSFW-02 opnsense[79354]: plugins_configure monitor (execute task : dpinger_configure_do())
Jan 20 22:19:47 AuDiOpnSFW-02 opnsense[79354]: /xmlrpc.php: The WAN_DHCP6 monitor address is empty, skipping.
Jan 20 22:19:47 AuDiOpnSFW-02 opnsense[79354]: /xmlrpc.php: The WAN_PPPOE monitor address is empty, skipping.
Jan 20 22:19:47 AuDiOpnSFW-02 configctl[58786]: event @ 1611141587.39 msg: Jan 20 22:19:47 AuDiOpnSFW-02.di.local config[79354]: config-event: new_config /conf/backup/config-1611141587.3895.xml
Jan 20 22:19:47 AuDiOpnSFW-02 configctl[58786]: event @ 1611141587.39 exec: system event config_changed
Jan 20 22:19:48 AuDiOpnSFW-02 opnsense[79354]: plugins_configure hosts ()
Jan 20 22:19:48 AuDiOpnSFW-02 kernel: pflog0: promiscuous mode disabled
Jan 20 22:19:48 AuDiOpnSFW-02 kernel: pflog0: promiscuous mode enabled
Jan 20 22:19:48 AuDiOpnSFW-02 opnsense[79354]: plugins_configure hosts (execute task : dnsmasq_hosts_generate())
Jan 20 22:19:48 AuDiOpnSFW-02 opnsense[79354]: plugins_configure hosts (execute task : unbound_hosts_generate())
Jan 20 22:19:52 AuDiOpnSFW-02 opnsense[79354]: plugins_configure dhcp ()
Jan 20 22:19:52 AuDiOpnSFW-02 opnsense[79354]: plugins_configure dhcp (execute task : dhcpd_dhcp_configure())
Jan 20 22:19:52 AuDiOpnSFW-02 opnsense[79354]: /xmlrpc.php: Warning! dhcpd_radvd_configure(auto) found no suitable IPv6 address on vmx2
Jan 20 22:19:53 AuDiOpnSFW-02 opnsense[79354]: plugins_configure dns ()
Jan 20 22:19:53 AuDiOpnSFW-02 opnsense[79354]: plugins_configure dns (execute task : dnsmasq_configure_do())
Jan 20 22:19:53 AuDiOpnSFW-02 opnsense[79354]: plugins_configure dns (execute task : unbound_configure_do())
Jan 20 22:19:53 AuDiOpnSFW-02 opnsense[79354]: plugins_configure remote ()
Jan 20 22:19:53 AuDiOpnSFW-02 opnsense[79354]: plugins_configure remote (execute task : openvpn_configure_do())
Jan 20 22:19:53 AuDiOpnSFW-02 opnsense[79354]: /xmlrpc.php: Resyncing OpenVPN instances.
i have no openvpn instances defined.
does anyone have any suggestions? i have even built 2 new vms and reconfigured both vms to match my configuration to no avail
-
Do you read the guides about CARP in virtual HA environments? For ESX you need to add some commands via esx-cli.
-
issue solved by following this guide from vmware
https://kb.vmware.com/s/article/59235
-
I have some similiar problems... and hopefully one of you can help me.
My OPNsense are virtualized on vmware and I have no tried multiple things to get the VIP running...
define the same nics(vmxnet3), dedicated vlan for sync interfaces, including the vmware KB article mentioned here, but nothing helped...
if I look at the system log of one of the opnsense(that one is a fresh install 21.7), I see:
Sep 17 21:04:44 OPNsense.localdomain opnsense[88818]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Resyncing OpenVPN instances for interface 192.168.4.10 - VIP_LAN.
Sep 17 21:04:47 OPNsense.localdomain opnsense[84697]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "192.168.4.10 - VIP_LAN (3@vmx0)" has resumed the state "MASTER" for vhid 3
Sep 17 21:04:47 OPNsense.localdomain opnsense[84697]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Resyncing OpenVPN instances for interface 192.168.4.10 - VIP_LAN.
Sep 17 21:14:30 OPNsense.localdomain opnsense[75053]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "192.168.4.10 - VIP_LAN (3@vmx0)" has resumed the state "BACKUP" for vhid 3
Sep 17 21:14:30 OPNsense.localdomain opnsense[75053]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Resyncing OpenVPN instances for interface 192.168.4.10 - VIP_LAN.
Sep 17 21:14:32 OPNsense.localdomain opnsense[44588]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "192.168.4.10 - VIP_LAN (3@vmx0)" has resumed the state "BACKUP" for vhid 3
Sep 17 21:14:32 OPNsense.localdomain opnsense[44588]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Resyncing OpenVPN instances for interface 192.168.4.10 - VIP_LAN.
Sep 17 21:14:34 OPNsense.localdomain opnsense[46862]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "192.168.4.10 - VIP_LAN (3@vmx0)" has resumed the state "MASTER" for vhid 3
Sep 17 21:14:34 OPNsense.localdomain opnsense[46862]: /usr/local/etc/rc.syshook.d/carp/20-openvpn: Resyncing OpenVPN instances for interface 192.168.4.10 - VIP_LAN.
On the other node(that one is was an older version lastly updated from 21.1 to 21.7) I can't really see current system logs...
both sync interfaces can ping each other, but the VIP is not getting activated...
I set the fw rule to allow all incoming traffic on that sync interfaces and to allow all traffic from the LAN interface of each opnsense to only the other interface via the local LAN interfaces.
HA modes has been configured to synchronize states on both opnsense.
VIP has been configured only at one of both opnsense, with "192.168.4.10/24 (vhid 3 , freq. 1 / 0)"
hopefully one of you have some idea what I could try.
-
Do you read the guides about CARP in virtual HA environments? For ESX you need to add some commands via esx-cli.
Where is that? I'm looking at https://docs.opnsense.org/manual/how-tos/carp.html (https://docs.opnsense.org/manual/how-tos/carp.html) and not seeing anything about it.
issue solved by following this guide from vmware
https://kb.vmware.com/s/article/59235
Thanks, that did it for me.