VXLAN Setup

[HeathCo81]

I'm trying to get VXLAN working on GNS3 using the latest OPNsense GNS3 appliance and OPNsense-24.7-nano-amd64.img. I have full BGP connectivity from TXR-OPN (OPNsense FW-1) to TXC-OPN (OPNsense FW-2) and everything in-between. Below I will add a screenshot of the entire topology and my OPNsense FW configs. I have read several of the VXLAN related threads in this message board, but I still haven't been able to get it working. Can anyone provide some guidance on this? Thank you!

OPNsense FW-1

root@TXR-OPN:~ # ifconfig vtnet0
vtnet0: flags=1008843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST,LOWER_UP> metric 0 mtu 1500
        description: LAN (lan)
        options=80028<VLAN_MTU,JUMBO_MTU,LINKSTATE>
        ether 0c:1f:ea:5c:00:00
        inet 192.168.1.1 netmask 0xffffff00 broadcast 192.168.1.255
        inet6 fe80::e1f:eaff:fe5c:0%vtnet0 prefixlen 64 scopeid 0x1
        media: Ethernet autoselect (10Gbase-T <full-duplex>)
        status: active
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
root@TXR-OPN:~ # ifconfig vxlan1
vxlan1: flags=1008843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST,LOWER_UP> metric 0 mtu 1335
        description: VXLAN1 (opt2)
        options=80020<JUMBO_MTU,LINKSTATE>
        ether 58:9c:fc:00:16:35
        inet 10.0.0.1 netmask 0xffffff00 broadcast 10.0.0.255
        inet6 fe80::5a9c:fcff:fe00:1635%vxlan1 prefixlen 64 scopeid 0x8
        groups: vxlan
        vxlan vni 100100 local 1.0.0.6:4789 remote 2.0.0.6:4789
        media: Ethernet autoselect (autoselect <full-duplex>)
        status: active
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>

OPNsense FW-2

root@TXC-OPN:~ # ifconfig vtnet0
vtnet0: flags=1008843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST,LOWER_UP> metric 0 mtu 1500
        description: LAN (lan)
        options=80028<VLAN_MTU,JUMBO_MTU,LINKSTATE>
        ether 0c:43:63:3c:00:00
        inet 192.168.1.2 netmask 0xffffff00 broadcast 192.168.1.255
        inet6 fe80::e43:63ff:fe3c:0%vtnet0 prefixlen 64 scopeid 0x1
        media: Ethernet autoselect (10Gbase-T <full-duplex>)
        status: active
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
root@TXC-OPN:~ # ifconfig vxlan1
vxlan1: flags=1008843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST,LOWER_UP> metric 0 mtu 1335
        description: VXLAN1 (opt2)
        options=80020<JUMBO_MTU,LINKSTATE>
        ether 58:9c:fc:00:16:35
        inet 10.0.0.2 netmask 0xffffff00 broadcast 10.0.0.255
        inet6 fe80::5a9c:fcff:fe00:1635%vxlan1 prefixlen 64 scopeid 0x8
        groups: vxlan
        vxlan vni 100100 local 2.0.0.6:4789 remote 1.0.0.6:4789
        media: Ethernet autoselect (autoselect <full-duplex>)
        status: active
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>

[Monviech (Cedrik)]

I just recently wrote new tutorials for vxlan and the frr plugin:

https://docs.opnsense.org/manual/how-tos/vxlan_bridge.html
https://docs.opnsense.org/manual/dynamic_routing.html

Maybe they can help you, I tested it all extensively so these things should work with stock OPNsense on both sides. Please note I had trouble getting vxlan working properly on virtual appliances. I used real network adapters either passed through via pcie or bare metal OPNsense installations.