The issue turned out to be a bug in the way opnsense generated the config. :)
https://github.com/opnsense/plugins/issues/3450
Looks like someone beat me to the fix so hopefully it will be bundled in the next update :)
https://github.com/opnsense/plugins/issues/3450
Looks like someone beat me to the fix so hopefully it will be bundled in the next update :)