I managed to fix this issue. I found out that in the overview of gateways there where 2 entries. This probably happend a few ago when I got a new IP from my ISP (DHCP). I deleted the old gateway object and VPN tunnel is working again. No clue how the second gateway ended up there.