I think this is solved with the help of a reddit user. I had a nightly backup running of the VM and I think it was disconnecting the ethernet connections. I also fixed some suricata errors in the meantime but I think the real culprit was the nightly VM backup. Hope this helps someone if they find it.