Sorry to bother everyone, in case someone comes across this in the future, the issue was that the host OS (Debian) with fresh install enables suspend on idle. Looks like this was disabling the ports for the VM. Even after coming out of suspend, the ports stayed disabled, this is why it was not obvious to me where the issue was.
Suspend disabled and everything is working now.
Suspend disabled and everything is working now.