I had to manually add the push rules for dhcp-option DNS and dhcp-option DOMAIN to get it working.
push "block-outside-dns"