I had a similar issue and found that my voip provider needed specific ports open, especially for SIP and RTP. Adding a firewall alias with those port ranges and creating rules to allow traffic in and out helped a lot. Also, making sure traffic wasn't getting caught by default block rules on WAN made a difference. Once I got those sorted, calls started working fine both ways.
"