In System -> HA -> Settings there is a setting called "Disconnect dialup interfaces", which is supposed to do what you want, but in my experience it does not work well.
Only if you add a third box doing the PPPoE termination. Otherwise the PPPoE connection needs to bounce between the two HA boxes in active/passive fashion.Cheers,Franco