When we create a new challenge type or change an existing one, the changes are not honored on renewal.
For example we had PowerDNS Challenge using internal IP and changed the config to have a public DNS name used.
However, ACME client does still use the internal IP on renewal. Looks like the config file never gets updates in some cases.