Spoke too soon. While the Service Tests Setting will apply, trying to apply the given "Service Settings" prevents me form applying the config. No error, no warning, just won't apply.