Typically we show a yellow warning box in case we want to display a warning to the user. However, when the email is not configured and the user goes to the alert modal, the warning is displayed as red text (see screenshot). We should make that consistent and also use a warning box here.