Reproduce:

• Create a collection with some data sources
• create a number report and create an alert based on it
• create a dashboard based on one of the templates
• save the dashboard and open the alerts dropdown

Observed:
Although the number report was not added to the dashboard, it's alert shows up in the alert dropdown.

Expected:
Only the alerts that exist inside the dashboard will show up in the alert dropdown