Service/Host Dashobard in CM, Query Browser should provide "Don't show later"