OFI 7.1.2 KPI persist after removed from monitored component

I had a couple KPIs that added for monitoring and then removed, however they’re still appearing from Monitoring page.

Is it supposed to be like this? otherwise how can I remove them from the view?