Hidden calendars show up in the side panel

Calendar
1

If I deactivate a calendar, its dates are still displayed in the side panel calendar view.
How do I get rid of those, short of deleting the calendar?
Im still on v9.