You can't remove individual events that you are not interested in, but you can unsubscribe from calendars that you are not interested in. That raises the question of how your ward and stake calendars are laid out. Some units have many specific calendars, and other units choose to have just a few broader calendars. There are pros and cons to each approach.
In our stake, for example, we have a single Holiday calendar. That makes it easy for members to unsubscribe if they track their holidays in some other way, but it's easy for interested people to turn that calendar's display on or off.
If you find that your ward and/or stake has too few calendars which then limits your ability to unsubscribe from irrelevant calendars, you might want to have a discussion with whoever is responsible for determining the scope of each of your ward/stake calendars.
Questions that can benefit the larger community should be asked in a public forum, not a private message.
