How to hide excluded blog categories from the filter?

Is it possible to display only blog categories that have active posts in the filter? Because now the category is still shown in the filter even tho their posts are excluded in the theme options. 

P.S I'd love to share a link to my site, but I can't seem to find how to make it private and hide from other viewers.