No, latex paint is fine. If you don't like to brick finish you could just skimcoat the whole fireplace and apply any faux finish.
Regards
Regards