Should we ban the Griffin Conservatory and the Hive of Serpents?

Is it possible to reduce the number of generated Sanctuaries and Hives by modifying the templates? If so, what could be the consequences?