It would be right to wear veils in a Church where the prevailing culture of that society is one where it is decent and right for women to wear veils. For instance, if a
Muslim lady in a Muslim land becomes a Christian and the normal dress for public gathering is a veil then she should continue wearing one in Church services.
The only time where veiling should be done away with in a culture where women wear veils is if the veil has some significance in worshipping false gods and is
recognized as their allegiance to that false god.