i personally dont see the issue with male cleaners, the thing is many people may think male cleaners not have alot of experience as women generally the ones who are in charge of all cleaning at home tc so more familiar with the tasks, thats the only thing that i can think of why people may assume female cleaners are better etc and i dont think it's to do with people not trusting males in their home, like you said many are just used to seeing females, although saying this i think builders cleans are generally more associated with males as it involves more hard work and working at hights sometimes and it not that often you will see many women doing them.
dash t