I mostly wear gloves in the summer due to carbon transfer from pole to my hands and so i wear gloves like cycle gloves. Winter it depends on cold wind but now im on hot water and my tubes go through pole, it heats the pole slightly. So when i start to get transfer from this new pole i will wear gloves again.
As for getting wet, that should only be for when its raining, so if you need to wear gloves all year and you said about being dry.....have you got your brush set at the correct angle, as water should not be running down your brush, your pole and to your hands. You may find a slight adjustment by even one click could stop this, if this is the reason for wet hands!?