best advise i got is to find something that dries fast. i use rocky early season gloves all year they are a early season quick drying glove that i put in my muff( there is said it) but the material is poly like and does not really hold water when they are inside the muff getting warm.... gonna need some skittles after this post aren't I?
All kidding aside, Milo brings up a great point here. Using a muff, your hands will have a tendency to sweat if you leave them in there too long. I usually just take my hands out every-so-often to cool them down... But moisture-wicking thin gloves is a good idea.