I don't know why but it's the ears that get me all the time.
I have these wrap around things called "180's" that wrap around the back of your head and cover up your ears. Like ear muffs but from behind.
If I have my ears covered then I'm good...except for the hands...gotta keep the hands warm. And it was biting cold for me today with the pups. Nothing a good warm soy chai latte couldn't fix though.