Because metal conducts the heat away from your hand far quicker than the wood does
On a cold day, why does a metal doorknob feel colder than the wooden door?
Because metal colds and can easily affected by the weather