thermodynamics - Why does my house seem to warm faster in summer than it cools in winter?

In summers when we switch off the air conditioner, the room seems to instantly get hot again. But in winter, when we switch off the heater the room seems to remain hot for some time. Why this difference?