statistical mechanics - Chemical potential in thermodynamics

In many scenarios, on computing the partial derivative of the internal energy ($U$) with respect to mole number ($N$) is negative. This implies that adding more moles of the substance decreases the $U$ of the system.

I find this strongly counter-intuitive. Shouldn't the derivative always be positive?