standard model - Reasons for choosing $SU(3)$ as the color group vs. $SO(4)$

What are the reasons that $SU(3)$ is used for QCD?

Why wouldn't the simpler & smaller group $SO(4)$ make a better candidate?