Exactly. Gems can be labelled as defective or "Off Colour" due to either actual defects, like we see with the Rutile Twins, or just because of how they act etc, such as two different Gems wanting to fuse with each other.