Not sure where in the code to implement this, but it would be nice to be able to deselect a specific cluster. For example, if you just click inside a cluster while the control is held down, the corresponding clusters will be deselected.