Hard to use when on a scrollable page

I have a scrollview for my options, and want to implement PIkolo in-line in it.  But when I drag one of the RGB circles, it often drags the scrollview up/down (keeping the RGB circles in their relative positions)

Is there any way to have the color picker prevent the scrollview from seeing the drag events?  Or do I need to move this into a non-scrolling dialog box?