The little drop down button is hard to press on small devices. The idea is to use the pointer: coarse media query (perhaps combined with a screen size check) and when set substitute in a single button which toggles color, or, on long-press does the drop-down.
I started working on this but stopped because setting the button up proved difficult because we possibly want a larger button which will take some special handling.