If you are editing, do not refresh the annotation lists (or at least don't interrupt editing) when another annotation is created or deleted in the same item. This is related to #506, but should reduce refreshes further.
As an added part, when refreshed, sometimes the data plotted on the metadata plot seems to "forget" some of the settings.