Keep track of bounding boxes accessed to determine what parts of the tree are least recently updated.