Need to make sure the pointing offset residual fit is good and that it doesn't apply garbage offsets. For now there is a stop-gap where if the offset it >5 arcmin it logs a warning and skips applying the offset.