Or look at alternate approaches to approximating the hessian. No benefit from optimization step if it doesn't produce a covariance to sample from.