As noted below, I could not get the scores to be the same, even with using the same seed. To deal with this I numbed up the data and trees so that the importances between calls should be highly correlated with one another. Then below I used rank() to make sure that they order the same.
Originally posted by @topepo in #171 (comment)