We would need to renormalize on the fly, since the total of all rule importances is not the same in each pruned version of the tree. This is a very minor issue, since the ordering of the rule importances is preserved in the current implementation.