Move contrib modules to /sites/all/modules/contrib/

Is this even possible this late in the game?
I remember contexts throwing a fit.
I remember openlayers bonking (we replaced it with leaflet, but havent implemented the locations map yet).
I hear chaos tools don't like it.
I fear migrating the data to a fresh install (that would present an opportunity to clean up some content type data models and field mappings).
