It's somewhat common for nan to be used as a raster nodata value. reclassify_raster can either reclassify nodata pixels -- if it is listed in the value map -- or propagate them as nodata in the output. Neither of these will work for nan because we use numpy.isclose() without passing equal_nan.
I feel like we've discussed this in the past, but I don't remember if there's a reason we did not address it. It came up in #419 . @claire-simpson do you remember?