The translation box (created from right click -> translate) can't currently be dismissed without switching to a different channel or reloading.
The cleanest way of fixing this is to add an "x" button to the top right corner; could be always visible, or only on hover. (This should be generalized, as the same ui would be good for removing unintended link previews.)