save_steps seems to overwrite output

Hi, 
I am trying to work with the output of different iterations as saved every "save_steps" (check parameter stationarity, compute means from simulated distribution, etc.), but if I am not mistaken, the code overwrites the output. Is this correct? Any elegant workaround?
Thanks a lot, 
Richard