agent/app/install.nsi needs to be updated so it actually deletes all the files when uninstalling. Currently it leaves a few files behind.
Also, I've had issues with trying to update the client on a machine by running install.exe again. We should verify that running install.exe a second time without uninstalling first works.