This might not always be the case - e.g. when keystone and swift proxy are on different host. Maybe we should asume swift proxy == localhost & auth_host == keystone ip?
See:
conn = httplib.HTTPConnection(self.conf.get('auth_host'), self.conf.get('access_port'))
If you're happy with this I can make the changes accordingly.