Trying to join a private org that has enabled autojoin fails

[duckduckgrayduck]

I have a test org that I enabled autojoin on and that is private. I have a domain added. When a user matching that domain logs in and sees they can join the org, they click join, but reach a page not found.