### What happened? Fix it and remove previously indexed pages from search. ### Tasks - [ ] add robots.txt - [ ] research other ways to block a domain - [ ] test - [ ] remove search indicies - [ ] check robots.txt and indexability after running a backstop test ### Relevant log output _No response_