Refactor the crawler

[hackroid]

Ideally, there should be only one crawler, i.e., instantiate only once. Maybe that singleton should belong to the botserver instance.

BTW, for now, we cannot put the crawler into botserver package, or it cause an import loop.