Omiai Crawler

A web crawler for Omiai with ChromeDriver

$ python crawler.py -h                                                                                                                                                                                                                   14:27:30  ☁  master ☂ ⚡
usage: crawler.py [-h] [-w WIDTH] [-ht HEIGHT] [-t TYPE] [-n PAGE_NUM] [-tmo TIMEOUT] [-hl]

Omiai Crawler: A web crawler for Omiai with ChromeDriver

optional arguments:
  -h, --help            show this help message and exit
  -w WIDTH, --width WIDTH
                        width of the Chrome window
  -ht HEIGHT, --height HEIGHT
                        height of the Chrome window
  -t TYPE, --type TYPE  <recommend | login | interests | fresh>
  -n PAGE_NUM, --page_num PAGE_NUM
                        number of loading pages
  -tmo TIMEOUT, --timeout TIMEOUT
                        timeout time for waiting for login (sec)
  -hl, --headless       runs Chrome in headless mode