Skip to content

Python crawling/Course of Internet and web tech/ITMO University

Notifications You must be signed in to change notification settings

HumanAutomationInteractionLab-HAIL/weibo-spider

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

16 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

python weibospider

Contents

  1. HsinWeiboSpider is a crawler to crawl posts from weibo with mongoDB = ./hsinWeiboSpider
  2. douban top 250 movies crawler as test crawler 1 = ./douban250
  3. mswallpaper is a crawler to grab wallpapers from microsoft as test crawler 2 = ./mswallpaper
  4. douban top 250 movies crawler by scrapy as test crawler 3 = ./scrapyspider
  5. Others are useless and most of them are gathered as reference weibo spider

Have fun!

About

Python crawling/Course of Internet and web tech/ITMO University

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published