Skip to content

choijun511/cnbeta_crawler

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 

Repository files navigation

cnbeta_crawler

==============

download the article of cnbeta in first page

为了学习xpath分析,试着扒了cnbeta。这个程序可以下载首页的文章,并且保存成txt文件。因为是严格匹配网页元素,所以无法用于别的站点。

————————

为什么是cnbeta? 以为cnbeta基本不会拒绝你的请求,所以很适合练习。别的网站可能会因为你连续多次的请求而返回404.

说明:http://blog.csdn.net/gt11799/article/details/39349359

About

download the article of cnbeta in first page

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages

  • Python 100.0%