OSC spider for new info

[edonyzpc]

https://github.com/edonyM/edonyM.github.io/issues/49

import scrapy

class OSCSpider(scrapy.Spider):
    name = "OSC"
    allowd_domains = ["www.oschina.net"]
    start_url = ['http://www.oschina.net/news/industry']

    def parse(self, response):
        self.log("fet the OSC: " + response.url)
        for item in response.css('div.main-info box-aw'):
            url = item.css('a::attr(href)').extract_first()
            yield url

[edonyzpc]

example to solve next_page request

• https://github.com/ictar/python-doc/blob/master/Scrapy/Scrapinghub%E7%9A%84Scrapy%E6%8A%80%E5%B7%A7%E7%B3%BB%E5%88%97/Scrapy%E6%8A%80%E5%B7%A7%EF%BC%9A2016%E5%B9%B4%E5%85%AD%E6%9C%88%E7%89%88.md