scrapy能爬取https的网页么 | Dami

0 0

scrapy能爬取https的网页么

想获得 https://www.facebook.com/feeds/page.php?format=json&id=1433215316907826 中的alternate，但是爬虫返回404的网页错误

11 years ago

金肛互撸娃

share

金肛互撸娃 11 years ago

0

到最后发现是proxy的问题。线上测试就没问题

answered 11 years ago

古手·羽　入

share

古手·羽　入 answered 11 years ago

0

用Scrapy对https是不行的，你可以用Facebook的SDK

https://github.com/pythonforfacebook/facebook-sdk

answered 11 years ago

荒耶丿宗蓮

share

荒耶丿宗蓮 answered 11 years ago

0

这有个用scrapy爬取https的解决方法： http://stackoverflow.com/questions/23958073/scrapy-not-scraping-https

answered 11 years ago

kuuuuuu

share

kuuuuuu answered 11 years ago

Your Answer