Skip to content

scrapy/前程无忧数据挖掘岗位信息爬取(广深)

Notifications You must be signed in to change notification settings

alige32/51job-datamining

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

15 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

51job-广深数据挖掘岗位爬取

scrapy 项目目录下开启爬虫

image 提取岗位详细信息,为以后数据分析做准备

image scrapy的异步性能还是很不错的,同比相同数据量下用request、lxml写的多线程爬虫性能要高出百分之50以上!

image

About

scrapy/前程无忧数据挖掘岗位信息爬取(广深)

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages