总共爬取了大概3千多本书籍，每次启动爬虫章节可以自动更新
小说的章节内容是存成txt格式的文件到硬盘，小说的封面图上传到七牛上进行存储
可以在crontab设置爬虫进程定时进行爬取，并且爬虫日志根据每次启动时间来进行分割
-
Notifications
You must be signed in to change notification settings - Fork 0
zhenchaozhu/book_spider
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
基于scrapy的小说爬虫网站
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published