news/spiders/news_spider.py
news/piplines.py
news/settings.py
scrapy list
scrapy crawl bishijie
注意启动前修改redis配置
不加-u会出现有些打印不能实时看到，python会缓存
nohup python3 -u run_spider.py >run_spider.out 2>&1 &
-
Notifications
You must be signed in to change notification settings - Fork 0
ccconnor/NewsSpider
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
A simple spider for crawling news
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published