New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

支持爬取js分页情况 #4

Open

hogking opened this issue Jun 6, 2024 · 0 comments

hogking commented Jun 6, 2024 •

edited

Loading

作者大大您好，
ScrapyListSpider里支持指定_next_page_element_css_selector元素从而实现更多页爬取。
但存在网站的分页跳转是通过js调用的比如：https://gdou.scnu.edu.cn/entity/first/firstInfoNews_toNewsList.action?type=702

<a href="javascript:sub(2)">下一页</a>

请问是否能支持适配这种情况呢？

The text was updated successfully, but these errors were encountered:

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment