Skip to content

Commit

Permalink
[update] test branch to code a crawler based on playwright
Browse files Browse the repository at this point in the history
  • Loading branch information
Jourdelune committed Jun 7, 2024
1 parent 17c9afd commit 1eac987
Show file tree
Hide file tree
Showing 18 changed files with 235 additions and 328 deletions.
Empty file removed Crawler/__init__.py
Empty file.
10 changes: 0 additions & 10 deletions Crawler/items.py

This file was deleted.

103 changes: 0 additions & 103 deletions Crawler/middlewares.py

This file was deleted.

13 changes: 0 additions & 13 deletions Crawler/pipelines.py

This file was deleted.

107 changes: 0 additions & 107 deletions Crawler/settings.py

This file was deleted.

4 changes: 0 additions & 4 deletions Crawler/spiders/__init__.py

This file was deleted.

60 changes: 0 additions & 60 deletions Crawler/spiders/audios.py

This file was deleted.

17 changes: 0 additions & 17 deletions Crawler/spiders/quotes.py

This file was deleted.

2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -12,7 +12,7 @@ pip install -r requirements.txt

Run the crawler
```bash
scrapy crawl audios
python3 main.py
```

## License
Expand Down
1 change: 1 addition & 0 deletions crawler/__init__.py
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
from crawler.crawler import Crawler
Loading

0 comments on commit 1eac987

Please sign in to comment.