Skip to content

Commit

Permalink
Update article_downloader.py
Browse files Browse the repository at this point in the history
  • Loading branch information
mircealungu committed Apr 27, 2024
1 parent 3ea06a2 commit bf4c686
Showing 1 changed file with 1 addition and 4 deletions.
5 changes: 1 addition & 4 deletions zeeguu/core/content_retriever/article_downloader.py
Original file line number Diff line number Diff line change
Expand Up @@ -117,11 +117,8 @@ def download_from_feed(feed: Feed, session, limit=1000, save_in_elastic=True):
)

try:
logp("before redirects")
logp(feed_item["url"])

url = _url_after_redirects(feed_item["url"])
logp("===============================> ")
logp("after redirects")
logp(url)

except requests.exceptions.TooManyRedirects:
Expand Down

0 comments on commit bf4c686

Please sign in to comment.