Skip to content

mishkat-ucr/web-ir-project

Repository files navigation

Crawler Instructions:

  • In “credentials.py” file write the authentication credentials required (client ID, client secret, app name, reddit username, reddit password)
  • In a ‘.txt’ file write the names of subreddits you want to crawl(Travel, solotravel etc) in new line.
  • Run the crawler using the following command:
    ./crawler.sh <input-file.txt> <numberOfPosts>
    For example:
    ./crawler.sh subreddits.txt 999
  • About

    No description, website, or topics provided.

    Resources

    Stars

    Watchers

    Forks

    Releases

    No releases published

    Packages

    No packages published