Skip to content

Releases: socius-org/RedditHarbor

0.2.4

02 Jun 21:26
Compare
Choose a tag to compare

What's Changed

Full Changelog: 0.2.3...0.2.4

0.2.3

19 Apr 05:55
Compare
Choose a tag to compare

Full Changelog: 0.2.2...0.2.3

  • update() module has been added to redditharbor.dock.pipeline. The module streamlines and automates the process of updating upvote_ratio, score, and num_comments metrics for existing submissions (comments and users will be added in the future release)

0.2.2

14 Mar 20:59
Compare
Choose a tag to compare

Full Changelog: 0.2.1...0.2.2

  • Updated download.py and pipeline.py to remove the use of os.path.abs_path, enabling users to download files within the working folder instead of automatically to the desktop.

0.2.1

17 Feb 11:36
Compare
Choose a tag to compare

Solved Issue #8 (Full Changelog): 0.2...0.2.1

  • Now able to collect and store comments from specified submission id(s).
  • Now able to fetch submission ids from the Supabase table. Designed for collect.comment_from_submission.

Public Beta

25 Jan 22:45
Compare
Choose a tag to compare

Collect

from redditharbor.dock.pipeline import collect
collect = collect(reddit_client, supabase_client, db_config)

From Subreddit

  • subreddit_submission: Collects and stores submissions and associated users in specified subreddits.
  • subreddit_comment: Collects and stores comments and associated users in specified subreddits.
  • subreddit_submission_and_comment: Collects and stores submissions, comments and associated users in specified subreddits.

From User

  • submission_from_user: Collects and stores submissions from specified user(s).
  • comment_from_user: Collects and stores comments from specified user(s).

Keyword Search

  • submission_by_keyword: Collects and stores submissions with specified keywords from given subreddits.

Download

from redditharbor.utils import download
  • submission.to_{filetype}: Save submission data to .CSV, .JSON, .TXT, .Pickle, .JPEG and .PNG files.
  • comment.to_{filetype}: Save comment data to .CSV, .JSON, .TXT, and .Pickle files.
  • user.to_{filetype}: Save user data to .CSV, .JSON, .TXT, and .Pickle files.

Fetch

from redditharbor.utils import fetch 
  • user.name: Fetch user names from the Supabase table. Designed mainly for collect.submission_from_user and collect.comment_from_user.

0.1.6.3

09 Jan 03:15
Compare
Choose a tag to compare
Merge branch 'main' of https://github.com/socius-org/RedditHarbor

0.1.6

08 Jan 20:38
Compare
Choose a tag to compare
change save_file_path to os.getcwd()

0.1.5.3

08 Jan 19:04
6b1bfd7
Compare
Choose a tag to compare
0.1.5.3 Pre-release
Pre-release
Update README.md

0.1.4

22 Dec 18:47
Compare
Choose a tag to compare
suppress unnecessary sys log from presidio

0.1.3

22 Dec 16:51
Compare
Choose a tag to compare
fixed minor error with pii masking