Timeframe of Data #13
-
This is a great resource for researchers, thanks Nick and co.! How far back, in terms of the timeframe, can RedditHarbor collect? |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment
-
Hi Daniel, thank you for your question! That's an excellent point you've raised, and it's something I've personally explored during RedditHarbor's beta testing phase around July 2023. At that time, I was collecting submissions from one of the subreddit collections over a 24-hour period. While RedditHarbor demonstrated the capability to collect historical data as far back as 2009, it appeared to perform best when collecting data from the past 5-6 months, as shown in the plot below. This is largely due to Reddit Data API, as unlike Twitter Data API, they do not support historical data search. Reddit Data API's strength lies in efficiently collecting and processing more recent submissions. If you have any further questions or need additional clarification, please feel free to ask. |
Beta Was this translation helpful? Give feedback.
Hi Daniel, thank you for your question!
That's an excellent point you've raised, and it's something I've personally explored during RedditHarbor's beta testing phase around July 2023. At that time, I was collecting submissions from one of the subreddit collections over a 24-hour period. While RedditHarbor demonstrated the capability to collect historical data as far back as 2009, it appeared to perform best when collecting data from the past 5-6 months, as shown in the plot below.
This is largely due to Reddit Data API, as unlike Twitter Data API, they do not support historical data search. Reddit Data API's strength lies in efficiently collecting and processing more recent submissions.
I…