Replies: 1 comment
-
We are yet to figure out the exact case, however just wanted to know if this could be a possibility. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Using both
CheerioCrawler
andPuppeteerCrawler
, we are running OOM.The memory gradually increases at approximate rate of custom
userData
being used for crawls.https://crawlee.dev/api/core/class/Request
Wanted to know if crawlee keeps
Request.userData
in memory for completed crawls, if yes, its duration and number of records being stored.Beta Was this translation helpful? Give feedback.
All reactions