You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I'm trying to launch an Node - Express server on GCP, which exposes the crawlee crawl for a specific url. Everything is pushed up and working fine, except when I run the actual crawl I get a BrowserLaunchError (no other information in the error only name). Things I have done
Run npx playwright install
new PlaywrightCrawler with persistStorage: false - this has a custom requestHandler, maxRequestsPerCrawl and preNavigationHooks
Am running crawler.run([myurl]) and returning the results.
All of this of course works perfectly locally, the headless option is not included, and the default is true. I found this - https://crawlee.dev/api/browser-pool/class/BrowserLaunchError but not sure what is triggering this really as I'm following the example provided. Any hints or even answers would be very helpful.
Edit: Tried instance_class F4, still same error. Is there a minimum memory required page/info for this?
Update: Tried instance class B4_1G as well 3GB memory, and it still returns the same error.
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
Hey,
I'm trying to launch an Node - Express server on GCP, which exposes the crawlee crawl for a specific url. Everything is pushed up and working fine, except when I run the actual crawl I get a
BrowserLaunchError
(no other information in the error only name). Things I have donenpx playwright install
persistStorage: false
- this has a custom requestHandler, maxRequestsPerCrawl and preNavigationHookscrawler.run([myurl])
and returning the results.Basically everything mentioned here is in place https://crawlee.dev/docs/deployment/gcp-browsers.
All of this of course works perfectly locally, the
headless
option is not included, and the default is true. I found this - https://crawlee.dev/api/browser-pool/class/BrowserLaunchError but not sure what is triggering this really as I'm following the example provided. Any hints or even answers would be very helpful.Edit: Tried instance_class F4, still same error. Is there a minimum memory required page/info for this?
Update: Tried instance class B4_1G as well 3GB memory, and it still returns the same error.
Thanks!
Beta Was this translation helpful? Give feedback.
All reactions