You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
It seems to me that the library does not work correctly over the http/2 when using a proxy. Each request create a new agent, which, in turn, create of a new connection. I tried to reuse an existing agent in Got, this significantly reduces the time to receive responses from the server.
hi! Taking a look at this issue right now, do you have a reproduction sample we can use to try to debug this? 🙏
Looking at the code, got-scraping only overwrites the agents provided by you when you also set a proxyUrl.
Also, what are the options you gave to the Http2OverHttp agent?
Apparently, I expressed myself incorrectly. I meant, when using the proxyUrl option, got-scraping creates a new agent for each request. As a result, the new agent creates a new connection for each request. But this does not correspond to the concept of http2, when a new connection is created only at the first request, and all other requests use an existing connection.
It should use an existing agent instead of creating a new one for each request.
I gave the code above as an example of how I used an existing agent in got
It seems to me that the library does not work correctly over the http/2 when using a proxy. Each request create a new agent, which, in turn, create of a new connection. I tried to reuse an existing agent in Got, this significantly reduces the time to receive responses from the server.
The text was updated successfully, but these errors were encountered: