-
Notifications
You must be signed in to change notification settings - Fork 20
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Avoid duplicate requests #105
Avoid duplicate requests #105
Commits on Jul 3, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 5908b6c - Browse repository at this point
Copy the full SHA 5908b6cView commit details -
Configuration menu - View commit details
-
Copy full SHA for eaa3409 - Browse repository at this point
Copy the full SHA eaa3409View commit details
Commits on Jul 4, 2023
-
Merge pull request scrapy-plugins#98 from scrapy-plugins/scrapy-poet-…
…optional Move the provider deps into an optional feature.
Configuration menu - View commit details
-
Copy full SHA for a3f3e15 - Browse repository at this point
Copy the full SHA a3f3e15View commit details
Commits on Jul 12, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 5ad4d79 - Browse repository at this point
Copy the full SHA 5ad4d79View commit details -
Configuration menu - View commit details
-
Copy full SHA for 914d599 - Browse repository at this point
Copy the full SHA 914d599View commit details -
Configuration menu - View commit details
-
Copy full SHA for 3c81296 - Browse repository at this point
Copy the full SHA 3c81296View commit details -
* move to pyproject.toml when possible * use pre-commit in tox, don't duplicate configuration * don't run mypy in pre-commit * update flake8, mypy and isort * update github actions
Configuration menu - View commit details
-
Copy full SHA for be25b79 - Browse repository at this point
Copy the full SHA be25b79View commit details -
Configuration menu - View commit details
-
Copy full SHA for edd2ed2 - Browse repository at this point
Copy the full SHA edd2ed2View commit details -
Configuration menu - View commit details
-
Copy full SHA for 44c3a5f - Browse repository at this point
Copy the full SHA 44c3a5fView commit details -
Configuration menu - View commit details
-
Copy full SHA for 8fd2138 - Browse repository at this point
Copy the full SHA 8fd2138View commit details -
Co-authored-by: Adrián Chaves <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 7ac7f12 - Browse repository at this point
Copy the full SHA 7ac7f12View commit details -
Configuration menu - View commit details
-
Copy full SHA for aeca861 - Browse repository at this point
Copy the full SHA aeca861View commit details -
Merge pull request scrapy-plugins#101 from scrapy-plugins/cleanup-ci
Cleanup tools configuration
Configuration menu - View commit details
-
Copy full SHA for fd91fbf - Browse repository at this point
Copy the full SHA fd91fbfView commit details -
Merge pull request scrapy-plugins#100 from scrapy-plugins/more-data-t…
…ypes Support more data types in the provider
Configuration menu - View commit details
-
Copy full SHA for bd4bd6b - Browse repository at this point
Copy the full SHA bd4bd6bView commit details -
Configuration menu - View commit details
-
Copy full SHA for 6d549b7 - Browse repository at this point
Copy the full SHA 6d549b7View commit details -
Configuration menu - View commit details
-
Copy full SHA for 226620c - Browse repository at this point
Copy the full SHA 226620cView commit details -
Configuration menu - View commit details
-
Copy full SHA for 139f55e - Browse repository at this point
Copy the full SHA 139f55eView commit details -
Merge pull request scrapy-plugins#104 from scrapy-plugins/quickstart
add a quick start section to readme
Configuration menu - View commit details
-
Copy full SHA for 267d689 - Browse repository at this point
Copy the full SHA 267d689View commit details
Commits on Jul 13, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 23c4940 - Browse repository at this point
Copy the full SHA 23c4940View commit details -
Configuration menu - View commit details
-
Copy full SHA for 1c7db87 - Browse repository at this point
Copy the full SHA 1c7db87View commit details -
Configuration menu - View commit details
-
Copy full SHA for 4e4c829 - Browse repository at this point
Copy the full SHA 4e4c829View commit details
Commits on Jul 14, 2023
-
Merge pull request scrapy-plugins#109 from scrapy-plugins/relnotes-0.…
…10.0 Add release notes for 0.10.0.
Configuration menu - View commit details
-
Copy full SHA for 0c8b648 - Browse repository at this point
Copy the full SHA 0c8b648View commit details -
Configuration menu - View commit details
-
Copy full SHA for 46ae308 - Browse repository at this point
Copy the full SHA 46ae308View commit details -
Configuration menu - View commit details
-
Copy full SHA for 24a4914 - Browse repository at this point
Copy the full SHA 24a4914View commit details -
Configuration menu - View commit details
-
Copy full SHA for 4361ca7 - Browse repository at this point
Copy the full SHA 4361ca7View commit details -
Merge pull request scrapy-plugins#106 from Gallaecio/trust-env
Support driving Zyte API requests through a proxy
Configuration menu - View commit details
-
Copy full SHA for 28927c0 - Browse repository at this point
Copy the full SHA 28927c0View commit details -
Configuration menu - View commit details
-
Copy full SHA for 23762b6 - Browse repository at this point
Copy the full SHA 23762b6View commit details
Commits on Jul 19, 2023
-
Configuration menu - View commit details
-
Copy full SHA for febe99f - Browse repository at this point
Copy the full SHA febe99fView commit details -
Configuration menu - View commit details
-
Copy full SHA for 5a8ce24 - Browse repository at this point
Copy the full SHA 5a8ce24View commit details -
Configuration menu - View commit details
-
Copy full SHA for 561d9ff - Browse repository at this point
Copy the full SHA 561d9ffView commit details
Commits on Jul 25, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 276c7f4 - Browse repository at this point
Copy the full SHA 276c7f4View commit details
Commits on Aug 2, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 660cdb2 - Browse repository at this point
Copy the full SHA 660cdb2View commit details -
Configuration menu - View commit details
-
Copy full SHA for 63a9d44 - Browse repository at this point
Copy the full SHA 63a9d44View commit details
Commits on Aug 3, 2023
-
Co-authored-by: Adrián Chaves <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 2820d56 - Browse repository at this point
Copy the full SHA 2820d56View commit details -
Merge pull request scrapy-plugins#114 from scrapy-plugins/max-zapi-re…
…quests Introduce ZYTE_API_MAX_REQUESTS
Configuration menu - View commit details
-
Copy full SHA for 3c09dfc - Browse repository at this point
Copy the full SHA 3c09dfcView commit details
Commits on Aug 4, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 8438007 - Browse repository at this point
Copy the full SHA 8438007View commit details -
Configuration menu - View commit details
-
Copy full SHA for 1097650 - Browse repository at this point
Copy the full SHA 1097650View commit details
Commits on Aug 7, 2023
-
Merge pull request scrapy-plugins#117 from Gallaecio/release-notes
CHANGES.rst: Cover 0.11.0
Configuration menu - View commit details
-
Copy full SHA for 6da9a39 - Browse repository at this point
Copy the full SHA 6da9a39View commit details -
Configuration menu - View commit details
-
Copy full SHA for b2d251d - Browse repository at this point
Copy the full SHA b2d251dView commit details -
Configuration menu - View commit details
-
Copy full SHA for 654aaba - Browse repository at this point
Copy the full SHA 654aabaView commit details -
Configuration menu - View commit details
-
Copy full SHA for e11265e - Browse repository at this point
Copy the full SHA e11265eView commit details -
Configuration menu - View commit details
-
Copy full SHA for 30c91d0 - Browse repository at this point
Copy the full SHA 30c91d0View commit details -
Configuration menu - View commit details
-
Copy full SHA for d3e7115 - Browse repository at this point
Copy the full SHA d3e7115View commit details
Commits on Aug 8, 2023
-
Merge pull request scrapy-plugins#121 from Gallaecio/fix-version-bumping
Fix version bumping
Configuration menu - View commit details
-
Copy full SHA for 5708e0e - Browse repository at this point
Copy the full SHA 5708e0eView commit details -
Configuration menu - View commit details
-
Copy full SHA for 75808e3 - Browse repository at this point
Copy the full SHA 75808e3View commit details
Commits on Aug 10, 2023
-
Configuration menu - View commit details
-
Copy full SHA for a330b4b - Browse repository at this point
Copy the full SHA a330b4bView commit details -
Merge pull request scrapy-plugins#123 from scrapy-plugins/stat-status…
…-codes Clarify how status codes are reflected in stats
Configuration menu - View commit details
-
Copy full SHA for 51823c9 - Browse repository at this point
Copy the full SHA 51823c9View commit details
Commits on Aug 21, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 8b1411b - Browse repository at this point
Copy the full SHA 8b1411bView commit details
Commits on Aug 23, 2023
-
Merge pull request scrapy-plugins#126 from scrapy-plugins/dont-warn-o…
…n-default-headers Do not warn about dropping the default Accept-Encoding header
Configuration menu - View commit details
-
Copy full SHA for b8a2fa4 - Browse repository at this point
Copy the full SHA b8a2fa4View commit details
Commits on Aug 24, 2023
-
Configuration menu - View commit details
-
Copy full SHA for a82ccbb - Browse repository at this point
Copy the full SHA a82ccbbView commit details -
Configuration menu - View commit details
-
Copy full SHA for deb1826 - Browse repository at this point
Copy the full SHA deb1826View commit details -
Merge pull request scrapy-plugins#127 from Gallaecio/release-notes
Cover 0.11.1 in the release notes
Configuration menu - View commit details
-
Copy full SHA for 20046c1 - Browse repository at this point
Copy the full SHA 20046c1View commit details
Commits on Aug 25, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 6fd143b - Browse repository at this point
Copy the full SHA 6fd143bView commit details -
Configuration menu - View commit details
-
Copy full SHA for cd47399 - Browse repository at this point
Copy the full SHA cd47399View commit details -
Configuration menu - View commit details
-
Copy full SHA for b9eb5d1 - Browse repository at this point
Copy the full SHA b9eb5d1View commit details
Commits on Aug 30, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 21926eb - Browse repository at this point
Copy the full SHA 21926ebView commit details
Commits on Aug 31, 2023
-
Merge pull request scrapy-plugins#128 from Gallaecio/request-arg-stats
Track top-level request args in stats
Configuration menu - View commit details
-
Copy full SHA for d61cb68 - Browse repository at this point
Copy the full SHA d61cb68View commit details
Commits on Sep 26, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 0282e00 - Browse repository at this point
Copy the full SHA 0282e00View commit details -
Configuration menu - View commit details
-
Copy full SHA for af1e223 - Browse repository at this point
Copy the full SHA af1e223View commit details -
Merge pull request scrapy-plugins#133 from Gallaecio/provider-geoloca…
…tion Implement ZYTE_API_PROVIDER_PARAMS
Configuration menu - View commit details
-
Copy full SHA for c5f02e0 - Browse repository at this point
Copy the full SHA c5f02e0View commit details -
Configuration menu - View commit details
-
Copy full SHA for f2dac4e - Browse repository at this point
Copy the full SHA f2dac4eView commit details -
Merge pull request scrapy-plugins#134 from Gallaecio/release-notes
Add release notes for 0.12.0
Configuration menu - View commit details
-
Copy full SHA for 207fed4 - Browse repository at this point
Copy the full SHA 207fed4View commit details -
Configuration menu - View commit details
-
Copy full SHA for c60c48a - Browse repository at this point
Copy the full SHA c60c48aView commit details -
Configuration menu - View commit details
-
Copy full SHA for 0918370 - Browse repository at this point
Copy the full SHA 0918370View commit details
Commits on Sep 28, 2023
-
Configuration menu - View commit details
-
Copy full SHA for b4ce6e0 - Browse repository at this point
Copy the full SHA b4ce6e0View commit details
Commits on Sep 29, 2023
-
Identify scrapy-zyte-api usage via custom user-agent (scrapy-plugins#130
) * send new user_agent with api_params * add _user_agent() to utils * remove _user_agent() from handler * add user_agent to AsyncClient * extract custom ua from settings and send to client * move package name to function * add test for _user_agent() * formatting * remove old test for user_agent * add test for user_agent (for _build_client) * se USER_AGENT as constant * send user_agent to client * change order for user agent in test/formatting * change order and delimeter for user agent in client * rename _USER_AGENT * _ZYTE_API_USER_AGENT rewrites any other user-agent * add __version__.py * fetching version from __version__.py * formatting * formatting * fix changing version in bump * formatting * set version to USER_AGENT from __version__.py * Set new version Co-authored-by: Adrián Chaves <[email protected]> * fix test to use full user_agent * construct user-agent at once * using USER_AGENT as default user agent * bump zyte-api version to the latest with user-agent --------- Co-authored-by: Adrián Chaves <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for d50b14d - Browse repository at this point
Copy the full SHA d50b14dView commit details -
updates for 0.12.1 release (scrapy-plugins#137)
* updates for 0.12.1 release * Update CHANGES.rst Co-authored-by: Adrián Chaves <[email protected]> --------- Co-authored-by: Adrián Chaves <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 6de738a - Browse repository at this point
Copy the full SHA 6de738aView commit details -
Configuration menu - View commit details
-
Copy full SHA for 1bd2e25 - Browse repository at this point
Copy the full SHA 1bd2e25View commit details -
Configuration menu - View commit details
-
Copy full SHA for b110833 - Browse repository at this point
Copy the full SHA b110833View commit details
Commits on Oct 4, 2023
-
Merge pull request scrapy-plugins#136 from scrapy-plugins/ellipsis
change ellipsis to 3 dots for ZYTE_API_LOG_REQUESTS text truncation
Configuration menu - View commit details
-
Copy full SHA for 3db30f1 - Browse repository at this point
Copy the full SHA 3db30f1View commit details -
Configuration menu - View commit details
-
Copy full SHA for 60e2265 - Browse repository at this point
Copy the full SHA 60e2265View commit details
Commits on Oct 11, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 2cabbe0 - Browse repository at this point
Copy the full SHA 2cabbe0View commit details
Commits on Oct 13, 2023
-
Configuration menu - View commit details
-
Copy full SHA for ab34b93 - Browse repository at this point
Copy the full SHA ab34b93View commit details
Commits on Oct 16, 2023
-
Configuration menu - View commit details
-
Copy full SHA for ecc42d4 - Browse repository at this point
Copy the full SHA ecc42d4View commit details
Commits on Oct 18, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 7f15a9c - Browse repository at this point
Copy the full SHA 7f15a9cView commit details
Commits on Oct 19, 2023
-
Co-authored-by: Adrián Chaves <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 8ee4e24 - Browse repository at this point
Copy the full SHA 8ee4e24View commit details -
Merge pull request scrapy-plugins#138 from scrapy-plugins/remove-extr…
…action-options Remove unused extration options
Configuration menu - View commit details
-
Copy full SHA for ad39749 - Browse repository at this point
Copy the full SHA ad39749View commit details -
Configuration menu - View commit details
-
Copy full SHA for bb54a28 - Browse repository at this point
Copy the full SHA bb54a28View commit details -
Configuration menu - View commit details
-
Copy full SHA for 1370505 - Browse repository at this point
Copy the full SHA 1370505View commit details
Commits on Oct 23, 2023
-
Configuration menu - View commit details
-
Copy full SHA for fbf37f0 - Browse repository at this point
Copy the full SHA fbf37f0View commit details
Commits on Oct 25, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 600a571 - Browse repository at this point
Copy the full SHA 600a571View commit details
Commits on Nov 2, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 80ae0a0 - Browse repository at this point
Copy the full SHA 80ae0a0View commit details
Commits on Nov 3, 2023
-
Use repr when logging request-id
Co-authored-by: Adrián Chaves <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 63228ec - Browse repository at this point
Copy the full SHA 63228ecView commit details -
Merge pull request scrapy-plugins#142 from scrapy-plugins/log-request-id
log Zyte API request id on errors
Configuration menu - View commit details
-
Copy full SHA for 5e205ef - Browse repository at this point
Copy the full SHA 5e205efView commit details
Commits on Nov 6, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 0b58307 - Browse repository at this point
Copy the full SHA 0b58307View commit details
Commits on Nov 7, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 438df61 - Browse repository at this point
Copy the full SHA 438df61View commit details -
Configuration menu - View commit details
-
Copy full SHA for b73bfc2 - Browse repository at this point
Copy the full SHA b73bfc2View commit details
Commits on Nov 8, 2023
-
Merge pull request scrapy-plugins#146 from Gallaecio/max-request-docs
Clarify the max requests docs
Configuration menu - View commit details
-
Copy full SHA for b395711 - Browse repository at this point
Copy the full SHA b395711View commit details
Commits on Nov 14, 2023
-
Configuration menu - View commit details
-
Copy full SHA for e55e99c - Browse repository at this point
Copy the full SHA e55e99cView commit details -
Configuration menu - View commit details
-
Copy full SHA for 87bd23a - Browse repository at this point
Copy the full SHA 87bd23aView commit details -
Configuration menu - View commit details
-
Copy full SHA for 4b5c088 - Browse repository at this point
Copy the full SHA 4b5c088View commit details -
Configuration menu - View commit details
-
Copy full SHA for aa3f77b - Browse repository at this point
Copy the full SHA aa3f77bView commit details -
Configuration menu - View commit details
-
Copy full SHA for b63ad66 - Browse repository at this point
Copy the full SHA b63ad66View commit details -
Configuration menu - View commit details
-
Copy full SHA for 15fc06e - Browse repository at this point
Copy the full SHA 15fc06eView commit details -
Configuration menu - View commit details
-
Copy full SHA for 08a5f48 - Browse repository at this point
Copy the full SHA 08a5f48View commit details -
Configuration menu - View commit details
-
Copy full SHA for e0ba154 - Browse repository at this point
Copy the full SHA e0ba154View commit details -
Merge pull request scrapy-plugins#148 from Gallaecio/bad-auth
Set a close reason for bad key and suspended account scenarios
Configuration menu - View commit details
-
Copy full SHA for 37e3517 - Browse repository at this point
Copy the full SHA 37e3517View commit details
Commits on Nov 15, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 2d936fd - Browse repository at this point
Copy the full SHA 2d936fdView commit details
Commits on Nov 20, 2023
-
Configuration menu - View commit details
-
Copy full SHA for b892453 - Browse repository at this point
Copy the full SHA b892453View commit details
Commits on Nov 24, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 493a48c - Browse repository at this point
Copy the full SHA 493a48cView commit details
Commits on Nov 28, 2023
-
Configuration menu - View commit details
-
Copy full SHA for dc09ac3 - Browse repository at this point
Copy the full SHA dc09ac3View commit details
Commits on Nov 30, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 702cc63 - Browse repository at this point
Copy the full SHA 702cc63View commit details -
Configuration menu - View commit details
-
Copy full SHA for d701f48 - Browse repository at this point
Copy the full SHA d701f48View commit details
Commits on Dec 12, 2023
-
Configuration menu - View commit details
-
Copy full SHA for cad9c3a - Browse repository at this point
Copy the full SHA cad9c3aView commit details -
Configuration menu - View commit details
-
Copy full SHA for e9be1a3 - Browse repository at this point
Copy the full SHA e9be1a3View commit details -
Configuration menu - View commit details
-
Copy full SHA for 3ee24f0 - Browse repository at this point
Copy the full SHA 3ee24f0View commit details -
Configuration menu - View commit details
-
Copy full SHA for 2b0d659 - Browse repository at this point
Copy the full SHA 2b0d659View commit details -
Configuration menu - View commit details
-
Copy full SHA for de01fc2 - Browse repository at this point
Copy the full SHA de01fc2View commit details -
Configuration menu - View commit details
-
Copy full SHA for 412475e - Browse repository at this point
Copy the full SHA 412475eView commit details -
Configuration menu - View commit details
-
Copy full SHA for 5305b46 - Browse repository at this point
Copy the full SHA 5305b46View commit details -
Configuration menu - View commit details
-
Copy full SHA for f5bb894 - Browse repository at this point
Copy the full SHA f5bb894View commit details -
Merge pull request scrapy-plugins#141 from scrapy-plugins/annotated-s…
…upport Initial support for typing.Annotated, support for extractFrom
Configuration menu - View commit details
-
Copy full SHA for 11a9b03 - Browse repository at this point
Copy the full SHA 11a9b03View commit details
Commits on Dec 13, 2023
-
Configuration menu - View commit details
-
Copy full SHA for a80fc0b - Browse repository at this point
Copy the full SHA a80fc0bView commit details -
Merge pull request scrapy-plugins#153 from scrapy-plugins/relnotes-0.…
…13.0 Release notes for 0.13.0.
Configuration menu - View commit details
-
Copy full SHA for fab5e58 - Browse repository at this point
Copy the full SHA fab5e58View commit details -
Configuration menu - View commit details
-
Copy full SHA for 0536f42 - Browse repository at this point
Copy the full SHA 0536f42View commit details
Commits on Dec 27, 2023
-
Merge remote-tracking branch 'scrapy-plugins/main' into provider-fix-…
…indirect-duplication
Configuration menu - View commit details
-
Copy full SHA for a5f909c - Browse repository at this point
Copy the full SHA a5f909cView commit details -
Configuration menu - View commit details
-
Copy full SHA for 857b51c - Browse repository at this point
Copy the full SHA 857b51cView commit details