Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add changes for Bulk API V2 - [opened] #26

Open
MeltyBot opened this issue Jun 25, 2021 · 0 comments
Open

Add changes for Bulk API V2 - [opened] #26

MeltyBot opened this issue Jun 25, 2021 · 0 comments
Assignees

Comments

@MeltyBot
Copy link
Contributor

Merges add_bulk_api_v2 -> master

Migrated from GitLab: https://gitlab.com/meltano/tap-salesforce/-/merge_requests/13


Adding support for Salesforce Bulk V2 API.

  • Adding a new BULK_V2_API_TYPE, which can be used by setting BULK_V2 as api_type in the config
  • Bumping the API version to 51.0 for Bulk V2 API, while keeping 41.0 on the other two API types
  • In Bulk V2, preventing the use of ORDER BY clause in SOQL queries because this creates issues https://help.salesforce.com/articleView?id=000353741&language=en_US&mode=1&type=1. I'm ensuring the state keeps the latest fetched records using a new max_replication_key_value variable.
  • Adding a new connection type OAuthPasswordCredentials which uses a combination of username, password, client_id, and client_secret.
  • Adding an end_date config to be able to split loads in multiple chunks. If some objects are too big to be loaded at once, end_date can be used in combination with start_date/the state of the stream.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants