feat: multithreaded bulk import (#1077) #1079
Merged
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
feat: Add BulkImport APIs and cron
chore: update pull request template
fix: Use the correct tenant config to create the proxy storage
fix: PR changes
fix: PR changes
fix: PR changes
fix: PR changes
fix: PR changes
fix: PR changes
fix: Update version
fix: PR changes
fix: PR changes
fix: Rename DeleteBulkImportUser API path
fix: disable bulk import for in-memory db
fix: a bug with createTotpDevices
fix: PR changes
feat: Add an api to import user in sync
feat: Add an api to get count of bulk import users
fix: PR changes
fix: Add error codes and plainTextPassword import
fix: PR changes
feat: multithreaded bulk import
fix: changelog update
fix: add new test
fix: fixing unreliable mutithreaded bulk import with mysql
fix: review fixes
fix: fixing failing tests
feat: bulkimport flow tests
feat: bulk import cron starter api
fix: tweaking params for faster import
fix: tests
checkpoint
fix: remove vacuuming
fix: minor tweaks
feat: bulk inserting the bulk migration data
fix: fast as a lightning
fix: restoring lost method
fix: reworked error handling to comform previous approach with messages
fix: fixing tests
fix: fixing failing tests, changing version
chore: update changelog
fix: fixing issues and failing tests
fix: review changes
fix: review fixes, reworking cron start/stop
Summary of change
(A few sentences about this PR)
Related issues
Test Plan
(Write your test plan here. If you changed any code, please provide us with clear instructions on how you verified your
changes work. Bonus points for screenshots and videos!)
Documentation changes
(If relevant, please create a PR in our docs repo, or create a checklist here
highlighting the necessary changes)
Checklist for important updates
coreDriverInterfaceSupported.json
file has been updated (if needed)pluginInterfaceSupported.json
file has been updated (if needed)build.gradle
getPaidFeatureStats
function in FeatureFlag.java filebuild.gradle
, please make sure to add themin
implementationDependencies.json
.getValidFields
inio/supertokens/config/CoreConfig.java
if new aliases were added for any coreconfig (similar to the
access_token_signing_key_update_interval
config alias).git tag
) in the formatvX.Y.Z
, and then find thelatest branch (
git branch --all
) whoseX.Y
is greater than the latest released tag.app_id_to_user_id
table, make sure to delete from this table when deletingthe user as well if
deleteUserIdMappingToo
is false.Remaining TODOs for this PR