Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Suggestions] Much faster imports #35

Open
Squareys opened this issue Jul 19, 2024 · 0 comments
Open

[Suggestions] Much faster imports #35

Squareys opened this issue Jul 19, 2024 · 0 comments

Comments

@Squareys
Copy link

Squareys commented Jul 19, 2024

Hey all,

The rate limit hit is actually the 300 requests / minute per webhook, so running the importer per channel in parallel gives a huge speedup. You will need to create a per-channel webhook name for that.

Additionally, messages can be appended to the previous message, if the user matches and no replies, files or reactions are attached to the previous file (remap the thread_ts for these appended messages). Beware of the max message length.

I have a very scrappy diff for this, which I might attach later. It's probably too scrappy for a merge request, though.

Best,
Jonathan

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant