Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add an option to make a persistent interceptor queue #57

Merged
merged 5 commits into from
Sep 3, 2024

Conversation

fillson-shady
Copy link
Collaborator

Adds an option to make a persistent interceptor queue, so messages won't be lost if connection is interrupted.

(cherry picked from commit 9851917)
(cherry picked from commit 322a212)
@fillson-shady fillson-shady requested a review from ghokun September 3, 2024 20:36
coyote.go Outdated
)
if err != nil {
return fmt.Errorf("%s %w", color.RedString("failed to declare a queue:"), err)
}
if persistent {
defer func() {
log.Printf("💔 Deleting queue %s", q.Name)
Copy link
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This will delete the queue even if it is persistent right? Can you help me understand what is the benefit here?

Copy link
Owner

@ghokun ghokun Sep 3, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

On a second look, I have an idea to use --queue argument to create persistent queue. Allow coyote to reconnect to an existing queue.

By default we generate interceptor queue names randomly with an UUID suffix:

<queue_name:interceptor>.<uuid>

We can make it persistent if queue argument is provided.

# queue name will not be suffixed with an UUID.
coyote --queue <queue_name>

In this case coyote will try to bind to the queue if it exists or create it does not.

So persistent flag is not needed anymore. What do you think?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You right! The logic here is coupled with a reconnection logic - if the queue is not persistent and we're disconnected from a cluster then RabbitMQ will automatically delete it.
Do you think it might be useful to have an extra flag to enable/disable the queue auto deletion?

Copy link
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

For now I tied it to queue argument being present or not. Let's revisit with auto reconnect functionality.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

That's a brilliant idea, I like it! And indeed it makes sense to keep the queue even between restarts.

README.md Outdated Show resolved Hide resolved
@ghokun ghokun merged commit 6608716 into main Sep 3, 2024
5 checks passed
@ghokun ghokun deleted the vfilatov/persistent-queue branch September 3, 2024 21:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants