Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ytap] Use a ymsg service to tap into a running ETL #125

Open
preaction opened this issue Feb 9, 2015 · 2 comments
Open

[ytap] Use a ymsg service to tap into a running ETL #125

preaction opened this issue Feb 9, 2015 · 2 comments
Labels

Comments

@preaction
Copy link
Owner

It would be really nice if I could tap into a running ETL to see what it's doing. Since ymsg (#46) will allow us to send/recv messages, it'd be nice if there was a way to send messages on-demand without interrupting the workflow.

Normally, we could just use ymsg in a send mode, and then any number of listeners can listen for messages. But what if we don't want to make the job distributed?

This might make more sense as part of ymsg...

@preaction
Copy link
Owner Author

This is different from #141, because this involves the data. ytap spout or ymsg spout would create a tapping point so that anyone could plug in to the data stream. Now I'm thinking this should be part of ymsg...

@preaction
Copy link
Owner Author

ymsg tee is another possible word. The endpoint would define how it performs: if it connects out to somewhere else, or if someone connects in to it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant