Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add 2 new option arguments for BW, 'topics' and 'schemas', If set, BW will only snapshot/streaming these 'topics' in these 'schemas', 'topics' and 'schemas' are vertical-line separated list. #101

Closed
wants to merge 164 commits into from

Conversation

badboyd
Copy link
Contributor

@badboyd badboyd commented Aug 3, 2016

No description provided.

Hien and others added 30 commits April 24, 2016 17:00
@badboyd
Copy link
Contributor Author

badboyd commented Sep 9, 2016

Sorry, I've just added this commit to my branch, so it will be on this PR. Are you ok with this ? 😟

Copy link
Contributor

@samstokes samstokes left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@badboyd sorry for leaving this hanging for so long. I'm no longer working actively on Bottled Water and I've been busy with other projects.

Thanks for all your changes. The default behaviour still isn't quite right, but we're almost there!

Regarding the VARATT_IS_EXTERNAL_ONDISK commit, did you find it fixed the problem you described in #113? So long as it does actually fix #113 then I think it's okay to include it in this PR. (It's better in general if you can do pull requests from a separate branch, so that you can keep working on your fork's master while the pull request is waiting to be merged, but I don't want to ask you to reshuffle your commits when you've already spent so much time on this :))

@@ -432,6 +432,12 @@ int snapshot_tuple(client_context_t context, PGresult *res, int row_number) {
/* Lookup for table oids from schema_pattern and table_pattern
If schema_pattern == % and table_pattern == % then BW will get all tables in db */
int lookup_table_oids(client_context_t context) {

if (strcmp(context->table_pattern, "%%") == 0 && strcmp(context->schema_pattern, "%%") == 0) {
Copy link
Contributor

@samstokes samstokes Oct 5, 2016

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for restoring this check, but I still think we should use "" (the empty string) as the default (i.e. strcmp(..., "")), rather than "%%". As I described in this comment, using "%%" as the default means we have confusing behaviour if someone explicitly specifies --tables=%%.

@kinghuang
Copy link

Just wanted to say thanks for the time that both of you — @samstokes and @badboyd — have put into this! I'm keenly interested in seeing this PR land. I'm not sure what the protocol is for this repo, but I'm happy to contribute some time as a reviewer or developer to assist, if that helps.

Add a clearer log for unknown config.
@kinghuang
Copy link

Any updates on this PR?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants