Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add tpcds refresh queries for sf1 #3

Open
wants to merge 3 commits into
base: main
Choose a base branch
from

Conversation

pratyakshsharma
Copy link

@pratyakshsharma pratyakshsharma commented Jun 6, 2024

Add data maintenance insert functions for tpc-ds sf1 scale factor. Currently only one stream is supported with insert functions.
Delete functions will be added in a separate PR.

@ethanyzhang
Copy link
Collaborator

Why there are some empty sql files?

Copy link
Member

@wanglinsong wanglinsong left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please remove those empty files.

cr_reversed_charge,
cr_merchant_credit,
cast(cr_net_loss as decimal(7,2))
FROM crv;
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

please add a \n at the end of all files

"queries/refresh/LF_CR.sql",
"queries/verify_LF_CR.sql"
]
}
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

any expected number of rows returned?

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

so the expected number of rows is actually an expression like >=2. Do we support such expressions currently @wanglinsong ?

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

How do you tell if the verification is successful?

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we can decide based on the number of rows getting returned. The number of rows getting returned can be >=2, and I am not sure if such an expression is currently supported.

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

So there is a way to compare the output with a baseline result and is currently being used for ds_orderby flavor. We will extend that support for ds_refresh flavor as well.

@ethanyzhang ethanyzhang force-pushed the main branch 3 times, most recently from e189d61 to f43d5e2 Compare June 20, 2024 09:22
"queries/refresh/LF_CR.sql",
"queries/verify_LF_CR.sql"
]
}
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

How do you tell if the verification is successful?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants