-
Notifications
You must be signed in to change notification settings - Fork 10
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add tpcds refresh queries for sf1 #3
base: main
Are you sure you want to change the base?
Conversation
Why there are some empty sql files? |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Please remove those empty files.
cr_reversed_charge, | ||
cr_merchant_credit, | ||
cast(cr_net_loss as decimal(7,2)) | ||
FROM crv; |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
please add a \n at the end of all files
"queries/refresh/LF_CR.sql", | ||
"queries/verify_LF_CR.sql" | ||
] | ||
} |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
any expected number of rows returned?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
so the expected number of rows is actually an expression like >=2. Do we support such expressions currently @wanglinsong ?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
How do you tell if the verification is successful?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
we can decide based on the number of rows getting returned. The number of rows getting returned can be >=2, and I am not sure if such an expression is currently supported.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
So there is a way to compare the output with a baseline result and is currently being used for ds_orderby flavor. We will extend that support for ds_refresh flavor as well.
e189d61
to
f43d5e2
Compare
"queries/refresh/LF_CR.sql", | ||
"queries/verify_LF_CR.sql" | ||
] | ||
} |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
How do you tell if the verification is successful?
7a4e2e4
to
72b23c7
Compare
5a8166d
to
be4d3be
Compare
Add data maintenance insert functions for tpc-ds sf1 scale factor. Currently only one stream is supported with insert functions.
Delete functions will be added in a separate PR.