You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Describe the bug
SQL queries with UDFs are hard to quantify in terms of what is the actual cost of them falling back to the CPU. Recently some of the customers reported Q tool speedup values of 3x while the actual runtimes were 2x slower.
Expected behavior
We should mark the whole stage as a CPU fallback and penalize UDF SQL queries heavily to indicate them as bad migration candidates.
The text was updated successfully, but these errors were encountered:
amahussein
changed the title
[BUG] Qualification: Jobs with UDFs can have considerably inaccurate recommended speed up time.
[BUG] Qualification: Jobs with UDFs may have inaccurate speedups
Jan 19, 2024
Adding penalty for stages with UDF's is done and UDF's are detected correctly in the qualification tool. But it didn't improve the total speedup factor as we do the average of speedups across all stages. I would still keep it open but lower the priority of it to investigate if other improvements can be done.
Describe the bug
SQL queries with UDFs are hard to quantify in terms of what is the actual cost of them falling back to the CPU. Recently some of the customers reported Q tool speedup values of 3x while the actual runtimes were 2x slower.
Expected behavior
We should mark the whole stage as a CPU fallback and penalize UDF SQL queries heavily to indicate them as bad migration candidates.
The text was updated successfully, but these errors were encountered: