Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

BigQuery slot computation: don't "average" the slots #5

Open
sourygna-cts opened this issue Apr 17, 2023 · 0 comments
Open

BigQuery slot computation: don't "average" the slots #5

sourygna-cts opened this issue Apr 17, 2023 · 0 comments

Comments

@sourygna-cts
Copy link

When doing some aggregations to compute the amount of slots per unit of time (like in the queries: query_slots_per_second.sql & slots_by_second.sql), the slots per unit of time is assessed by doing a sort of average of the slot usage ("SAFE_DIVIDE(total_slot_ms, )").

This makes the (false) assumption that the slot usage is always the same during the whole duration of the query.

Instead of using the JOBS_BY_PROJECT tables, it is possible to use the JOBS_TIMELINE tables, which give a better insight of what happens each second

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant