Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Provide a way to run benchmarks with alternate framework configs #244

Open
diptorupd opened this issue May 1, 2023 · 1 comment
Open

Comments

@diptorupd
Copy link

The helper function runner.run_benchmarks does not offer a way to run the benchmarks with an external set of framework configurations.

I want to run dpbench in batch mode with a set of framework configs that change the sycl_device attribute. However, as the runner.run_benchmarks only reads configs from the default location, I cannot submit multiple jobs where each job has a different sycl_device.

@diptorupd diptorupd changed the title Provide a way to run benchmarks with alternat framework configs Provide a way to run benchmarks with alternate framework configs May 10, 2023
@ZzEeKkAa
Copy link
Contributor

I agree that we need to provide external framework support, but for this particular problem we can just use run flag:

> dpbench run --help

Subcommand to run benchmark executions.

options:
  --sycl-device [SYCL_DEVICE]
                        Sycl device to overwrite for framework configurations.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants