auto_queues widget should check AllowQos property for slurm partitions

[simonLeary42]

a slurm partition can have a QOS whitelist (AllowQos), and users can be granted access to a QOS with an "association" in the slurm database. If a user attempts to schedule a job on an AllowQos partition, and they aren't associated with any of the allowed QOSes, they get an invalid QOS specification error. It would be nice if the auto_queues widget did not display (or grayed out) slurm partitions which aren't accessible by the current user.

I previously wrote some python code that gets the current user's QOSes from sacctmgr:

my_associations = json.loads(
    subp.check_output(
        [
            "/usr/bin/sacctmgr",
            "show",
            "association",
            "--json",
            f"user={os.getenv('USER')}",
        ]
    )
)
my_qos = [x["qos"] for x in my_associations["associations"] if "qos" in x]

[simonLeary42]

The logic already exists to check whether partition access is allowed based on AllowAccounts, so it seems natural that it should also respect AllowQos:

ondemand/apps/dashboard/app/lib/account_cache.rb

Line 132 in 5ec1821

def blocked_queue?(queue)

[simonLeary42]

After doing some reading, I see that OOD core already knows which QOS the current user has access to. What it doesn't know is how those accounts QOS can be used to determine partition access.

https://github.com/OSC/ood_core/blob/4342e29119c9db3a4860940f83191ba1cb760156/lib/ood_core/job/adapters/slurm.rb#L369

[johrstrom]

Thanks for the issue. I don't think I can get this into 4.0, but we'll see about the next next release.