How to add linter/fixer only for certain file names

[pbrisbin]

I'd like to use the actionlint linter but only if the current path matches .github/workflows/*.yml. This seems like an obvious thing to want, but I can't seem to fully solve it.

I've gotten it to half-work with:

  autocmd BufNewFile,BufRead .github/workflows/*.yml
    \ call add(g:ale_linters["yaml"], "actionlint")

With this, opening any yaml file doesn't use actionlint, but opening a workflow file does -- as desired.

Problem is, once I do open a workflow file, the linter is now there forever. If I open some other yaml file in the same vim session, it's still active and ALE yells at me about all the workflow lints.

I've attempted to remove the linter on non-workflow yaml files through a similar autocmd, which is I think the approach I want, but nothing I try seems to work. I can only close and re-open vim to fix it.

Any suggestions?