Add filter for test directory in runtest util

[hpatro]

Helps testing specific functionality like cluster rather than running the entire test suite.

Usage example

./runtest --test-dir tests/unit/cluster

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 70.26%. Comparing base (e65b2d2) to head (5391733).
Report is 2 commits behind head on unstable.

Additional details and impacted files

@@             Coverage Diff              @@
##           unstable     #630      +/-   ##
============================================
+ Coverage     70.11%   70.26%   +0.14%     
============================================
  Files           110      110              
  Lines         60038    60039       +1     
============================================
+ Hits          42096    42184      +88     
+ Misses        17942    17855      -87     

see 22 files with indirect coverage changes

[zuiderkwast]

Nice.

What I've really been missing though is the possibility to find test suites using tab completion.

What if we add an option that takes a file name as its arguments? I mean a path relative to the working directory, so that tab completion actually works. If a directory is provided, it can run all tests in that directory. WDYT?

[hpatro]

Nice.

What I've really been missing though is the possibility to find test suites using tab completion.

What if we add an option that takes a file name as its arguments? I mean a path relative to the working directory, so that tab completion actually works. If a directory is provided, it can run all tests in that directory. WDYT?

Good suggestion. Let me try out.

[hpatro]

@zuiderkwast PTAL

[zuiderkwast]

It looks like it can work, with these limitations:

• It accepts paths relative the repo root dir only. It doesn't accept absolute paths or relative somewhere else, if the current directory is changed.
• It can't be repeated, like --single can.

How about we make --single and --skipunit and others work with filenames and dirs in addition to the current format? We could expand all unit names to absolut names and work with that internally. I think we can trust filenames from the user without filtering them.

[madolson]

How about we make --single and --skipunit and others work with filenames and dirs in addition to the current format?

I like this idea.