"make test" always uses the last successfully build binary although building failed

[smehringer]

This can lead to 100% tests passed although one of the tests failed to build and should thereby also fail the test (not run).

Acceptance Criteria

• If a test fails to build the test should not pass when running make test

[marehr]

This is standard behaviour of cmake. We can't change that?!

EDIT:// I forgot that we added non-standard behaviour that make test builds the tests.

[smehringer]

This is standard behaviour of cmake. We can't change that?!

When I mentioned that in Gitter you said Write that down :) 🤷 So I thought it's worth an issue.
If we won't change this anyway I can clode the issue again.

[joergi-w]

I currently see 3 solutions:

1. Automatically perform a make clean before each make test build – disadvantage: unnecessarily long build time.
2. Implement standard behaviour and build tests with make – disadvantage: much refactoring.
3. Actively delete the respective existing binary file when a build fails – disadvantage: even more non-standard code.