Add machinery to run test only on changed files

Add machinery to run test only on changed files #4952