Add machinery to run test only on changed files

Add machinery to run test only on changed files #3393