Dynamically generate invalid config files in unit tests

Dynamically generate invalid config files in unit tests #1060