Non-LORA trigger words will also trigger related images？

[poppysix]

I used this to train an avatar and it worked very well. But currently I have encountered a problem, that is, using this lora model, characters and animal images that are not associated with trigger words will become the same as virtual characters. Adjusting weights and using non-trigger words doesn't work either. Is there a way to solve this?