Unstable network connection when switch is set to 100 Mbps

[earth4s]

I haven't been able to figure this out but I have to force 10 Mbps FDX on my switch to get a stable connection to my NanoKVMs. Ping show random drops and I an unable to access the Web interface when set to auto negotiate or 100 Mpbs.

1. Switch is a Ubiquiti "USW Pro 48 PoE"
2. Used multiple Ethernet Cables, both shielded and unshielded.
3. POE is disabled on the ports used and does not affect stability in any meaningful way
4. Port default is "auto" 10 Mbps/100 Mbps/1 Gbps negotiation
5. When the ports are set to 100 Mbps FDX or HDX the connection is just as unstable as "auto"
6. NanoKVM is flashed with v1.3.0
7. So far affects all the NanoKVMs I have used (I have open only 3 of 5 NanoKVMs that I own)
8. 10 Mbps FDX is the only stable port configuration I have found
9. I have another switch in route (another Ubiquiti switch) that I might be able to test with soon.

Any ideas on what might be the issue on why 100 Mbps is unstable? Or any additional configuration I can test?