Question about the time spent in Evaluation

[cs911]

During the Evaluation phase (evaluate fid prdc of the model) when I train the model, sometimes it takes ten minutes, sometimes two or three hours. And the gpu utilization is sometimes very high and sometimes very low. Why? My gpu is 2080ti.

[alex4727]

Hi,
FID and IS evaluation codes are mostly composed of GPU (CUDA) codes so they work faster.
PRDC on the other hand, tends to take longer time as it runs on CPU.
Besides, the size of dataset increases computing time of PRDC a lot more than FID so you should consider omitting PRDC if your dataset is too big or you don't need them.