the calculation of the FullyConnected layer takes a lot of time

[zhaohb]

now I have a model, and I've pressed it with benchmark and found that the FullyConnected layer takes a lot of time，about 25% of the total inference time：

dense/BiasAdd                 EXECUTED       layerType: FullyConnected     realTime: 4481      cpu: 4481           execType: jit_gemm_FP32
...
dense_2/BiasAdd               EXECUTED       layerType: FullyConnected     realTime: 4490      cpu: 4490           execType: jit_gemm_FP32
...

In this link https://toscode.gitee.com/vinsonSpace/openvino/blob/master/build-instruction.md saw that GEMM can be accelerated through openblas or MKL：

I want to use mkl:

cmake ..     -DENABLE_CLDNN=OFF     -DENABLE_OPENCV=OFF     -DENABLE_VPU=OFF     -DENABLE_PYTHON=ON    -DNGRAPH_ONNX_IMPORT_ENABLE=ON -DNGRAPH_ONNX_FRONTEND_ENABLE=ON  -DNGRAPH_ONNX_EDITOR_ENABLE=ON  -DGEMM=MKL -DMKLROOT=/work/compile_ov_20214/mklml_lnx_2019.0.5.20190502  -DCMAKE_INSTALL_PREFIX=/work/compile_ov_20214/openvino_dist

but I am reminded that this GEMM macro is not available.

CMake Warning:
  Manually-specified variables were not used by the project:

    GEMM
    DMKLROOT
......

openvino doesn't support this macro？

[zhaohb]

my bad, GEMM macros can be set in version 2021.1, but now I'm using 2021.4.
but how do I choose gemm's implementation? Or will it automatically choose the best performance implementation, MKL or openblas？

[mzegla]

This issue is not related to the model server, but OpenVINO itself.
I can see the thread is continued in openvinotoolkit/openvino#7273, so I'm closing this one.