You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Installation with default CMakeLists.txt parameters for me, working on the old i3770k caused a stop error and the chat did not open. managed to solve the problem a few days ago by disabling all microinstructions, but the performance did not suit me, a dozen characters were displayed in responses for more than a minute. #160 (comment)
Now I propose the second option for editing CMakeLists.txt - here are the lines changed in it:
(all parameters avx2 are replaced by avx)
after compiling with these settings, the program works correctly with activated AVX and the speed of responses has increased
(full modified CMakeLists.txt in attachment) CMakeLists.txt
The text was updated successfully, but these errors were encountered:
Installation with default CMakeLists.txt parameters for me, working on the old i3770k caused a stop error and the chat did not open. managed to solve the problem a few days ago by disabling all microinstructions, but the performance did not suit me, a dozen characters were displayed in responses for more than a minute. #160 (comment)
Now I propose the second option for editing CMakeLists.txt - here are the lines changed in it:
(all parameters avx2 are replaced by avx)
else()
message(STATUS "x86 detected")
if (MSVC)
set(CMAKE_CXX_FLAGS "${CMAKE_CXX_FLAGS} /arch:AVX")
set(CMAKE_CXX_FLAGS_RELEASE "${CMAKE_CXX_FLAGS_RELEASE} /arch:AVX")
set(CMAKE_C_FLAGS "${CMAKE_C_FLAGS} /arch:AVX")
else()
if(NOT LLAMA_NO_AVX)
set(CMAKE_C_FLAGS "${CMAKE_C_FLAGS} -mavx")
endif()
if(NOT LLAMA_NO_AVX2)
set(CMAKE_C_FLAGS "${CMAKE_C_FLAGS} -mavx")
endif()
if(NOT LLAMA_NO_FMA)
set(CMAKE_C_FLAGS "${CMAKE_C_FLAGS} -mfma")
endif()
set(CMAKE_C_FLAGS "${CMAKE_C_FLAGS} -mf16c")
endif()
endif()
after compiling with these settings, the program works correctly with activated AVX and the speed of responses has increased
(full modified CMakeLists.txt in attachment) CMakeLists.txt
The text was updated successfully, but these errors were encountered: