Code

WIP: Add MultiGPU support#12

Code

Draft

YellowRoseCx wants to merge 11 commits into0cc4m:latestmerge0cc4m/GPTQ-for-LLaMa:latestmergefrom YellowRoseCx:multigpu-gptqYellowRoseCx/GPTQ-for-LLaMa:multigpu-gptqCopy head branch name to clipboard

+28-4

Commits

Commits on May 16, 2023

• Begin patch

  YellowRoseCx

  authored
  ddca545

Commits on May 23, 2023

• Merge branch '0cc4m:latestmerge' into multigpu-gptq

  YellowRoseCx

  authored
  1c92a99

• playing around and testing

  YellowRoseCx

  authored
  379bdb3

• playing around and testing

  YellowRoseCx

  authored
  146c7c7

Commits on May 25, 2023

• Prevent GPU Out Of Memory

  YellowRoseCx

  authored
  10eec3c

• Update modelutils.py

  YellowRoseCx

  authored
  a89c4e3

• multi gpu work in progress

  YellowRoseCx

  authored
  30512d5

• uncomment 2 lines

  YellowRoseCx

  authored
  d1fd82d

• Update llama.py

  YellowRoseCx

  authored
  5330d3c

• Update llama.py

  YellowRoseCx

  authored
  f97f830

• Update llama.py

  YellowRoseCx

  authored
  3e9d3b2