Code

Basic components with tracing supports#4

Code

Open

Celve wants to merge 17 commits intomainCoLearn-Dev/deserve:mainfrom worker_traceCoLearn-Dev/deserve:worker_traceCopy head branch name to clipboard

+3,082

Commits

Commits on Jul 30, 2024

• feat: add naive worker implementation

  Celve

  committed
  478cbe0

  Copy full SHA for 478cbe0

• feat: support batch forward with correctness verified

  Celve

  committed
  5f365a7

  Copy full SHA for 5f365a7

• chore: simplify some structure

  Celve

  committed
  a858053

  Copy full SHA for a858053

Commits on Jul 31, 2024

• feat: support batch forward

  Celve

  committed
  7d6063b

  Copy full SHA for 7d6063b

• feat: support batch result

  Celve

  committed
  5c2f700

  Copy full SHA for 5c2f700

• chore: move llama to model dir

  Celve

  committed
  710bd5a

  Copy full SHA for 710bd5a

Commits on Aug 1, 2024

• feat: support cancel at anytime

  Celve

  committed
  5e19f67

  Copy full SHA for 5e19f67

• feat: support shared layer storage

  Celve

  committed
  2ab64f4

  Copy full SHA for 2ab64f4

• feat: store block table in torch tensor

  Celve

  committed
  9fedc61

  Copy full SHA for 9fedc61

• chore: move some code

  Celve

  committed
  b0cb543

  Copy full SHA for b0cb543

Commits on Aug 2, 2024

• feat: support dumping traces

  Celve

  committed
  29e5c24

  Copy full SHA for 29e5c24

Commits on Aug 3, 2024

• feat: share memory for different KV cache

  Celve

  committed
  bee4e61

  Copy full SHA for bee4e61

• docs(worker): add readme

  Celve

  committed
  a706df1

  Copy full SHA for a706df1

• fix(worker): enable tracing

  Celve

  committed
  757301b

  Copy full SHA for 757301b

Commits on Aug 5, 2024

• feat: add controller and client

  Celve

  committed
  b08ec03

  Copy full SHA for b08ec03

• fix: end output when receives end of text

  Celve

  committed
  a8dd3e9

  Copy full SHA for a8dd3e9

• chore: format some files

  Celve

  committed
  6ec459a

  Copy full SHA for 6ec459a