Code

adds llm as judge using transformers#223

Code

Merged

NathanHB merged 23 commits intomainhuggingface/lighteval:mainfrom nathan-add-judge-transformershuggingface/lighteval:nathan-add-judge-transformersCopy head branch name to clipboardAug 14, 2024

+152-91

Commits

Commits on Apr 26, 2024

• Transformers as Judge added

  anilaltuner

  committed
  fdb22c7

• Transformers as Judge added

  anilaltuner

  committed
  6906b04

Commits on Apr 30, 2024

• Formatting fix

  anilaltuner

  committed
  8a33c12

Commits on May 23, 2024

• Check model from HfApi

  anilaltuner

  committed
  aef34a7

Commits on Jul 3, 2024

• Merge branch 'main' into main

  clefourrier

  authored
  8ebfb16

• Merge branch 'main' into main

  clefourrier

  authored
  c8e26f0

Commits on Jul 11, 2024

• Merge branch 'main' into main

  NathanHB

  authored
  6f976c7

• fixes after merge with main

  NathanHB

  committed
  1e0a720

Commits on Jul 24, 2024

• linting

  NathanHB

  committed
  a54b888

• fix doc

  NathanHB

  committed
  ba8c7bf

• Merge remote-tracking branch 'origin/main' into nathan-add-judge-transformers

  NathanHB

  committed
  36ed509

• merge

  NathanHB

  committed
  e6c9a99

Commits on Jul 25, 2024

• readd openai and adds llama 3 405b as judge

  NathanHB

  committed
  a75d057

• Merge branch 'main' into nathan-add-judge-transformers

  clefourrier

  authored
  27585fa

Commits on Jul 30, 2024

• fixing PR comments

  NathanHB

  committed
  0ce15da

• Merge branch 'nathan-add-judge-transformers' of github.com:huggingface/lighteval into nathan-add-judge-transformers

  NathanHB

  committed
  131c90e

Commits on Jul 31, 2024

• Update src/lighteval/metrics/llm_as_judge.py

  Show description for bb742c9
  

  NathanHB

  and

  clefourrier

  authored
  bb742c9

• add nits

  NathanHB

  committed
  2b8a078

• fix tests

  NathanHB

  committed
  3109dcd

• fix tests

  NathanHB

  committed
  5df8df3

Commits on Aug 8, 2024

• Merge branch 'main' into nathan-add-judge-transformers

  clefourrier

  authored
  ea12185

Commits on Aug 14, 2024

• fix tests

  NathanHB

  committed
  97b7b42

• Merge branch 'main' into nathan-add-judge-transformers

  NathanHB

  authored
  5633fdc