Skip to content

Releases: Sagacify/saga-llm-evaluation

v0.10.0

27 Jun 15:28
Compare
Choose a tag to compare

Feature

  • pyproject: Remove bleurt from dependencies, add it to readme (49ffac0)

v0.9.0

27 Jun 14:25
Compare
Choose a tag to compare

Feature

  • cd: Add token pypi to poetry in cd (0879230)

v0.8.0

04 Jun 11:52
Compare
Choose a tag to compare

Feature

  • Make publishing public to PyPI (64fbb80)

v0.7.2

08 Dec 09:36
Compare
Choose a tag to compare

Fix

  • cd: Add password for private repo (c509d8a)
  • cd: Add username cred for private repo (6e02408)
  • pyproject: Re-add private repo to poetry (7360b4a)

v0.7.1

08 Dec 08:43
Compare
Choose a tag to compare

Fix

  • cd: Update credentials for private repo (d2832a3)

v0.7.0

07 Dec 16:11
Compare
Choose a tag to compare

Feature

  • project: Llama model can be now load from local, minor fix, improve doc (6064ffc)
  • project: Redesigned scorer, llm_metrics support lists as input, scorer test skipped (99932ea)
  • llm_metric: For each llm_metric, evaluation model can be passed as input (d01ca44)

Fix

  • llm_metrics: Unify default value for models (c467e28)

Documentation

  • language_metrics: Adjust doc for q_squared compute function (8fa7e97)

v0.6.0

26 Oct 14:30
Compare
Choose a tag to compare

Feature

  • add_aspects: Add aspects to geval and gptscore small changes in arguments (d76676d)
  • scorer: Add scorer class support (c457d31)

v0.5.0

25 Oct 08:43
Compare
Choose a tag to compare

Feature

  • llm_metrics: Refactor gptscore and add support for geval and selfcheck (980acdb)
  • gptscore: Revamp to make multiple predictions at once (ce999f8)
  • gptscore: Add gptscore support (09d2cba)

Fix

  • format: Run pylint and black (7986b7f)
  • pylint: Format code (4f44004)

v0.4.0

23 Oct 14:27
Compare
Choose a tag to compare

Feature

  • language_metrics: Add q squared (329b7bd)

Fix

  • versions: Update versions of tensorflow back (a25acd7)

v0.3.0

19 Oct 08:29
Compare
Choose a tag to compare

Feature

  • metadata: Add support for computing simple metadata (1f12800)

Fix

  • ci: Downgraded elemeta to 1.0.7 (c8c872c)
  • ci: Attempt for fixing ci (74b2078)