Skip to content

Commit

Permalink
fix(embedding_metrics): add featurize_model_name argument to init for…
Browse files Browse the repository at this point in the history
… mauve score
  • Loading branch information
LucieNvz committed Oct 18, 2023
1 parent 1d45ec8 commit db39ad3
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions saga_llm_evaluation_ml/model/helpers/embedding_metrics.py
Original file line number Diff line number Diff line change
Expand Up @@ -39,13 +39,13 @@ def compute(self, references, predictions, **kwargs):


class MAUVE:
def __init__(self):
def __init__(self, featurize_model_name="gpt2"):
"""
MAUVE score computes the difference between the candidate sentence distribution and the reference sentence distribution.
The bigger the MAUVE score, the better.
"""
self.metric = load("mauve")
self.featurize_model_name = "gpt2"
self.featurize_model_name = featurize_model_name

def compute(self, references, predictions, **kwargs):
"""
Expand Down

0 comments on commit db39ad3

Please sign in to comment.