You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
We should check how TREC handle qrel binarization and follow the same process, paying attention to types and trying to make things as clear as possible.
The text was updated successfully, but these errors were encountered:
actually right now it is a bit of a bug that we cast the value to int and if the max value is > 1 we don't normalize the metric to [0,1] (I guess the RBP paper also doesn't do this)
Yeah, we should check how to handle - I believe we should allow gain mapping to floats like you suggested, but we'd need to be explicit about it somehow. Perhaps just let the qrels reader handle floats?
We should check how TREC handle qrel binarization and follow the same process, paying attention to types and trying to make things as clear as possible.
The text was updated successfully, but these errors were encountered: