Skip to content

Actions: huggingface/lighteval

Actions

Quality

Actions

Loading...
Loading

Show workflow options

Create status badge

Loading
quality.yaml
789 workflow run results
789 workflow run results

Filter by Event

Filter by Status

Filter by Branch

Filter by Actor

Expose samples via the CLI Quality #851: Pull request #228 synchronize by clefourrier
July 18, 2024 12:58 2m 19s clem_details
clem_details
July 18, 2024 12:58 2m 19s
Removes default bert scorer init Quality #850: Pull request #234 opened by clefourrier
July 18, 2024 12:41 2m 21s bert_scorer_import
bert_scorer_import
July 18, 2024 12:41 2m 21s
Fixes #165 - adds a check with generation length is not set by the user Quality #849: Pull request #233 synchronize by NathanHB
July 18, 2024 11:14 2m 19s #165
#165
July 18, 2024 11:14 2m 19s
Fix a tiny bug in DROP metric (#229) Quality #848: Commit 66ed7a2 pushed by clefourrier
July 18, 2024 10:36 2m 11s main
main
July 18, 2024 10:36 2m 11s
Fixes #165 - adds a check with generation length is not set by the user Quality #847: Pull request #233 opened by clefourrier
July 18, 2024 09:41 2m 16s #165
#165
July 18, 2024 09:41 2m 16s
Fixing issues with multichoice_continuations_start_space - was not parsed properly Quality #846: Pull request #232 opened by clefourrier
July 18, 2024 08:54 2m 12s multichoice_continuations_start_space_fix
multichoice_continuations_start_space_fix
July 18, 2024 08:54 2m 12s
Fix a tiny bug in DROP metric Quality #845: Pull request #229 synchronize by sadra-barikbin
July 17, 2024 17:38 2m 18s sadra-barikbin:fix-drop
sadra-barikbin:fix-drop
July 17, 2024 17:38 2m 18s
A small improvement in metrics_sample.py::ROUGE Quality #844: Pull request #217 synchronize by clefourrier
July 17, 2024 15:12 2m 20s sadra-barikbin:small-improvement-in-rouge
sadra-barikbin:small-improvement-in-rouge
July 17, 2024 15:12 2m 20s
Fix a tiny bug in DROP metric Quality #843: Pull request #229 synchronize by clefourrier
July 17, 2024 14:51 2m 22s sadra-barikbin:fix-drop
sadra-barikbin:fix-drop
July 17, 2024 14:51 2m 22s
Quantization related issues (#224) Quality #842: Commit 44f9a46 pushed by clefourrier
July 17, 2024 14:36 2m 17s main
main
July 17, 2024 14:36 2m 17s
A small improvement in metrics_sample.py::ROUGE Quality #841: Pull request #217 synchronize by clefourrier
July 17, 2024 14:00 2m 25s sadra-barikbin:small-improvement-in-rouge
sadra-barikbin:small-improvement-in-rouge
July 17, 2024 14:00 2m 25s
Ar support for MBZUAI-arabic-mmlu Quality #840: Pull request #209 synchronize by clefourrier
July 17, 2024 13:58 2m 13s bakrianoo:ar-support-ArabicMMLU
bakrianoo:ar-support-ArabicMMLU
July 17, 2024 13:58 2m 13s
Quantization related issues Quality #839: Pull request #224 synchronize by clefourrier
July 17, 2024 13:49 3m 32s clem_bnb_gptq_config_bug
clem_bnb_gptq_config_bug
July 17, 2024 13:49 3m 32s
Make evaluator invariant of input request type order (#215) Quality #838: Commit 951cd5b pushed by clefourrier
July 17, 2024 13:48 2m 19s main
main
July 17, 2024 13:48 2m 19s
Remove the latex writer since we don't use it Quality #837: Pull request #231 opened by clefourrier
July 17, 2024 13:48 2m 16s rm_latex_table
rm_latex_table
July 17, 2024 13:48 2m 16s
Quantization related issues Quality #836: Pull request #224 synchronize by clefourrier
July 17, 2024 13:33 2m 26s clem_bnb_gptq_config_bug
clem_bnb_gptq_config_bug
July 17, 2024 13:33 2m 26s
Expose samples via the CLI Quality #835: Pull request #228 synchronize by clefourrier
July 17, 2024 13:23 2m 17s clem_details
clem_details
July 17, 2024 13:23 2m 17s
Fix a tiny bug in DROP metric Quality #834: Pull request #229 opened by sadra-barikbin
July 17, 2024 12:59 4m 19s sadra-barikbin:fix-drop
sadra-barikbin:fix-drop
July 17, 2024 12:59 4m 19s
Make evaluator invariant of input request type order Quality #833: Pull request #215 synchronize by clefourrier
July 17, 2024 12:35 2m 32s sadra-barikbin:Fix-request-type-order-in-evaluator
sadra-barikbin:Fix-request-type-order-in-evaluator
July 17, 2024 12:35 2m 32s
Fix _init_max_length in base_model.py (#185) Quality #832: Commit d43c9a3 pushed by clefourrier
July 17, 2024 12:34 2m 20s main
main
July 17, 2024 12:34 2m 20s
Fix _init_max_length in base_model.py Quality #831: Pull request #185 synchronize by clefourrier
July 17, 2024 11:33 2m 18s gucci-j:dev-gucci
gucci-j:dev-gucci
July 17, 2024 11:33 2m 18s
A small improvement in metrics_sample.py::ROUGE Quality #829: Pull request #217 synchronize by sadra-barikbin
July 17, 2024 10:31 2m 33s sadra-barikbin:small-improvement-in-rouge
sadra-barikbin:small-improvement-in-rouge
July 17, 2024 10:31 2m 33s
Expose samples via the CLI Quality #828: Pull request #228 synchronize by clefourrier
July 17, 2024 10:15 2m 23s clem_details
clem_details
July 17, 2024 10:15 2m 23s
Expose samples via the CLI Quality #827: Pull request #228 opened by clefourrier
July 17, 2024 09:19 2m 20s clem_details
clem_details
July 17, 2024 09:19 2m 20s
launch lighteval using lighteval --args (#152) Quality #826: Commit 4550cb7 pushed by clefourrier
July 17, 2024 09:16 2m 13s main
main
July 17, 2024 09:16 2m 13s