VILA-Lab: Vision and Language Acceleration Lab

All

9 repositories

Mobile-MMLU
Public
Mobile-MMLU: A Mobile Intelligence Language Understanding Benchmark
benchmark mobile ai llm
Python
•
MIT License
•1•7•0•0•Updated Dec 26, 2024Dec 26, 2024
Mobile_MMLU
Public
HTML
•0•0•0•0•Updated Dec 25, 2024Dec 25, 2024
DELT
Public
Official implementation to DELT: A Simple Diversity-driven EarlyLate Training for Dataset Distillation which outperforms SOTA top 1-acc by +1.3% and increases diversity per class by +5%
image-synthesis dataset-distillation dataset-condensation
Python
•0•18•0•0•Updated Dec 2, 2024Dec 2, 2024
SRe2L
Public
(NeurIPS 2023 spotlight) Large-scale Dataset Distillation/Condensation, 50 IPC (Images Per Class) achieves the highest 60.8% on original ImageNet-1K val set.
image-synthesis dataset-distillation dataset-condensation
Python
•18•123•1•0•Updated Nov 15, 2024Nov 15, 2024
Open-LLM-Leaderboard
Public
Open-LLM-Leaderboard: Open-Style Question Evaluation. Paper at https://arxiv.org/abs/2406.07545
leaderboard llms open-ended-question-marker llm-evaluation open-ended-evaluation llm-leaderboard
Python
•
Creative Commons Attribution 4.0 International
•3•35•1•0•Updated Jun 27, 2024Jun 27, 2024
Open-LLM-Leaderboard-Website
Public
HTML
•0•1•0•0•Updated Jun 15, 2024Jun 15, 2024
ATLAS
Public
A principled instruction benchmark on formulating effective queries and prompts for large language models (LLMs). Our paper: https://arxiv.org/abs/2312.16171
Python
•
Apache License 2.0
•94•938•6•0•Updated May 28, 2024May 28, 2024
GBLM-Pruner
Public
Are gradient information useful for pruning of LLMs?
Python
•
MIT License
•8•40•1•0•Updated Apr 22, 2024Apr 22, 2024
i-mae
Public
i-mae Pytorch Repo
Python
•3•19•2•0•Updated Apr 6, 2024Apr 6, 2024