Pinned Loading

1. xlang-ai/OSWorld xlang-ai/OSWorld Public

   [NeurIPS 2024] OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments

   Python 1.4k 161

2. xlang-ai/Spider2-V xlang-ai/Spider2-V Public

   [NeurIPS 2024] Spider2-V: How Far Are Multimodal Agents From Automating Data Science and Engineering Workflows?

   Jupyter Notebook 110 7

3. xlang-ai/Spider2 xlang-ai/Spider2 Public

   Spider 2.0: Evaluating Language Models on Real-World Enterprise Text-to-SQL Workflows

   HTML 208 14

4. TableQAKit TableQAKit Public

   A Toolkit for Table-based Question Answering

   Python 106 7

5. S3Eval S3Eval Public

   [NAACL 2024] A Synthetic, Scalable and Systematic Evaluation Suite for Large Language Models

   Python 33 1

6. yiyihum/da-code yiyihum/da-code Public

   [EMNLP 2024] DA-Code: Agent Data Science Code Generation Benchmark for Large Language Models

   Python 55 4