From 0a028139fefe9f8f408763eed3242bce39a8c535 Mon Sep 17 00:00:00 2001 From: "github-actions[bot]" <41898282+github-actions[bot]@users.noreply.github.com> Date: Sat, 13 Jul 2024 15:50:55 +0000 Subject: [PATCH] Deployed 81f762c with MkDocs version: 1.6.0 --- index.html | 5 +---- search/search_index.json | 2 +- 2 files changed, 2 insertions(+), 5 deletions(-) diff --git a/index.html b/index.html index 2b6129c..e98a111 100644 --- a/index.html +++ b/index.html @@ -606,10 +606,7 @@

SciCode: A Research Coding Benchmark Curated by Scientists

-Minyang Tian1,2*, Luyu Gao3*, Shizhuo Dylan Zhang1, Xinan Chen1†, Cunwei Fan1†, Xuefei Guo1†, Roland Haas1†, Pan Ji4†, Kittithat Krongchon1†, Yao Li1†, Shengyan Liu1†, Di Luo5,6,11†, Yutao Ma7†, Hao Tong1†, Kha Trinh7†, Chenyu Tian8†, Zihan Wang1†, Bohao Wu1†, Yanyu Xiong9†, Shengzhu Yin1†, Minhui Zhu1†, Kilian Lieret10, Yanxin Lu1, Genglin Liu1, Yufeng Du1, Tianhua Tao1 -

-

-Ofir Press10, Jamie Callan3, Eliu Huerta1,2,7, Hao Peng1 +Minyang Tian1,2*, Luyu Gao3*, Shizhuo Dylan Zhang1, Xinan Chen1†, Cunwei Fan1†, Xuefei Guo1†, Roland Haas1†, Pan Ji4†, Kittithat Krongchon1†, Yao Li1†, Shengyan Liu1†, Di Luo5,6,11†, Yutao Ma7†, Hao Tong1†, Kha Trinh7†, Chenyu Tian8†, Zihan Wang1†, Bohao Wu1†, Yanyu Xiong9†, Shengzhu Yin1†, Minhui Zhu1†, Kilian Lieret10, Yanxin Lu1, Genglin Liu1, Yufeng Du1, Tianhua Tao1, Ofir Press10, Jamie Callan3, Eliu Huerta1,2,7, Hao Peng1

diff --git a/search/search_index.json b/search/search_index.json index 5190962..849699c 100644 --- a/search/search_index.json +++ b/search/search_index.json @@ -1 +1 @@ -{"config":{"lang":["en"],"separator":"[\\s\\-]+","pipeline":["stopWordFilter"]},"docs":[{"location":"","title":"SciCode: A Research Coding Benchmark Curated by Scientists","text":"

Minyang Tian1,2*, Luyu Gao3*, Shizhuo Dylan Zhang1, Xinan Chen1\u2020, Cunwei Fan1\u2020, Xuefei Guo1\u2020, Roland Haas1\u2020, Pan Ji4\u2020, Kittithat Krongchon1\u2020, Yao Li1\u2020, Shengyan Liu1\u2020, Di Luo5,6,11\u2020, Yutao Ma7\u2020, Hao Tong1\u2020, Kha Trinh7\u2020, Chenyu Tian8\u2020, Zihan Wang1\u2020, Bohao Wu1\u2020, Yanyu Xiong9\u2020, Shengzhu Yin1\u2020, Minhui Zhu1\u2020, Kilian Lieret10, Yanxin Lu1, Genglin Liu1, Yufeng Du1, Tianhua Tao1

Ofir Press10, Jamie Callan3, Eliu Huerta1,2,7, Hao Peng1

1University of Illinois Urbana-Champaign 2Argonne National Laboratory 3Carnegie Mellon University 4University of North Carolina at Chapel Hill 5Massachusetts Institute of Technology 6Harvard University 7University of Chicago 8University of Texas at Austin 9Stanford University 10Princeton University 11The NSF AI Institute for Artificial Intelligence and Fundamental Interactions

* Equal contribution lead authors. \u2020 Data curation, alphabetical order. - :material-book:{ .lg .middle } __Leaderboard__ --- How good are LMs at science, really? [:octicons-arrow-right-24: Browse the results](leaderboard.md) - :material-book:{ .lg .middle } __Preprint__ --- Learn all the details [:octicons-arrow-right-24: Read the preprint](https://arxiv.com) commodo ligula eget dolor. Aenean massa. Cum sociis natoque penatibus et magnis dis parturient montes, nascetur ridiculus mus. Donec quam felis, ultricies nec, pellentesque eu, pretium quis, sem. Nulla consequat massa quis enim. Donec pede justo, fringilla vel, aliquet nec, vulputate eget, arcu. In enim justo, rhoncus ut, imperdiet a, venenatis vitae, justo. Nullam dictum felis eu pede mollis pretium. Integer tincidunt. Cras dapibus. Vivamus elementum semper nisi. Aenean vulputate eleifend tellus. Aenean leo ligula, porttitor eu, consequat vitae, eleifend ac, enim. Aliquam lorem ante, dapibus in, viverra quis, feugiat a, tellus. Phasellus viverra nulla ut metus varius laoreet. Quisque rutrum. Aenean imperdiet. Etiam ultricies nisi vel augue. Curabitur ullamcorper ultricies nisi. Nam eget dui. Etiam rhoncus. Maecenas tempus, tellus eget condimentum rhoncus, sem quam semper libero, sit amet adipiscing sem neque sed ipsum. Nam quam nunc, blandit vel, luctus pulvinar, hendrerit id, lorem. Maecenas nec odio et ante tincidunt tempus. Donec vitae sapien ut libero venenatis faucibus. Nullam quis ante. Etiam sit amet orci eget eros faucibus tincidunt. Duis leo. Sed fringilla mauris sit amet nibh. Donec sodales sagittis magna. Sed consequat, leo eget bibendum sodales, augue velit cursus nunc. - :material-play:{ .lg .middle } __Installation & usage__ --- Learn how to evaluate your model [:octicons-arrow-right-24: Read the docs](docs/index.md)"},{"location":"_footer/","title":"footer","text":"

"},{"location":"leaderboard/","title":"Leaderboard","text":"

date author model score 240712 scicode gpt4 0.8 240712 scicode gpt4o 0.8

How to submit

Want to submit your own model? Head over to the documentation.

"},{"location":"leaderboard_table/","title":"Leaderboard table","text":"date author model score 240712 scicode gpt4 0.8 240712 scicode gpt4o 0.8"}]} \ No newline at end of file +{"config":{"lang":["en"],"separator":"[\\s\\-]+","pipeline":["stopWordFilter"]},"docs":[{"location":"","title":"SciCode: A Research Coding Benchmark Curated by Scientists","text":"

Minyang Tian1,2*, Luyu Gao3*, Shizhuo Dylan Zhang1, Xinan Chen1\u2020, Cunwei Fan1\u2020, Xuefei Guo1\u2020, Roland Haas1\u2020, Pan Ji4\u2020, Kittithat Krongchon1\u2020, Yao Li1\u2020, Shengyan Liu1\u2020, Di Luo5,6,11\u2020, Yutao Ma7\u2020, Hao Tong1\u2020, Kha Trinh7\u2020, Chenyu Tian8\u2020, Zihan Wang1\u2020, Bohao Wu1\u2020, Yanyu Xiong9\u2020, Shengzhu Yin1\u2020, Minhui Zhu1\u2020, Kilian Lieret10, Yanxin Lu1, Genglin Liu1, Yufeng Du1, Tianhua Tao1, Ofir Press10, Jamie Callan3, Eliu Huerta1,2,7, Hao Peng1

1University of Illinois Urbana-Champaign 2Argonne National Laboratory 3Carnegie Mellon University 4University of North Carolina at Chapel Hill 5Massachusetts Institute of Technology 6Harvard University 7University of Chicago 8University of Texas at Austin 9Stanford University 10Princeton University 11The NSF AI Institute for Artificial Intelligence and Fundamental Interactions

* Equal contribution lead authors. \u2020 Data curation, alphabetical order. - :material-book:{ .lg .middle } __Leaderboard__ --- How good are LMs at science, really? [:octicons-arrow-right-24: Browse the results](leaderboard.md) - :material-book:{ .lg .middle } __Preprint__ --- Learn all the details [:octicons-arrow-right-24: Read the preprint](https://arxiv.com) commodo ligula eget dolor. Aenean massa. Cum sociis natoque penatibus et magnis dis parturient montes, nascetur ridiculus mus. Donec quam felis, ultricies nec, pellentesque eu, pretium quis, sem. Nulla consequat massa quis enim. Donec pede justo, fringilla vel, aliquet nec, vulputate eget, arcu. In enim justo, rhoncus ut, imperdiet a, venenatis vitae, justo. Nullam dictum felis eu pede mollis pretium. Integer tincidunt. Cras dapibus. Vivamus elementum semper nisi. Aenean vulputate eleifend tellus. Aenean leo ligula, porttitor eu, consequat vitae, eleifend ac, enim. Aliquam lorem ante, dapibus in, viverra quis, feugiat a, tellus. Phasellus viverra nulla ut metus varius laoreet. Quisque rutrum. Aenean imperdiet. Etiam ultricies nisi vel augue. Curabitur ullamcorper ultricies nisi. Nam eget dui. Etiam rhoncus. Maecenas tempus, tellus eget condimentum rhoncus, sem quam semper libero, sit amet adipiscing sem neque sed ipsum. Nam quam nunc, blandit vel, luctus pulvinar, hendrerit id, lorem. Maecenas nec odio et ante tincidunt tempus. Donec vitae sapien ut libero venenatis faucibus. Nullam quis ante. Etiam sit amet orci eget eros faucibus tincidunt. Duis leo. Sed fringilla mauris sit amet nibh. Donec sodales sagittis magna. Sed consequat, leo eget bibendum sodales, augue velit cursus nunc. - :material-play:{ .lg .middle } __Installation & usage__ --- Learn how to evaluate your model [:octicons-arrow-right-24: Read the docs](docs/index.md)"},{"location":"_footer/","title":"footer","text":"

"},{"location":"leaderboard/","title":"Leaderboard","text":"

date author model score 240712 scicode gpt4 0.8 240712 scicode gpt4o 0.8

How to submit

Want to submit your own model? Head over to the documentation.

"},{"location":"leaderboard_table/","title":"Leaderboard table","text":"date author model score 240712 scicode gpt4 0.8 240712 scicode gpt4o 0.8"}]} \ No newline at end of file