What's the script for getting zero-shot chatgpt-3.5/4 performance?

[CSerxy]

Hi,

Thanks for your excellent work and contributing the code to the whole community. I am little confused for the different scripts you were using. Can you make it clearer for which scripts correspond to the zero-shot chatgpt-3.5/4? Many thanks!

Best

[chuanyang-Zheng]

We are sorry that we reply later.

The proposed PHP is a few-shot prompting framework. Hence, the code does not work for zero-shot.
If we want to test the zero-shot performance for chatgpt-3.5/4, we can refer to the zero-shot official code: https://github.com/kojima-takeshi188/zero_shot_cot

Hope this can help! If there are any other problems, please let us know.

Again, thank you very much for your attention to this work, and wish you a good day.