Question About datasets

[Tan-Hexiang]

In LitCab/script/get_baselines.sh，what is

"../../ICLR_2024/${dataset}/test${model_name_postfix}temperature_1topp_1.0_num_demos_15_answers.${num_samples}.csv"

Can you please provide a README to help me reproduce the work? I am following this work. I would appreciate it if you could give me some help

[XinLiu-cs]

Thanks for reaching out! I've updated the README and hope it addresses your questions. If you have any more questions or need further clarification, please let me know!

[thangld201]

Hi @XinLiu-cs, do you still have model outputs and GPT-4 evaluations (accurate / non-accurate) ? If possible, can you share them ? I plan to further examine the evaluation parts.

[XinLiu-cs]

Sorry for the late reply. Sure! I will upload them ASAP.

[XinLiu-cs]

Hi @XinLiu-cs, do you still have model outputs and GPT-4 evaluations (accurate / non-accurate) ? If possible, can you share them ? I plan to further examine the evaluation parts.

I've uploaded the gpt4 evaluation results!