Hello, about the training datasets folder

[WildLight]

Hello, I meet a question.

In above folder of 'squad', there is a 'translate-train' folder. But you public the datasets only a 'translate-train-en' folder, so the data of 'translate-train' are contain in the 'translate-train-en' ?
When I run the code of training process, will use file 'squad.translate.train.en-ar.json' and I only rename the file 'squad.translate.train.en-ar-en.json' to 'squad.translate.train.en-ar.json', this is right ?
I hope you can help me. Thank you.

[yhy1117]

Hi, you can download data and translation data (translate-train and translate-test) from XTREME repo.
We only provide other data in the google drive link.

[WildLight]

Hello, thanks a lot for the quick reply.

I don't know where is the squad data(translate-train).

Besides, I also view the .sh file in XTREME repo, but I didn't find it.
I hope you can tell me the detail, Thanks a lot @yhy1117

[yhy1117]

Hi, you can download translation data from here.

[WildLight]

Hi, Thanks a lot @yhy1117 .
(Closing this issue. If I have further questions, I will reach out.)
Again, thanks a lot for the quick reply.

[WildLight]

Hello, here I go again.😂
There is no such file(squad.translate.train.en-en.json) in XTREME

When I run the code getting the 'get_train_examples', there is need the file 'squad.translate.train.en-en.json'.

I hope you can help me. Thanks a lot.

[yhy1117]

The squad.translate.train.en-en.json file is the squad/train-v1.1.json file. Sorry, I will fix the code soon.

[WildLight]

OK, thanks a lot for the quick reply.

[WildLight]

Hello, when I run the code, I get the error(Process finished with exit code 137).

So, I want to ask what is your hardware environment configuration like.
I have the enviroment of hardware.

The GPU is 2080Ti(11019MiB).
Thanks a lot 😄

[yhy1117]

Hi, our hardware environments are: CPU 88, Memory 350GB, GPU Nvidia V100-32GB.