Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
sunbo1999 authored Apr 15, 2022
1 parent 2b299d3 commit 6c25fe4
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
# CoCLSA
Corpus of Chinese Linguistic Semantic Acceptability
## Dataset
We use the web crawler to obtain Chinese multiple-choice questions related to incorrect semantic sentences from the high school examination online resources in the past ten years. Then we organize these data into a dataset with a total of 24,228 sentences with two labels. One of the labels is correct sentences, and the other is incorrect semantic sentences. We choose 45,248 sentences as the train dataset, 2,160 sentences as the validation dataset, and 2,000 as the test dataset. Since most of the multiple-choice questions we crawl are sentences with semantic errors, there are more semantic incorrect sentences in CoCLSA. To ensure reasonableness, we divide the validation and test sets with the same number of correct and incorrect semantic sentences. Therefore, the proportion of incorrect semantic sentences is higher in the training set.
We use the web crawler to obtain Chinese multiple-choice questions related to incorrect semantic sentences from the high school examination online resources in the past ten years. Then we organize these data into a dataset with a total of 24,228 sentences with two labels. One of the labels is correct sentences ('0'), and the other is incorrect semantic sentences ('1'). We choose 45,248 sentences as the train dataset, 2,160 sentences as the validation dataset, and 2,000 as the test dataset. Since most of the multiple-choice questions we crawl are sentences with semantic errors, there are more semantic incorrect sentences in CoCLSA. To ensure reasonableness, we divide the validation and test sets with the same number of correct and incorrect semantic sentences. Therefore, the proportion of incorrect semantic sentences is higher in the training set.
| Dataset| #Line | Avg.Length | Error Ratio |
| :---: | :---: | :---: | :---: |
| Train | 45,248 | 50.4 | 74.6% |
Expand Down

0 comments on commit 6c25fe4

Please sign in to comment.