add datasets

autoliuweijie · Dec 12, 2019 · 708f0c4 · 708f0c4
1 parent d62bcec
commit 708f0c4
Show file tree

Hide file tree

Showing 20 changed files with 158,107 additions and 0 deletions.
diff --git a/README.md b/README.md
@@ -102,6 +102,7 @@ useage: [--pretrained_model_path] - Path to the pre-trained model parameters.
 ### Classification benchmarks
 
 Accuracy (dev/test %) on different dataset:
+
 | Dataset       | HowNet       | CnDbpedia     |
 | :-----        | :----:       | :----:        |
 | Book review   | 88.75/87.75  | 88.80/87.69   |
@@ -117,6 +118,7 @@ Accuracy (dev/test %) on different dataset:
 ### NER example
 
 Run an example on the msra_ner dataset with CnDbpedia:
+
 ```
 CUDA_VISIBLE_DEVICES='0' nohup python3 -u run_kbert_ner.py \
     --pretrained_model_path ./models/google_model.bin \

diff --git a/datasets/.gitignore b/datasets/.gitignore
@@ -0,0 +1,5 @@
+finance_qa/
+xnli/
+weibo/
+lcqmc/
+law_qa/
diff --git a/datasets/book_review/dev.tsv b/datasets/book_review/dev.tsv
diff --git a/datasets/book_review/test.tsv b/datasets/book_review/test.tsv
diff --git a/datasets/book_review/train.tsv b/datasets/book_review/train.tsv
diff --git a/datasets/chnsenticorp/dev.tsv b/datasets/chnsenticorp/dev.tsv
diff --git a/datasets/chnsenticorp/test.tsv b/datasets/chnsenticorp/test.tsv
diff --git a/datasets/chnsenticorp/train.tsv b/datasets/chnsenticorp/train.tsv
diff --git a/datasets/financial_ner/dev.tsv b/datasets/financial_ner/dev.tsv
diff --git a/datasets/financial_ner/test.tsv b/datasets/financial_ner/test.tsv
diff --git a/datasets/financial_ner/train.tsv b/datasets/financial_ner/train.tsv
diff --git a/datasets/medical_ner/dev.tsv b/datasets/medical_ner/dev.tsv
diff --git a/datasets/medical_ner/test.tsv b/datasets/medical_ner/test.tsv
diff --git a/datasets/medical_ner/train.tsv b/datasets/medical_ner/train.tsv
diff --git a/datasets/msra_ner/dev.tsv b/datasets/msra_ner/dev.tsv
diff --git a/datasets/msra_ner/test.tsv b/datasets/msra_ner/test.tsv
diff --git a/datasets/msra_ner/train.tsv b/datasets/msra_ner/train.tsv
diff --git a/datasets/shopping/dev.tsv b/datasets/shopping/dev.tsv
diff --git a/datasets/shopping/test.tsv b/datasets/shopping/test.tsv
diff --git a/datasets/shopping/train.tsv b/datasets/shopping/train.tsv