Is there online corpus for the Chinese language? What I mean is something like the Brown Corpus for American English.
-
3Please clarify what kinds of queries you need to run. For instance, why wouldn't google meet your purposes (you can limit to Chinese results only)?– Stumpy Joe PeteCommented Sep 7, 2013 at 23:22
-
The primary disadvantage of the Google approach is that they don't have a search API and actively detect and block scraping. It would be suitable for any human needs, but probably not for what drobnbobn is after.– JamesCommented Sep 10, 2013 at 3:49
Add a comment
|
3 Answers
For a big-data Chinese corpus, have a look at this one:
(Taiwan) Academia Sinica Balanced Corpus of Modern Chinese 台灣 中央研究院 中文詞知識庫小組 現代漢語平衡語料庫
- A million-word level corpus
- Contact: Miss Su-Chu Lin (林素朱), [email protected]
- Introduction in Chinese
- Not sure if you can download it for free
I haven't found a large corpus, but I have used the results of some projects that analysed all Usenet newsgroups from 1993-1994. You could probably contact Shih-Kun Huang for information about the original corpus.
The files I used were a list of character frequencies and a list of word frequencies.
It's probably smaller than you want, and it only contains individual sentences, but you might find the translations at tatoeba.org interesting. You can download the raw data.
I don't know if they can be downloaded, but there are lots of example sentences on jukuu.com.
answered Sep 11, 2013 at 5:07
You can download all of the Chinese language Wikipedia. (you would probably want: zhwiki-latest-pages-meta-current.xml.bz2)
Another source that may or may not be suitable depending on the specific project is Project Gutenberg's collection of Chinese language books. The downside of this source is that most of them will be quite old.
-
2What character set does the xml file use, traditional or simplified? If it is a mix, that's an issue.– imrekCommented Aug 16, 2015 at 8:00