I am trying to make a strict index of individual words for a large work of literature, using Chinese word segmentation, such as are found at the back of reference books. . e.g. "大星............ found on pages 55,65,109,2202", etc.
A few sections left unsegmented by the programme were:
Numbers, e.g. 一千三百三十五. In English, in words this would be indexed as: "One" "thousand" "three" "hundred" "thirty" "five". Are large numbers considered a separate 'word', or should these be separated into characters?
Words with repeated characters. I have read a few good posts about repeated characters. Are these considered separate words, or a variant of the original? So, would 孤孤單單 be listed as a separate word to 孤單, and 子子孫孫 separately to 子孫?