PRICES include / exclude VAT
Homepage>BS Standards>01 GENERALITIES. TERMINOLOGY. STANDARDIZATION. DOCUMENTATION>01.140 Information sciences. Publishing>01.140.10 Writing and transliteration>BS ISO 24614-2:2011 Language resource management. Word segmentation of written texts Word segmentation for Chinese, Japanese and Korean
immediate downloadReleased: 2013-04-30
BS ISO 24614-2:2011 Language resource management. Word segmentation of written texts Word segmentation for Chinese, Japanese and Korean

BS ISO 24614-2:2011

Language resource management. Word segmentation of written texts Word segmentation for Chinese, Japanese and Korean

Format
Availability
Price and currency
English Secure PDF
Immediate download
360.89 USD
You can read the standard for 1 hour. More information in the category: E-reading
Reading the standard
for 1 hour
36.09 USD
You can read the standard for 24 hours. More information in the category: E-reading
Reading the standard
for 24 hours
108.27 USD
English Hardcopy
In stock
360.89 USD
Standard number:BS ISO 24614-2:2011
Pages:54
Released:2013-04-30
ISBN:978 0 580 66328 4
Status:Standard
DESCRIPTION

BS ISO 24614-2:2011


This standard BS ISO 24614-2:2011 Language resource management. Word segmentation of written texts is classified in these ICS categories:
  • 01.140.10 Writing and transliteration

The basic concepts and general principles of word segmentation as defined in ISO 24614-1 apply to Chinese, Japanese and Korean. Text needs to be segmented into tokens, words, phrases or some other types of smaller textual units in order to perform certain computational applications on language resources, such as natural language processing, information retrieval (IR) and machine translation (MT). This part of ISO 24614 is restricted to the segmentation of a text into words or other word segmentation units (WSUs). This task is distinct from morphological or syntactic analysis per se, although it greatly depends on morphosyntactic analysis. It is also different from the task of laying out a framework for constructing a lexicon and identifying its lexical entries, namely lemmas and lexemes. The frameworks for the latter tasks are provided by ISO 24611, ISO 24613 and ISO 24615.

The main objective of this part of ISO 24614 is to specify rules for delineating WSUs for Chinese, Japanese and Korean. Some rules are common to all three languages, though each language also has its own distinct rules for identifying WSUs. The common features are discussed in Clause 5, then the distinct rules are laid out in Clause 6 for Chinese, Clause 7 for Japanese and Clause 8 for Korean.