Empirical Methods for Splitting Compound Words with Application to Machine Translation

Abstract

A statistical machine translation (MT) system may include a compound splitting module to split compounded words for more accurate translation. The compound splitting module select a best split for translation by the MT system.

1 . A method comprising:
 identifying one or more split options for a compounded word in a source language, each split option having a translation in a target language;   ranking the compounded word and the one or more split options; and   selecting a translation option from the compounded word and the one or more split options.   
   
   
       2 . The method of  claim 1 , further comprising:
 providing the translation option to a machine translation system for translation into the target language.   
   
   
       3 . The method of  claim 1 , wherein said ranking comprises:
 ranking the compounded word and the one or more split options based on the number of split options.   
   
   
       4 . The method of  claim 1 , wherein said ranking comprises:
 ranking the compounded word and the one or more split options based on the frequency of occurrence of the compounded word and the one or more split options in a source language corpus.   
   
   
       5 . The method of  claim 1 , wherein said ranking comprises:
 identifying a translation pair including the compounded word in a parallel corpus, said translation pair including a translation of the compounded word in the target language; and   comparing the compounded word and the one or more split options to the translation of the compounded word in the target language.   
   
   
       6 . The method of  claim 1 , wherein said identifying comprises:
 excluding a potential split option based on a part-of-speech of said potential split option.   
   
   
       7 . The method of  claim 6 , wherein the part-of-speech comprises one of a preposition and a determiner. 
   
   
       8 . An apparatus comprising:
 a split generator to identify one or more split options for a compounded word in a source language, each split option having a translation in a target language;   a module to generate ranking information for the compounded word and the one or more split options; and   a split selector to rank the compounded word and the one or more split options based on the ranking information and select a translation option from the compounded word and the one or more split options.   
   
   
       9 . The apparatus of  claim 8 , wherein the module comprises:
 a frequency module to identify the frequency of occurrence of the compounded word and the one or more split options in a source language corpus.   
   
   
       10 . The apparatus of  claim 8 , wherein the module comprises:
 a translation lexicon to
 identify a translation pair including the compounded word in a parallel corpus, said translation pair including a translation of the compounded word in the target language, and 
 compare the compounded word and the one or more split options to the translation of the compounded word in the target language. 
   
   
   
       11 . The apparatus of  claim 8 , wherein the module comprises a translation table generated by splitting compounded words in a parallel corpus and aligning the split compounded words with corresponding target words in the parallel corpus. 
   
   
       12 . The apparatus of  claim 8 , wherein the module comprises:
 a module to exclude a potential split option based on a part-of-speech of said potential split option.   
   
   
       13 . The apparatus of  claim 12 , wherein the part-of-speech comprises one of a preposition and a determiner. 
   
   
       14 . An article comprising a machine-readable medium including machine-executable instructions, the instructions operative to cause a machine to:
 identify one or more split options for a compounded word in a source language, each split option having a translation in a target language;   rank the compounded word and the one or more split options; and   select a translation option from the compounded word and the one or more split options.   
   
   
       15 . The article of  claim 14 , further comprising instructions to cause the machine to:
 provide the translation option to a machine translation system for translation into the target language.   
   
   
       16 . The article of  claim 14 , wherein the instructions for ranking comprise instructions to cause the machine to:
 rank the compounded word and the one or more split options based on the number of split options.   
   
   
       17 . The article of  claim 14 , wherein the instructions for ranking comprise instructions to cause the machine to:
 rank the compounded word and the one or more split options based on the frequency of occurrence of the compounded word and the one or more split options in a source language corpus.   
   
   
       18 . The article of  claim 14 , wherein the instructions for ranking comprise instructions to cause the machine to:
 identify a translation pair including the compounded word in a parallel corpus, said translation pair including a translation of the compounded word in the target language; and   compare the compounded word and the one or more split options to the translation of the compounded word in the target language.   
   
   
       19 . The article of  claim 14 , wherein the instructions for identifying comprise instructions to cause the machine to:
 exclude a potential split option based on a part-of-speech of said potential split option.   
   
   
       20 . The article of  claim 19 , wherein the part-of-speech comprises one of a preposition and a determiner.