Experiments with Russian to Kazakh sentence alignment
| dc.contributor.author | Assylbekov, Zhenisbek | |
| dc.contributor.author | Myrzakhmetov, Bagdat | |
| dc.contributor.author | Makazhanov, Aibek | |
| dc.date.accessioned | 2016-09-20T10:26:55Z | |
| dc.date.available | 2016-09-20T10:26:55Z | |
| dc.date.issued | 2016 | |
| dc.description.abstract | Sentence alignment is the final step in building parallel corpora, which arguably has the greatest impact on the quality of a resulting corpus and the accuracy of machine translation systems that use it for training. However, the quality of sentence alignment itself depends on a number of factors. In this paper we investigate the impact of several data processing techniques on the quality of sentence alignment. We develop and use a number of automatic evaluation metrics, and provide empirical evidence that application of all of the considered data processing techniques yields bitexts with the lowest ratio of noise and the highest ratio of parallel sentences. | ru_RU |
| dc.identifier.citation | Zhenisbek Assylbekov , Bagdat Myrzakhmetov and Aibek Makazhanov (2016) Experiments with Russian to Kazakh sentence alignment. The 4-th International Conference on Computer Processing of Turkic Languages “TurkLang 2016”. | ru_RU |
| dc.identifier.uri | http://nur.nu.edu.kz/handle/123456789/1694 | |
| dc.language.iso | en | ru_RU |
| dc.publisher | The 4-th International Conference on Computer Processing of Turkic Languages “TurkLang 2016” | ru_RU |
| dc.rights | Attribution-NonCommercial-ShareAlike 3.0 United States | * |
| dc.rights.uri | http://creativecommons.org/licenses/by-nc-sa/3.0/us/ | * |
| dc.subject | sentence alignment | ru_RU |
| dc.subject | sentence splitting | ru_RU |
| dc.subject | lemmatization | ru_RU |
| dc.subject | parallel corpus | ru_RU |
| dc.subject | Kazakh language | ru_RU |
| dc.subject | выравнивание по предложениям | ru_RU |
| dc.subject | разбивка по предложениям | ru_RU |
| dc.subject | лемматизация | ru_RU |
| dc.subject | параллельный корпус | ru_RU |
| dc.subject | казахский язык | ru_RU |
| dc.subject | Research Subject Categories::MATHEMATICS | ru_RU |
| dc.title | Experiments with Russian to Kazakh sentence alignment | ru_RU |
| dc.type | Conference Paper | ru_RU |