Towards a Methodology for Evaluating English-to-Korean Machine Translation Systems

영-한 기계번역 성능 평가 연구

The purpose of this paper is to establish the standard method of evaluation English-to-Korean MT systems We focus on test suites, evaluation procedure and evaluation results. Four computer programs on the market are tested on a test suite consisting of 1,501 sentence, The quality of translation and the capacity of MT system are the key points for evaluation . The sentences in the suite are classified according to the grammatical properties they reveal. The classificatory scheme has the structure of a directory: each sentence belongs to a subclass, which belongs to a major class,. We place the sentences in the test suite on a scale of difficulty (hard ordinary easy) and each output sentence is graded on a scale of four accuracy levels. We also test the programs with respect to their speed.