Laboratory of Computer and Information Science / Neural Networks Research Centre CIS Lab Helsinki University of Technology

Competition 1: Arabic


Table: The submitted unsupervised morpheme analysis compared to the Gold Standard in Arabic (Competition 1).

The original gold standard morpheme analysis was here modified to connect the POS label to the root of the word, e.g. Algbn = gabon_POS:N Al+ +SG. In addition, the gender morphemes were removed (the German gold standard doesn't contain these either). This did not affect the ranking of the submissions, but made the evaluation resemble more the other tested languages.
AUTHOR METHOD PRECISION RECALL F-MEASURE
Monson Paramor+Morfessor 79.77% 27.47% 40.87%
Morfessor baseline 78.16% 23.74% 36.41%
Morfessor MAP 90.17% 20.97% 34.03%
Monson Morfessor 90.35% 20.95% 34.01%
Zeman 1 77.24% 12.73% 21.86%
Monson Paramor 78.58% 8.52% 15.37%
Zeman 3 89.62% 5.18% 9.79%

Return to the result page

HOME | RULES | SCHEDULE | DATASETS | EVALUATION | WORKSHOP | RESULTS | FAQ | CONTACT

You are at: CIS → Unsupervised Morpheme Analysis -- Morpho Challenge 2008

Page maintained by webmaster at cis.hut.fi, last updated Friday, 11-Jul-2008 10:18:25 EEST