Laboratory of Computer and Information Science / Neural Networks Research Centre CIS Lab Helsinki University of Technology

Competition 1: Turkish


Table: The submitted unsupervised morpheme analysis compared to the Gold Standard in Turkish (Competition 1). Methods without authors are reference methods by the organizers.
AUTHOR METHOD PRECISION RECALL F-MEASURE
Monson et al. ParaMor-Morfessor Mimic 48.07% 60.39% 53.53%
Monson et al. ParaMor-Morfessor Union 47.25% 60.01% 52.88%
Monson et al. ParaMorMimic 49.54% 54.77% 52.02%
Lavallée & Langlais RALI-COF 48.43% 44.54% 46.40%
- Morfessor CatMAP 79.38% 31.88% 45.49%
Spiegler et al. PROMODES 2 35.36% 58.70% 44.14%
Spiegler et al. PROMODES 32.22% 66.42% 43.39%
Bernhard MorphoNet 61.75% 30.90% 41.19%
Can & Manandhar 2 41.39% 38.13% 39.70%
Spiegler et al. PROMODES committee 55.30% 28.35% 37.48%
Golénia et al. UNGRADE 46.67% 30.16% 36.64%
Tchoukalov et al. MetaMorph 39.14% 29.45% 33.61%
Virpioja & Kohonen Allomorfessor 85.89% 19.53% 31.82%
- Morfessor Baseline 89.68% 17.78% 29.67%
Lavallée & Langlais RALI-ANA 69.52% 12.85% 21.69%
- letters 8.66% 99.13% 15.93%
Can & Manandhar 1 73.03% 8.89% 15.86%


Table: Corresponding results in the Morpho Challenge 2008 (for reference)
AUTHOR METHOD PRECISION RECALL F-MEASURE
Monson et al. ParaMor+Morfessor 66.78% 57.97% 62.07%
Monson et al. ParaMor 57.35% 45.75% 50.90%
Monson et al. Morfessor 77.36% 33.47% 46.73%
Zeman 1 77.48% 22.71% 35.13%
Kohonen et al. Allomorfessor 93.16% 9.56% 17.35%
Zeman 3 72.28% 3.87% 7.34%


Table: Corresponding results in the Morpho Challenge 2007 (for reference)
AUTHOR METHOD PRECISION RECALL F-MEASURE
Bordag 5a 81.06% 23.51% 36.45%
Bordag 5 81.19% 23.44% 36.38%
Zeman - 77.48% 22.71% 35.13%
Bernhard 2 77.00% 20.77% 32.72%
Bernhard 1 81.32% 16.37% 27.25%
McNamee & Mayfield 3 65.00% 16.23% 25.98%
McNamee & Mayfield 4 85.49% 10.31% 18.40%
McNamee & Mayfield 5 94.80% 5.20% 9.87%

Return to the result page

HOME | RULES | SCHEDULE | DATASETS | EVALUATION | WORKSHOP | RESULTS | FAQ | CONTACT

You are at: CIS → Unsupervised Morpheme Analysis -- Morpho Challenge 2009

Page maintained by webmaster at cis.hut.fi, last updated Monday, 07-Sep-2009 16:24:44 EEST