Laboratory of Computer and Information Science / Neural Networks Research Centre CIS Lab Helsinki University of Technology

Competition 1: Finnish


Table: The submitted unsupervised morpheme analysis compared to the Gold Standard in Finnish (Competition 1). Methods without authors are reference methods by the organizers.
AUTHOR METHOD PRECISION RECALL F-MEASURE
Monson et al. ParaMor-Morfessor Union 47.89% 50.98% 49.39%
Monson et al. ParaMor-Morfessor Mimic 51.75% 45.42% 48.38%
- Morfessor CatMAP 79.01% 31.08% 44.61%
Spiegler et al. PROMODES committee 41.20% 48.22% 44.44%
Monson et al. ParaMor Mimic 47.15% 40.50% 43.57%
Spiegler et al. PROMODES 2 33.51% 61.32% 43.34%
Spiegler et al. PROMODES 35.86% 51.41% 42.25%
Lavallée & Langlais RALI-COF 74.76% 26.20% 38.81%
Golénia et al. UNGRADE 40.78% 33.02% 36.49%
Bernhard MorphoNet 63.35% 22.62% 33.34%
Virpioja & Kohonen Allomorfessor 86.51% 19.96% 32.44%
- Morfessor Baseline 89.41% 15.73% 26.75%
Tchoukalov et al. MetaMorph 37.17% 15.15% 21.53%
Lavallée & Langlais RALI-ANA 60.06% 10.33% 17.63%
- letters 5.17% 99.89% 9.83%


Table: Corresponding results in the Morpho Challenge 2008 (for reference)
AUTHOR METHOD PRECISION RECALL F-MEASURE
Monson et al. ParaMor+Morfessor 65.21% 50.43% 56.87%
Monson et al. ParaMor 49.97% 37.64% 42.93%
Monson et al. Morfessor 79.76% 24.95% 38.02%
Zeman 1 72.02% 21.90% 33.59%
Kohonen et al. Allomorfessor 92.64% 8.65% 15.83%
Zeman 3 71.94% 3.84% 7.30%


Table: Corresponding results in the Morpho Challenge 2007 (for reference)
AUTHOR METHOD PRECISION RECALL F-MEASURE
Bernhard 2 63.92% 44.48% 52.45%
Bernhard 1 78.11% 29.39% 42.71%
Bordag 5a 72.45% 27.21% 39.56%
Bordag 5 72.80% 26.36% 38.71%
Zeman - 71.88% 22.40% 34.16%
McNamee & Mayfield 3 45.53% 11.79% 18.73%
McNamee & Mayfield 4 68.09% 8.32% 14.82%
McNamee & Mayfield 5 86.69% 5.03% 9.51%

Return to the result page

HOME | RULES | SCHEDULE | DATASETS | EVALUATION | WORKSHOP | RESULTS | FAQ | CONTACT

You are at: CIS → Unsupervised Morpheme Analysis -- Morpho Challenge 2009

Page maintained by webmaster at cis.hut.fi, last updated Thursday, 03-Sep-2009 15:15:32 EEST