Laboratory of Computer and Information Science / Neural Networks Research Centre CIS Lab Helsinki University of Technology

Competition 1: English


Table: The submitted unsupervised morpheme analysis compared to the Gold Standard in English (Competition 1). Methods without authors are reference methods by the organizers.
AUTHOR METHOD PRECISION RECALL F-MEASURE
Virpioja & Kohonen Allomorfessor 68.98% 56.82% 62.31%
- Morfessor Baseline 74.93% 49.81% 59.84%
Monson et al. ParaMor-Morfessor Union 55.68% 62.33% 58.82%
Lignos et al. - 83.49% 45.00% 58.48%
Monson et al. ParaMor-Morfessor Mimic 54.80% 60.17% 57.36%
Monson et al. ParaMor Mimic 53.13% 59.01% 55.91%
Bernhard MorphoNet 65.08% 47.82% 55.13%
Lavallée & Langlais RALI-COF 68.32% 46.45% 55.30%
Can & Manandhar - 58.52% 44.82% 50.76%
- Morfessor CatMAP 84.75% 35.97% 50.50%
Spiegler et al PROMODES 36.20% 64.81% 46.46%
Lavallée & Langlais RALI-ANA 64.61% 33.48% 44.10%
Spiegler et al. PROMODES 2 32.24% 61.10% 42.21%
Spiegler et al. PROMODES committee 32.24% 61.10% 42.21%
Tchoukalov et al. MetaMorph 68.41% 27.55% 39.29%
Golénia et al. UNGRADE 28.29% 51.74% 36.58%
- letters 3.82% 99.88% 7.35%


Table: Corresponding results for the Morpho Challenge 2008 methods (for reference)
AUTHOR METHOD PRECISION RECALL F-MEASURE
Monson et al. ParaMor+Morfessor 69.59% 65.57% 67.52%
Monson et al. ParaMor 63.32% 51.96% 57.08%
Zeman 1 67.13% 46.67% 55.06%
Monson et al. Morfessor 80.57% 36.31% 50.06%
Kohonen et al. Allomorfessor 83.31% 15.84% 26.61%
Zeman 3 77.32% 9.69% 17.23%


Table: Corresponding results for the Morpho Challenge 2007 methods (for reference)
AUTHOR METHOD PRECISION RECALL F-MEASURE
Monson et al. ParaMor+Morfessor 70.09% 67.38% 68.71%
Bernhard 2 67.42% 65.11% 66.24%
Bernhard 1 75.61% 57.87% 65.56%
Monson et al. ParaMor 67.60% 55.72% 61.09%
Pitler - 78.22% 43.44% 55.86%
Zeman - 67.13% 46.67% 55.06%
Monson et al. Morfessor 80.57% 36.31% 50.06%
Bordag 5a 61.75% 35.21% 44.84%
Bordag 5 61.81% 34.63% 44.39%
McNamee & Mayfield 3 43.47% 22.73% 29.85%
McNamee & Mayfield 4 75.96% 18.17% 29.32%
McNamee & Mayfield 5 92.34% 9.88% 17.84%

Return to the result page

HOME | RULES | SCHEDULE | DATASETS | EVALUATION | WORKSHOP | RESULTS | FAQ | CONTACT

You are at: CIS → Unsupervised Morpheme Analysis -- Morpho Challenge 2009

Page maintained by webmaster at cis.hut.fi, last updated Monday, 21-Sep-2009 09:49:36 EEST