Laboratory of Computer and Information Science / Neural Networks Research Centre CIS Lab Helsinki University of Technology

Competition 1: German


Table: The submitted unsupervised morpheme analysis compared to the Gold Standard in German (Competition 1). Methods without authors are reference methods by the organizers.
AUTHOR METHOD PRECISION RECALL F-MEASURE
Monson et al. ParaMor-Morfessor Union 52.53% 60.27% 56.14%
Monson et al. ParaMor-Morfessor Mimic 51.07% 57.79% 54.22%
- Morfessor CatMAP 71.08% 38.92% 50.30%
Monson et al. ParaMor Mimic 50.81% 47.68% 49.20%
Can & Manandhar 2 57.67% 42.67% 49.05%
Lavallée & Langlais RALI-COF 67.53% 34.38% 45.57%
Spiegler et al. PROMODES 2 36.11% 50.52% 42.12%
Virpioja & Kohonen Allomorfessor 77.78% 28.83% 42.07%
Bernhard MorphoNet 67.41% 30.19% 41.71%
Spiegler et al. PROMODES 49.88% 33.95% 40.40%
Spiegler et al. PROMODES committee 48.48% 34.61% 40.39%
- Morfessor Baseline 81.70% 22.98% 35.87%
Lignos et al. - 78.90% 21.35% 33.61%
Golénia et al. UNGRADE 39.02% 29.25% 33.44%
Tchoukalov et al. MetaMorph 39.59% 19.81% 26.40%
Can & Manandhar 1 73.16% 15.27% 25.27%
Lavallée & Langlais RALI-ANA 61.39% 15.34% 24.55%
- letters 2.79% 99.92% 5.43%


Table: Corresponding results in the Morpho Challenge 2008 (for reference)
AUTHOR METHOD PRECISION RECALL F-MEASURE
Monson et al. ParaMor+Morfessor 64.06% 61.52% 62.76%
Monson et al. Morfessor 70.73% 38.82% 50.13%
Monson et al. ParaMor 56.98% 42.10% 48.42%
Zeman 1 66.86% 29.73% 41.16%
Kohonen et al. Allomorfessor 87.82% 8.54% 15.57%
Zeman 3 74.19% 7.10% 12.95%


Table: Corresponding results in the Morpho Challenge 2007 (for reference)
AUTHOR METHOD PRECISION RECALL F-MEASURE
Monson et al. ParaMor+Morfessor 69.96% 55.42% 61.85%
Bernhard 2 54.02% 60.77% 57.20%
Bernhard 1 66.82% 42.48% 51.94%
Bordag 5a 62.22% 43.81% 51.42%
Bordag 5 62.48% 42.77% 50.78%
Monson et al. Morfessor 70.73% 38.82% 50.13%
Monson et al. ParaMor 68.69% 33.28% 44.83%
Zeman - 66.81% 29.83% 41.25%
McNamee & Mayfield 3 45.78% 12.92% 20.15%
McNamee & Mayfield 4 75.62% 9.67% 17.15%
McNamee & Mayfield 5 90.92% 6.13% 11.48%

Return to the result page

HOME | RULES | SCHEDULE | DATASETS | EVALUATION | WORKSHOP | RESULTS | FAQ | CONTACT

You are at: CIS → Unsupervised Morpheme Analysis -- Morpho Challenge 2009

Page maintained by webmaster at cis.hut.fi, last updated Monday, 07-Sep-2009 16:24:33 EEST