Laboratory of Computer and Information Science / Neural Networks Research Centre CIS Lab Helsinki University of Technology

Competition 2: English


Table: The obtained average precision (AP%) in the information retrieval task for the submitted segmentations in English. Methods without authors are reference methods by the organizers. Indexing is performed using Okapi (BM25) weighting for all morphemes except the most common ones (stoplist) with frequency higher than 150,000. Asterisk (*) denotes submissions that did not include segmentations for Competition 2 and were evaluated by using the smaller Competition 1 wordlist.
AUTHOR METHOD AP%
- snowball porter 0.4081
- TWOL first 0.3957
- TWOL all 0.3922
Lignos et al. - 0.3890*
- Morfessor Baseline 0.3861
Virpioja & Kohonen Allomorfessor 0.3852
Monson et al. ParaMor Mimic 0.3822
Monson et al. ParaMor-Morfessor Union 0.3811
- grammatical first 0.3734
- Morfessor CatMAP 0.3713
Lavellée & Langlais RALI-ANA 0.3707*
Monson et al. ParaMor-Morfessor Mimic 0.3649
Tchoukalov et al. MetaMorph 0.3623*
Lavellée & Langlais RALI-COF 0.3616*
Bernhard MorphoNet 0.3560
- grammatical all 0.3542
- dummy 0.3293
Golénia et al. UNGRADE 0.2996*
Can & Manandhar - 0.2940*
Spiegler et al. PROMODES 0.2917*
Spiegler et al. PROMODES 2 0.2066*
Spiegler et al. PROMODES committee 0.2066*

Return to the result page

HOME | RULES | SCHEDULE | DATASETS | EVALUATION | WORKSHOP | FAQ | CONTACT

You are at: CIS → Unsupervised Morpheme Analysis -- Morpho Challenge 2009

Page maintained by webmaster at cis.hut.fi, last updated Monday, 07-Sep-2009 13:14:55 EEST