Competition 2: English
Table: The obtained average precision (AP%)
in the information retrieval task for the submitted segmentations
in English. Methods without authors are reference methods by
the organizers. Indexing is performed using Okapi (BM25) weighting
for all morphemes except the most common ones (stoplist) with
frequency higher than 150,000. Asterisk (*) denotes submissions that
did not include segmentations for Competition 2 and were evaluated
by using the smaller Competition 1 wordlist.
AUTHOR |
METHOD |
AP% |
- |
snowball porter |
0.4081 |
- |
TWOL first |
0.3957 |
- |
TWOL all |
0.3922 |
Lignos et al. |
- |
0.3890* |
- |
Morfessor Baseline |
0.3861 |
Virpioja & Kohonen |
Allomorfessor |
0.3852 |
Monson et al. |
ParaMor Mimic |
0.3822 |
Monson et al. |
ParaMor-Morfessor Union |
0.3811 |
- |
grammatical first |
0.3734 |
- |
Morfessor CatMAP |
0.3713 |
Lavellée & Langlais |
RALI-ANA |
0.3707* |
Monson et al. |
ParaMor-Morfessor Mimic |
0.3649 |
Tchoukalov et al. |
MetaMorph |
0.3623* |
Lavellée & Langlais |
RALI-COF |
0.3616* |
Bernhard |
MorphoNet |
0.3560 |
- |
grammatical all |
0.3542 |
- |
dummy |
0.3293 |
Golénia et al. |
UNGRADE |
0.2996* |
Can & Manandhar |
- |
0.2940* |
Spiegler et al. |
PROMODES |
0.2917* |
Spiegler et al. |
PROMODES 2 |
0.2066* |
Spiegler et al. |
PROMODES committee |
0.2066* |
Return to the result page
HOME
| RULES
| SCHEDULE
| DATASETS
| EVALUATION
| WORKSHOP
| FAQ
| CONTACT
Page maintained by webmaster at cis.hut.fi,
last updated Monday, 07-Sep-2009 13:14:55 EEST