Unsupervised Morpheme Analysis -- Morpho Challenge 2010

[an error occurred while processing this directive]

Competition 1

English

**Table:** The submitted morpheme analysis compared to the Gold Standard in **English** (Competition 1). Methods without authors are reference methods by the organizers. The types are: S = semi-supervised algorithm, P = unsupervised algorithm with supervised parameter tuning, U = fully unsupervised algorithm.
AUTHOR	METHOD	PRECISION	RECALL	F-MEASURE	TYPE
Kohonen	Morfessor S+W	65.62%	69.28%	67.40%	S
Kohonen	Morfessor S+W+L	67.87%	66.43%	67.14%	S
Lignos	Base Inference	80.77%	53.76%	64.55%	U
Lignos	Iterative Compounding	80.27%	52.76%	63.67%	U
Spiegler	DEAP MDL-NOCAT	51.44%	80.95%	62.91%	S
Spiegler	DEAP PROB-NOCAT	58.52%	63.06%	60.70%	S
Lignos	Aggressive Compounding	71.45%	52.31%	60.40%	U
Kohonen	Morfessor U+W	60.33%	59.55%	59.94%	P
Spiegler	DEAP MDL-CAT	49.83%	75.08%	59.90%	S
Nicolas	MorphAcq	67.83%	53.43%	59.78%	U
Spiegler	DEAP PROB-CAT	55.00%	56.61%	55.79%	S
-	Morfessor Baseline	81.39%	41.70%	55.14%	U
Spiegler	Promodes	39.59%	64.72%	49.13%	P
Spiegler	Promodes-E	49.69%	46.22%	47.90%	P
-	Morfessor CatMAP	86.84%	30.03%	44.63%	U
Golenia	MAGIP	29.88%	70.65%	42.00%	S
Spiegler	Promodes-H	26.84%	63.69%	37.77%	P
-	Letters	4.41%	99.88%	8.44%	-

Finnish

**Table:** The submitted morpheme analysis compared to the Gold Standard in **Finnish** (Competition 1). Methods without authors are reference methods by the organizers. The types are: S = semi-supervised algorithm, P = unsupervised algorithm with supervised parameter tuning, U = fully unsupervised algorithm.
AUTHOR	METHOD	PRECISION	RECALL	F-MEASURE	TYPE
Spiegler	DEAP MDL-NOCAT	56.03%	70.71%	62.52%	S
Spiegler	DEAP MDL-CAT	57.43%	66.59%	61.67%	S
Kohonen	Morfessor S+W+L	58.38%	63.35%	60.76%	S
Kohonen	Morfessor S+W	57.59%	55.21%	56.38%	S
Spiegler	DEAP PROB-NOCAT	56.66%	44.79%	50.03%	S
Kohonen	Morfessor U+W	56.97%	42.98%	49.00%	P
Lignos	Aggressive Compounding	63.07%	39.98%	48.94%	U
Spiegler	DEAP PROB-CAT	51.93%	42.41%	46.69%	S
Spiegler	Promodes-E	43.26%	45.73%	44.46%	P
Spiegler	Promodes	41.59%	47.41%	44.31%	P
Golenia	MAGIP	36.25%	53.73%	43.29%	S
-	Morfessor CatMAP	80.31%	29.51%	43.16%	U
Spiegler	Promodes-H	35.08%	53.45%	42.36%	P
Lignos	Iterative Compounding	75.32%	26.70%	39.43%	U
Lignos	Base Inference	78.98%	24.46%	37.35%	U
-	Morfessor Baseline	90.60%	14.39%	24.83%	U
-	Letters	5.04%	99.89%	9.60%	-

German

**Table:** The submitted morpheme analysis compared to the Gold Standard in **German** (Competition 1). Methods without authors are reference methods by the organizers. The types are: S = semi-supervised algorithm, P = unsupervised algorithm with supervised parameter tuning, U = fully unsupervised algorithm.
AUTHOR	METHOD	PRECISION	RECALL	F-MEASURE	TYPE
Kohonen	Morfessor U+W	58.55%	44.94%	50.85%	P
-	Morfessor CatMAP	72.70%	35.43%	47.64%	U
Lignos	Base Inference	66.38%	35.36%	46.14%	U
Lignos	Aggressive Compounding	59.41%	37.21%	45.76%	U
Lignos	Iterative Compounding	62.13%	34.70%	44.53%	U
Nicolas	MorphAcq	69.97%	25.29%	37.15%	U
-	Morfessor Baseline	82.80%	19.77%	31.92%	U
-	Letters	2.80%	99.92%	5.45%	-

Turkish

**Table:** The submitted morpheme analysis compared to the Gold Standard in **Turkish** (Competition 1). Methods without authors are reference methods by the organizers. The types are: S = semi-supervised algorithm, P = unsupervised algorithm with supervised parameter tuning, U = fully unsupervised algorithm.
AUTHOR	METHOD	PRECISION	RECALL	F-MEASURE	TYPE
Kohonen	Morfessor S+W+L	71.69%	59.97%	65.31%	S
Spiegler	DEAP MDL-NOCAT	68.93%	56.12%	61.87%	S
Spiegler	DEAP MDL-CAT	72.75%	53.49%	61.65%	S
Spiegler	DEAP PROB-CAT	68.86%	55.81%	61.65%	S
Spiegler	DEAP PROB-NOCAT	65.71%	58.04%	61.63%	S
Kohonen	Morfessor S+W	65.71%	47.15%	54.90%	S
Spiegler	Promodes	46.59%	51.67%	49.00%	P
Spiegler	Promodes-E	40.75%	52.39%	45.84%	P
-	Morfessor CatMAP	79.38%	31.88%	45.49%	U
Kohonen	Morfessor U+W	40.71%	46.76%	43.52%	P
Spiegler	Promodes-H	47.88%	39.37%	43.21%	P
Golenia	MAGIP	32.00%	65.80%	43.06%	S
Lignos	Aggressive Compounding	55.51%	34.36%	42.45%	U
Lignos	Iterative Compounding	68.69%	21.44%	32.68%	U
Nicolas	MorphAcq	79.02%	19.78%	31.64%	U
-	Morfessor Baseline	89.68%	17.78%	29.67%	U
Lignos	Base Inference	72.81%	16.11%	26.38%	U
-	Letters	8.66%	99.13%	15.93%	-

Return to the result page

HOME | RULES | SCHEDULE | DATASETS | EVALUATION | WORKSHOP | FAQ | CONTACT

You are at: CIS → Unsupervised Morpheme Analysis -- Morpho Challenge 2010

Page maintained by webmaster at cis.hut.fi, last updated Tuesday, 24-Aug-2010 16:07:46 EEST