Results

Manual evaluation by organizers

Participant ID	Precision	Recall	F1.0
ihmana	0.6244	0.6186	0.6215
nigula	0.6093	0.6093	0.6093
TMUUED	0.6132	0.6047	0.6089
GU	0.5860	0.5860	0.5860
kjimichi	0.5628	0.5628	0.5628
shotakoyama	0.5756	0.5488	0.5619
stahl	0.3581	0.3581	0.3581
Baseline System	0.3116	0.3116	0.3116

BLEU-based

Participant ID	Precision	Recall	F1.0
ihmana	0.486	0.482	0.484
TMUUED	0.477	0.471	0.474
GU	0.471	0.471	0.471
nigula	0.463	0.463	0.463
kjimichi	0.460	0.460	0.460
stahl	0.437	0.437	0.437
shotakoyama	0.444	0.424	0.434
Baseline System	0.334	0.334	0.334