Ontology Alignment Evaluation Initiative - OAEI-2014 Campaign

Results OAEI 2014::Large BioMed Track

Summary Results (top systems)

The following table summarises the results for the systems that completed all 6 tasks of the Large BioMed Track. The table shows the total time in seconds to complete all tasks and averages for Precision, Recall, F-measure and Incoherence degree. The systems have been ordered according to the average F-measure and Incoherence degree.

AML was a step ahead and obtained the best average Recall and F-measure, and the second best average Precision.

LogMap-C obtained the best average Precision while LogMap-Bio obtained the second best average Recall.

Regarding mapping incoherence, AML also computed, on average, the mapping sets leading to the smallest number of unsatisfiable classes. LogMap variants also obtained very good results in terms of mapping coherence.

Finally, LogMapLt was the fastest system. The rest of the tools were also very fast and only needed between 21 and 144 minutes to complete all 6 tasks.


System Total Time (s) Average
Precision  Recall  F-measure Incoherence
AML 1,844 0.906 0.752 0.819 0.0045%
LogMap 1,751 0.890 0.719 0.792 0.0131%
LogMap-Bio 8,634 0.843 0.744 0.784 0.8%
XMap 1,258 0.813 0.702 0.750 48.7%
LogMap-C 6,331 0.907 0.559 0.688 0.0125%
LogMapLite 317 0.868 0.532 0.613 34.0%