Ontology Alignment Evaluation Initiative - OAEI-2014 Campaign

Results OAEI 2014::Large BioMed Track

Runtimes and task completion

Table 1 shows which systems were able to complete each of the matching tasks in less than 10 hours and the required computation times. Systems have been ordered with respect to the number of completed task and the average time required to complete them. Times are reported in seconds.

The last column reports the number of tasks that a system could complete. For example, 6 system were able to complete all six tasks. The last row shows the number of systems that could finish each of the tasks. The tasks involving SNOMED were also harder with respect to both computation times and the number of systems that completed the tasks.


System FMA-NCI FMA-SNOMED SNOMED-NCI Average # Tasks
Task 1 Task 2 Task 3 Task 4 Task 5 Task 6
LogMapLite 5 44 13 90 76 89 53 6
XMap 17 144 35 390 182 490 210 6
LogMap 14 106 63 388 263 917 292 6
AML 27 112 126 251 831 497 307 6
LogMap-C 81 289 119 571 2,723 2,548 1,055 6
LogMap-Bio 975 1,226 1,060 1,449 1,379 2,545 1,439 6
OMReasoner 82 36,369 691 - 5,206 - 10,587 4
MaasMtch 1,460 - 4,605 - - - 3,033 2
RSDLWB 2,216 - - - - - 2,216 1
AOT 9,341 - - - - - 9,341 1
AOTL 20,908 - - - - - 20,908 1
# Systems 11 7 8 6 7 6 4,495 45
Table 1: System runtimes (s) and task completion.