Ontology Alignment Evaluation Initiative - OAEI-2013 Campaign

Results OAEI 2013::Large BioMed Track

Runtimes and task completion

Table 1 shows which systems (including variants) were able to complete each of the matching tasks in less than 18 hours and the required computation times. Systems have been ordered with respect to the number of completed task and the average time required to complete them. Times are reported in seconds.

The last column reports the number of tasks that a system could complete. For example, 12 system configurations were able to complete all six tasks. The last row shows the number of systems that could finish each of the tasks. The tasks involving SNOMED were also harder with respect to both computation times and the number of systems that completed the tasks.


System FMA-NCI FMA-SNOMED SNOMED-NCI Average # Tasks
Task 1 Task 2 Task 3 Task 4 Task 5 Task 6
LogMapLt 7 59 14 101 54 132 61 6
IAMA 13 139 27 217 98 206 117 6
AML 16 201 60 542 291 569 280 6
AML-BK 38 201 93 530 380 571 302 6
AML-R 18 194 86 554 328 639 303 6
GOMMA2012 39 243 54 634 220 727 320 6
AML-BK-R 42 204 121 583 397 635 330 6
YAM++ 93 365 100 401 391 712 344 6
LogMap-BK 44 172 85 556 444 1,087 398 6
LogMap 41 161 78 536 433 1,232 414 6
ServOMap 140 2,690 391 4,059 1,698 6,320 2,550 6
SPHeRe (*) 16 8,136 154 20,664 2,486 10,584 7,007 6
XMapSiG 1,476 - 11,720 - - - 6,598 2
XMapGen 1,504 - 12,127 - - - 6,816 2
Hertuda 3,403 - 17,610 - - - 10,507 2
ODGOMS-v1.1 6,366 - 27,450 - - - 16,908 2
HotMatch 4,372 - 32,243 - - - 18,308 2
ODGOMS-v1.2 10,204 - 42,908 - - - 26,556 2
StringsAuto 6,358 - - - - - 6,358 1
MaasMatch 12,409 - - - - - 12,409 1
# Systems 20 12 18 12 12 12 5,906 86
Table 1: System runtimes (s) and task completion. (*) Note that the times for SPHeRe were reported by the authors. SPHeRe is a special tool which relies on the utilization of cloud computing resources.