ORE 2012 Evaluation

The testing data was used for evaluation of four DLBSs HermiT, FaCT++, jcel and WSReasoner.

HermiT

is the first publicly-available OWL DL reasoner based on a novel "hypertableau" calculus. It can handle DL Safe rules and the rules can directly be added to the input ontology in any of the OWL syntaxes supported by the OWL API.

FaCT++

is the new generation of the well-known FaCT OWL DL reasoner. FaCT++ uses the established FaCT algorithms, but with a different internal architecture. Additionally, FaCT++ is implemented using C++ in order to create a more efficient software tool, and to maximise portability.

jcel

is a reasoner for the description logic (a subset of the OWL 2 EL profile) that uses a rule-based completion algorithm. jcel is fully implemented in Java with an extensible and modular design. It uses the OWL API, and can be used as a plug-in for Protégé, or as a standalone application.

WSReasoner

is a prototype reasoner for ontology classification focused on large ontologies. Currently WSReasoner supports classification for a fragment of OWL 2 which corresponds to the DL ALCHOI.

The evaluation has been run on AMD Athlon(tm) 64 X2 Dual Core Processor 4600+ machine with 2GB of main memory. DLBSs were allowed to allocate up to 1 GB. SEALS storage and reasoning systems evaluation component has been used in the evaluation. All systems support OWL API 3.2. The evaluation have been performed exploiting it as a common interface to DLBSs. Thus, the systems were run on the subset of the evaluation tasks that is OWL-API 3.2 parsable.

Unfortunately, there were some issues with WSReasoner that prevented it being evaluated using the SEALS storage and reasoning systems evaluation component, and the reasoner was evaluated locally by the authors. Thus, WSReasoner results are presented in an independent table.