Datasets
ORE workshop provides the following evaluation datasets. Note that they may suffer minor changes until mid February. The datasets include (see metadata_ontologies.txt for an overview of the ontology sizes) a set of state of the art ontologies in OWL 2 language, both in RDF/XML and Functional syntax. Concretely:
107 real world ontologies and 87 test cases for OWL DL compliant DLBS;
20 real world ontologies and 32 test cases for OWL RL compliant DLBS;
8 real world ontologies and 32 test cases for OWL EL compliant DLBS;
8 real world ontologies and 27 test cases for OWL QL compliant DLBS.
The datasets are organised by reasoning service. The "class satisfiability" and "instance retrieval" datasets also contain a text file specifying the classes involved within the evaluation. Additionally the "classification" and "instance retrieval" datasets also provides a "reference" solution. Note that this "reference" is not a "gold standard" to evaluate output correctness, thus it should only be used for comparison purposes.
Classification ([zip], 19Mb)
Class satisfiability ([zip], 19Mb)
Ontology satisfiability ([zip], 19Mb)
Logical entailment ([zip], 190Kb) and non entailment ([zip], 20Kb)
Instance retrieval ([zip], 320Kb)