Information Systems Group

― Knowledge Representation and Reasoning

RODI Benchmark

Overview

Accessing and utilizing enterprise or Web data that is scattered across multiple data sources is an important task for both applications and users. Ontology-based data integration, where an ontology mediates between the raw data and its consumers, is a promising approach to facilitate such scenarios. This approach crucially relies on high-quality mappings to relate the ontology and the data, the latter being typically stored in relational databases. A number of systems to help mapping construction have recently been developed. A generic and effective benchmark for reliable and comparable evaluation of mapping quality would make an important contribution to the development of ontology-based integration systems and their application in practice. RODI represents such a benchmark. RODI offers test scenarios from conference, geographical, and oil and gas domains. Scenarios are constituted of databases, ontologies, mappings, and queries to test expected results. Systems that compute relational-to-ontology mappings can be evaluated using RODI by checking how well they can handle various features of relational schemas and ontologies, and how well computed mappings work for query answering.

Using RODI

Below you can find the RODI Benchmark distribution. The archive contains sources, binaries, required libraries, scenarios, examples for BootOX, IncMap and D2RQ systems, documentation, and scripts to run experiments.

Source codes, together with a pre-configured Eclipse project, are also available at RODIs github webpage. The pre-configured Eclipse project assumes that all required libraries are placed under the 'lib' folder.

By downloading the sources and/or binaries of RODI, you agree to the following licence.



Download

ISG Researchers

Ernesto Jimenez-Ruiz, Evgeny Kharlamov, Ian Horrocks

Main contacts

Benchmark: Christoph Pinkel

Experimental results: Ernesto Jimenez-Ruiz

Key Publications

  • Christoph Pinkel, Carsten Binnig, Ernesto Jimenez-Ruiz, Evgeny Kharlamov, Wolfgang May, Andriy Nikolov, Martin G. Skjæveland, Alessandro Solimando, Mohsen Taheriyan, Christian Heupel, Ian Horrocks "RODI: Benchmarking Relational-to-Ontology Mapping Generation Quality". Semantic Web Journal. IOS Press. 2017 (in press). [PDF]

  • Christoph Pinkel, Carsten Binnig, Ernesto Jimenez-Ruiz, Wolfgang May, Dominique Ritze, Martin G. Skjæveland, Alessandro Solimando and Evgeny Kharlamov. "RODI: A Benchmark for Automatic Mapping Generation in Relational-to-Ontology Data Integration" 12th European Semantic Web Conference, ESWC 2015. [PDF]

  • Christoph Pinkel, Ernesto Jimenez-Ruiz. "RODI: Technical User Manual" [PDF]

  • Ernesto Jimenez-Ruiz, Evgeny Kharlamov, Dmitriy Zheleznyakov, Ian Horrocks, Christoph Pinkel, Martin G. Skjæveland, Evgenij Thorstensen and Jose Mora. BootOX: Practical Mapping of RDBs to OWL 2. In the 14th International Semantic Web Conference, 2015. [PDF]