Learning-based SPARQL query performance modeling and prediction

Wei Emma Zhang*, Quan Z. Sheng, Yongrui Qin, Kerry Taylor, Lina Yao

*Corresponding author for this work

    Research output: Contribution to journalArticlepeer-review

    21 Citations (Scopus)

    Abstract

    One of the challenges of managing an RDF database is predicting performance of SPARQL queries before they are executed. Performance characteristics, such as the execution time and memory usage, can help data consumers identify unexpected long-running queries before they start and estimate the system workload for query scheduling. Extensive works address such performance prediction problem in traditional SQL queries but they are not directly applicable to SPARQL queries. In this paper, we adopt machine learning techniques to predict the performance of SPARQL queries. Our work focuses on modeling features of a SPARQL query to a vector representation. Our feature modeling method does not depend on the knowledge of underlying systems and the structure of the underlying data, but only on the nature of SPARQL queries. Then we use these features to train prediction models. We propose a two-step prediction process and consider performances in both cold and warm stages. Evaluations are performed on real world SPRAQL queries, whose execution time ranges from milliseconds to hours. The results demonstrate that the proposed approach can effectively predict SPARQL query performance and outperforms state-of-the-art approaches.

    Original languageEnglish
    Pages (from-to)1015-1035
    Number of pages21
    JournalWorld Wide Web
    Volume21
    Issue number4
    DOIs
    Publication statusPublished - 1 Jul 2018

    Fingerprint

    Dive into the research topics of 'Learning-based SPARQL query performance modeling and prediction'. Together they form a unique fingerprint.

    Cite this