Big Data Query Processing

At a glance

Project leader : Prof. Dr. Kurt Stockinger
Project team : Melanie Imhof, Jonas Looser, Thierry Musy
Project status : completed
Funding partner : Third party
Project partner : LinkResearchTools
Contact person : Kurt Stockinger

Description

The goal of this project is to perform a proof-of-concept for Big Data query processing with an international industry partner. In particular, we investigate if a Big Data solution based on Apache Hadoop and Cloudera’s Impala can handle the complex query workload of our industry partner subject to minimal response times (near real-time). The main tasks of the project are as follows: Systematic and rigorous evaluation of the query response times, scalability analysis (very large data sets being accessed by hundreds of concurrent users) and evaluation of various fault tolerance scenarios.

The results of the project can be found in the following technical report:

pd.zhaw.ch/publikation/upload/207101.pdf

Publications

Imhof, Melanie; Looser, Jonas; Musy, Thierry; Stockinger, Kurt,

2014.

Evaluation of query processing with impala for mixed workloads.

ZHAW Zürcher Hochschule für Angewandte Wissenschaften.

Available from: https://doi.org/10.21256/zhaw-3786

go back