ePrints

A parallel online trajectory compression approach for supporting big data workflow

Lookup NU author(s): Wei Han, Dr Tejal Shah

Downloads

Full text for this publication is not currently held within this repository. Alternative links are provided below where available.

Abstract

© 2017 Springer-Verlag GmbH Austria Nowadays with booming of sensor technology, location big data exhibit as high complexity, massive volume, real-time and stream-based characteristic. The current workflow systems are facing the challenge hardly to efficiently process the real-time location big data like trajectory stream. Online compression method is an available solution to preprocess these trajectory data in order to speed up the processing of big data workflow. However, the current online compression methods are in a serial execution that are hard to fast compress massive real-time original trajectory data. Aiming at this problem, we employ the multi-core and many-core approaches to accelerate a representative online trajectory compression method SQUISH-E. First a parallel version of SQUISH-E is proposed. PSQUISH-E used a data parallel scheme based on overlap technique and OpenMP to achieve the implementation over multiple-core CPUs. For further reducing compression time, we combine iteration method and GPU Hyper-Q feature to develop GPU-aided PSQUISH-E algorithm called as G-PSQUISH-E. The experimental results showed that (1) the data parallel scheme based on overlap can reach a similar SED error as the SQUISH-E (2) the proposed PSQUISH-E running on multi-core CPU achieved 3.8 times acceleration effect, and (3) G-PSQUISH-E further accelerated the effect of about 3 times compared with PSQUISH-E.

Publication metadata

Author(s): Han W, Deng Z, Chu J, Zhu J, Gao P, Shah T

Publication type: Article

Publication status: Published

Journal: Computing

Year: 2018

Volume: 100

Issue: 1

Pages: 3-20

Print publication date: 01/01/2018

Online publication date: 20/06/2017

Acceptance date: 13/06/2017

ISSN (print): 0010-485X

ISSN (electronic): 1436-5057

Publisher: Springer-Verlag Wien

URL: https://doi.org/10.1007/s00607-017-0563-8

DOI: 10.1007/s00607-017-0563-8

Altmetrics

Share