BENCHMARKING BIG SPATIAL DATA PROCESSING FRAMEWORKS
Journal Title: Современные информационные технологии и ИТ-образование - Year 2018, Vol 14, Issue 1
Abstract
Today, the processing of large amounts of spatial data in distributed systems plays a crucial role in many areas of our life. Large data are often unstructured, and special algorithms are required for its processing. One of the methods for analyzing large data is a spatial analysis. The source of large data in this case is often the geographical information system. In this article, a benchmark is considered to evaluate the frameworks that work with such data. Also, the evaluation results of three frameworks according to developed benchmark are presented: GeoSpark, STARK, SpecialSpark. In the course of this paper, we considered a benchmark of two types: macrobenchmark and microbenchmark. In the paper, testing of topological predicates on various topological data is also considered. The comparison was made using the DE-9IM model. This model is used to determine the types of topological relationships, such as intersection, equality, etc. The main problem of comparing the data frameworks was that not all of them support the operations of the selected model, which influenced the formation of scenarios for the microbenchmark and macrobenchmark, since it was impossible to compare all the DE-9IM items.
Authors and Affiliations
Anastasia Garaeva, Airat Kabirov, Olga Tikhonova
Keywords
Related Articles
- EP ID EP508782
- DOI 10.25559/SITITO.14.201801.126-137
- Views 103
- Downloads 0
METHODOLOGICAL ASPECTS OF THE DIGITAL SKILLS CONCEPT
The article is devoted to the study of certain methodological aspects of the digital skills concept. The concepts, characteristics, classification of digital skills are considered. A model of digital skills and their pro...
NEURAL NETWORK METHOD OF RESTORING AN INITIAL PROFILE OF THE SHOCK WAVE
In this paper, we apply neural network modeling to solve the inverse problem of mathematical physics with a system of nonlinear partial differential equations of hyperbolic type. In the problem, the initial conditions ar...
RESOURCE VOLUME OPTIMIZATION OF LANGUAGE IDENTIFIERS FOR THE ACCOUNT OF METHODS AND IDENTIFICATION ALGORITHMS
This article is a continuation of the author's series of publications on the topic of text’s language identification. Here is considered the possibility of optimizing the resource capacity of programs and systems for lan...
STUDY OF THE SMALL FLUCTUATIONS OF THE BODY TOCOMPLEX DESCSIDE IN FLOW OF THE AMBIENCE
The work is devoted to the construction and investigation of a mathematical model of a body of a complex configuration that performs auto-oscillations in the flow of a quasi-static medium under the action of aerodynamic...
DIGITAL ECONOMY: METHODOLOGICAL INSTRUMENTS OF CONFIGURATION, PLANNING, MAINTENANCE
The relevance of a problem to a present situation is explained by rapid development of digital economy. Means of science don't allow foretelling what implementation will the next doubling of computer capacities following...