SOFTWARE ARCHITECTURE OF HIGH-PRODUCTION COMPLEXES FOR TEXT OF THE NEWS PROCESSING FOR SOLVING THE PROBLEMS OF DATA MINING
Journal Title: Современные информационные технологии и ИТ-образование - Year 2017, Vol 13, Issue 3
Abstract
The article proposes the architecture of the software for processing collections of news text messages, as well as the corresponding composition and structure of the information system. The system is a few steps of obtaining and processing information, functioning on the basis of a hybrid computing cluster. Each stage of receiving, processing and storing information in a generalized information system is represented by a microservice as a separate program unit. At the same time, the possibility of using different technology stacks for each service is emphasized so that properly selected specialized solutions increase the efficiency and quality of the result, and the shortcomings of the classical micro-service architecture are offset by the internal heterogeneity of the micro-services expressed in the form of flexible modularization. The essence of the proposed approach is the application of the principle of pipeline concurrency based on a microservice architecture with dynamic service boundaries.
Authors and Affiliations
Konstantin Otradnov, Anton Alyoshkin, Dmitry Zhukov
Keywords
Related Articles
- EP ID EP266419
- DOI 10.25559/SITITO.2017.3.437
- Views 105
- Downloads 0
COMPARISON OF METHODS OF CONSTRUCTION OF APPROXIMATE ANALYTICAL SOLUTIONS OF DIFFERENTIAL EQUATIONS CONSIDERING ON THE EXAMPLE OF ELEMENTARY FUNCTIONS
Compares methods of constructing multilayer approximate solutions of differential equations based on classical approximate methods on the example of the exponent and cosine. In contrast to classical numerical methods, th...
MATHEMATICAL AND SOFTWARE SOLUTIONS OF STOCHASTIC CELLULAR AUTOMATONS WITH MEMORY
In provided article a model of stochastic cellular automatons with memory is discussed. The analysis of the model shows that the dynamics of state changes in such systems is very complex and non-obvious and requires furt...
ARCHITECTURE OF THE PARALLEL SOFTWARE FOR THE SIMULATION OF MULTIDIMENSIONAL PROBLEMS
The architecture of the parallel software constructed on the basis of a design pattern «Bridge», and intended for simulation of multidimensional tasks (network dynamics; compression of multidimensional data, pattern reco...
ESTIMATION METHODOLOGY OF THE LANGUAGE IDENTIFICATION RESULTS
The article presents the author's methodology for evaluating the language identification results, developed in the course of experimental research and showing the effectiveness of appropriate methods, technologies, algor...
DEVELOPMENT AND IMPLEMENTATION OF A CONCEPTUAL INFORMATION SYSTEM “BUSINESS INTELLIGENCE” MODEL OF A PHARMACEUTICAL COMPANY'S “SAIDAL” COMMERCIAL SERVICE
The Dynamic nature of modern business operations, the constant growth and the complexity of the data flows companies to turn to the most advanced data processing means, one of these tools is the Business Intelligence (BI...