SOFTWARE ARCHITECTURE OF HIGH-PRODUCTION COMPLEXES FOR TEXT OF THE NEWS PROCESSING FOR SOLVING THE PROBLEMS OF DATA MINING

Abstract

The article proposes the architecture of the software for processing collections of news text messages, as well as the corresponding composition and structure of the information system. The system is a few steps of obtaining and processing information, functioning on the basis of a hybrid computing cluster. Each stage of receiving, processing and storing information in a generalized information system is represented by a microservice as a separate program unit. At the same time, the possibility of using different technology stacks for each service is emphasized so that properly selected specialized solutions increase the efficiency and quality of the result, and the shortcomings of the classical micro-service architecture are offset by the internal heterogeneity of the micro-services expressed in the form of flexible modularization. The essence of the proposed approach is the application of the principle of pipeline concurrency based on a microservice architecture with dynamic service boundaries.

Authors and Affiliations

Konstantin Otradnov, Anton Alyoshkin, Dmitry Zhukov

Keywords

Related Articles

PROBLEM OF COMMON TRANSPORT SYSTEM ORGANIZATION

The paper discusses the problem of common transport system creation from system-wide positions. Much attention is focused on two aspects – active self-maintenance in the environment with disorganization and dual nature o...

DISTRIBUTION OF THE NEURAL NETWORK BETWEEN MOBILE DEVICE AND CLOUD INFRASTRUCTURE SERVICES

Neural networks become the only way to solve problems in some areas. Such tasks as recognition of images, sounds, classification require serious processor power and memory for training and functioning of the network. Mod...

FEATURES OF PROGRAMMING IN DSSP FOR THE TERNARY MACHINE

In article characteristic properties of the Dialogue System for Structured Programming (DSSP) in which it significantly differs from the traditional languages (Pascal, C) which are usually used for development of a basic...

ON SOME PROBLEMS OF EXTERNAL BALLISTICS

The article presents an approach to solving some ballistics problems. The main object is a launcher in general with the possibility of setting the rotation angle, the ascent angle and the initial velocity. A general math...

ARCHITECTURE AND RELIABILITY OF OPERATING SYSTEMS

Progress in the production technology of microprocessors significantly increased reliability and performance of the computer systems hardware. It cannot be told about the corresponding characteristics of the software and...

Download PDF file
  • EP ID EP266419
  • DOI 10.25559/SITITO.2017.3.437
  • Views 108
  • Downloads 0

How To Cite

Konstantin Otradnov, Anton Alyoshkin, Dmitry Zhukov (2017). SOFTWARE ARCHITECTURE OF HIGH-PRODUCTION COMPLEXES FOR TEXT OF THE NEWS PROCESSING FOR SOLVING THE PROBLEMS OF DATA MINING. Современные информационные технологии и ИТ-образование, 13(3), 93-99. https://europub.co.uk/articles/-A-266419