SOFTWARE ARCHITECTURE OF HIGH-PRODUCTION COMPLEXES FOR TEXT OF THE NEWS PROCESSING FOR SOLVING THE PROBLEMS OF DATA MINING
Journal Title: Современные информационные технологии и ИТ-образование - Year 2017, Vol 13, Issue 3
Abstract
The article proposes the architecture of the software for processing collections of news text messages, as well as the corresponding composition and structure of the information system. The system is a few steps of obtaining and processing information, functioning on the basis of a hybrid computing cluster. Each stage of receiving, processing and storing information in a generalized information system is represented by a microservice as a separate program unit. At the same time, the possibility of using different technology stacks for each service is emphasized so that properly selected specialized solutions increase the efficiency and quality of the result, and the shortcomings of the classical micro-service architecture are offset by the internal heterogeneity of the micro-services expressed in the form of flexible modularization. The essence of the proposed approach is the application of the principle of pipeline concurrency based on a microservice architecture with dynamic service boundaries.
Authors and Affiliations
Konstantin Otradnov, Anton Alyoshkin, Dmitry Zhukov
Keywords
Related Articles
- EP ID EP266419
- DOI 10.25559/SITITO.2017.3.437
- Views 91
- Downloads 0
ADAPTIVE TRAINING STRATEGY FOR DIGITAL ECONOMY PROBLEMS IN DUBNA STATE UNIVERSITY
The article is devoted to new educational trends in the transition to the digital economy. The development program of digital economy in Russia requires new approaches to training and the use of modern digital technologi...
TIME EFFICIENT ALGORITHM FOR THE GENERALIZED0 ENTROPYCALCULATION OF TWO-DIMENSIONS WORDS BY THE METHOD OF A SLIDING WINDOW
In the article we consider methods for calculating the entropy of two-dimensional words of finite length over in finite alphabet, with reference to the problem of self-organization of rod-like particles on a torus. Monit...
ONTOLOGICAL APPROACH TO ANALYSIS AND CREATION OF CURRICULUM ON PERSPECTIVE IT-SPECIALIZATION
IT-specialization «Computational Science» is in demand, but does not have a unified Curriculum, approved by the IT-community. The domains of application of ontologies in education and IT education were studied on the bas...
DIGITAL ECONOMY: METHODOLOGICAL INSTRUMENTS OF CONFIGURATION, PLANNING, MAINTENANCE
The relevance of a problem to a present situation is explained by rapid development of digital economy. Means of science don't allow foretelling what implementation will the next doubling of computer capacities following...
ANALYTICAL HIERARCHY PROCESS FOR THE SELECTION OF STRATEGIC ALTERNATIVES FOR INTRODUCTION OF INFRASTRUCTURE VIRTUAL DESKTOP INFRASTRUCTURE IN THE UNIVERSITY
The task of choosing a strategy for implementing the virtual desktop infrastructure into the IT infrastructure of the university is considered. The infrastructure of virtual desktops is a technology that provides central...