Extracting a reliable signal from heterogeneous data
Journal Title: Modern Innovations, Systems and Technologies - Year 2024, Vol 4, Issue 1
Abstract
The article is devoted to the study of extracting a common reliable signal from data divided into heterogeneous groups. A soft maximum estimate of the maximum value is proposed as a computationally attractive alternative aimed at achieving a balance between a combined estimate and a (hard) estimate of the maximum value. The problem of extracting a common signal from heterogeneous data is considered. Since heterogeneity prevails in large-scale systems, the goal is a computationally efficient estimator (solution) with good statistical proper-ties with varying degrees of data heterogeneity. Using this estimate can lead to more reliable estimates for heterogeneous data compared to an estimate that does not take into account grouping, that is, a combined estimate. In large-scale data processing systems, where data heterogeneity is usually found, the computational aspect of evaluation is crucial. In substantiation of this thesis, the article provides an analysis of the effectiveness of soft maximum estimation for approval of large-scale data processing systems, confirming the effectiveness of the applied method. In summary soft maximin estimation will be practically useful in a number of different contexts, as a way of aggregating explained variances across groups.
Authors and Affiliations
D. I. Atlasov, O. Ja. Kravets
Keywords
Related Articles
- EP ID EP755328
- DOI 10.47813/2782-2818-2024-4-1-0122-0132
- Views 22
- Downloads 0
Analysis of models for image processing when implementing an object detection system on a railway track
With the development of the railway industry, informatization of society and the automation of many technological processes, it becomes possible to create an automatic control system, diagnostics and safety of locomotive...
Optimization of the method for determining the fatty acid composition of dairy products
Chromatographic analysis of fatty acid methyl esters is used to characterize the lipid fraction of food products and is an effective method for detecting adulteration and one of the most important applications in food an...
Methods of reducing the vibration and noise level in sewing machines
The article covers the forces acting on the sewing machine links and the vibrations in the sewing machine caused by these forces, the failures and the faults caused by these vibrations, and the impact of these faults on...
Automation of the storage of operational information of the collector-beam system for collecting products for its control
Within the framework of this work, a model for storing operational information of a collector-beam system for collecting products from the Orenburg gas condensate field for its management is proposed. A feature of the pr...
On the issue of choosing a real-time operating system for hardware and software support of industrial and environmental monitoring systems
The article discusses the features of the operation of environmental monitoring systems. A number of factors are determined that affect the organization of hardware and software support for such systems. The main factors...