Extracting a reliable signal from heterogeneous data
Journal Title: Modern Innovations, Systems and Technologies - Year 2024, Vol 4, Issue 1
Abstract
The article is devoted to the study of extracting a common reliable signal from data divided into heterogeneous groups. A soft maximum estimate of the maximum value is proposed as a computationally attractive alternative aimed at achieving a balance between a combined estimate and a (hard) estimate of the maximum value. The problem of extracting a common signal from heterogeneous data is considered. Since heterogeneity prevails in large-scale systems, the goal is a computationally efficient estimator (solution) with good statistical proper-ties with varying degrees of data heterogeneity. Using this estimate can lead to more reliable estimates for heterogeneous data compared to an estimate that does not take into account grouping, that is, a combined estimate. In large-scale data processing systems, where data heterogeneity is usually found, the computational aspect of evaluation is crucial. In substantiation of this thesis, the article provides an analysis of the effectiveness of soft maximum estimation for approval of large-scale data processing systems, confirming the effectiveness of the applied method. In summary soft maximin estimation will be practically useful in a number of different contexts, as a way of aggregating explained variances across groups.
Authors and Affiliations
D. I. Atlasov, O. Ja. Kravets
Keywords
Related Articles
- EP ID EP755328
- DOI 10.47813/2782-2818-2024-4-1-0122-0132
- Views 24
- Downloads 0
Determination of parameters of a trepanning machine for cleaning wool fibers
This article provides information about the technology of primary processing of wool and the feeding part of the baking machine. It analyzes the operating principle and types of baking machines at the enterprise of prima...
The impact of distribution shift on object segmentation accuracy using convolutional neural network
Neural networks are widely used for object recognition in computer vision. Object recognition accuracy decreases as the statistical parameters of a test dataset deviate from those parameters of a training dataset. Such p...
Construction of ground control points for spacecraft using optimization-simulation model
The article deals with the application of simulation modeling and optimization-simulation approach to solving problems of synthesis of structures of automated spacecraft control systems, namely, the choice of spacecraft...
Analysis of thyroid nodule ultrasound images by image feature extraction technique
The most frequent left thyroid nodule is the presence of thyroid nodules that have never been seen before. With X-ray computed tomography (CT) being used more often in diagnosing thyroid disorders, however, image process...
Improvement of automated control systems for the nitrobenzene washing process
The article discusses the modernization of automated process control systems for the nitrobenzene washing stage in chemical production. The main focus is on improving process efficiency and safety, as well as ensuring co...