Extracting a reliable signal from heterogeneous data
Journal Title: Modern Innovations, Systems and Technologies - Year 2024, Vol 4, Issue 1
Abstract
The article is devoted to the study of extracting a common reliable signal from data divided into heterogeneous groups. A soft maximum estimate of the maximum value is proposed as a computationally attractive alternative aimed at achieving a balance between a combined estimate and a (hard) estimate of the maximum value. The problem of extracting a common signal from heterogeneous data is considered. Since heterogeneity prevails in large-scale systems, the goal is a computationally efficient estimator (solution) with good statistical proper-ties with varying degrees of data heterogeneity. Using this estimate can lead to more reliable estimates for heterogeneous data compared to an estimate that does not take into account grouping, that is, a combined estimate. In large-scale data processing systems, where data heterogeneity is usually found, the computational aspect of evaluation is crucial. In substantiation of this thesis, the article provides an analysis of the effectiveness of soft maximum estimation for approval of large-scale data processing systems, confirming the effectiveness of the applied method. In summary soft maximin estimation will be practically useful in a number of different contexts, as a way of aggregating explained variances across groups.
Authors and Affiliations
D. I. Atlasov, O. Ja. Kravets
Keywords
Related Articles
- EP ID EP755328
- DOI 10.47813/2782-2818-2024-4-1-0122-0132
- Views 6
- Downloads 0
Neural networks for creating digital works of art: art through the eyes of algorithms
In this article, the authors first describe the main effective methods of training neural networks to generate video and photographic materials. Next comes a detailed analysis of the most pressing problems related to the...
Review of approaches and methods to assess the comparative efficiency of technological processes and production
The article provides an overview of approaches and methods to assess the comparative efficiency of technological processes and production. It is known that the most common methods are those that assess production based o...
Recovery blocks method to improve software reliability: comparison with N-version programming
Today, computers are used in every kind of human activity (from scientific research to the service sector). This article covers the topic of software reliability increasing in connection with the importance of maintainin...
The deep internet of things
A study of modern technologies and tools used in the deep Internet, as well as an assessment of the risks associated with them, is presented. Due to the fact that the Internet that we use every day is called the "surface...
Filtration rates in the area of squeezing materials
Analytical dependencies are determined that describe the patterns of change in filtration rates in the squeezing area. It was established that the fluid filtration rate along the abscissa axis at the boundaries of the co...