Enhancing the Informativeness of Multispectral Images by means of Multimodal Image Fusion

Abstract

The research is devoted to the problem of combining graphic information from sensors of various physical nature in multispectral monitoring systems using methods of multimodal image fusion. Each of the sensors of the multispectral monitoring system allows to obtain digital images of the observed scene in different ranges of electromagnetic radiation. In this paper, we consider a two-spectral monitoring system, the frst sensor of which operates in the visible range, and the second in the infrared. The main problem with multimodal image fusion is that each partial sensor of the multispectral monitoring system represents specifc characteristics of the environment (brightness, thermal or radar contrasts of objects, etc). Another, no less important problem is the different spatial resolution of sensors of different physical nature and the inconsistency of their felds of view. Therefore, the problem of effective multimodal image fusion is not trivial. As a criterion for the effectiveness of combining graphical information in a single fused image, which should contain the maximum available useful information from various sensors, the informativeness of this image is chosen. A quantitative assessment of image informativeness is proposed to be performed using an improved method based on multicriteria analysis of image parameters. Multimodal image fusion is performed using the proposed method based on the discrete wavelet transform with the formation of low-frequency wavelet coefcients of the resulting wavelet spectrum by analyzing the regression communication model between the input images from different sensors. Confrmed experimentally that the proposed method of image fusion makes it possible to synthesize more informative multispectral images than known algorithms. The application of proposed method of image fusion for monitoring objects in difcult observation conditions (smoke, fog, low illumination) allows to increase the efciency of the multispectral monitoring system and signifcantly reduce the amount of redundant information coming to the operator of the system.

Authors and Affiliations

A. Hryvachevskyi, I. Prudyus

Keywords

Related Articles

System Choice of Optimal Technological 3D MID Solution

Modern General statement of a problem. Modern Three-Dimensional Molded Interconnect Devices (3D-MID) technology of injection-molded thermoplastic circuit carriers with structured circuit traces has proved to be an effect...

Scattering of the flat waves by symmetrical vibrator with nonlinear load in process work of nonlinear radio locator

Analysis permitting to find the secondary electrical field distribution along the nonlinear load symmetrical vibrator for anyone component and her harmonics when known level of the power and the irradiation UHF field vol...

Professional training for Internet of Things technology

Introduction. Proposed concept for training "Internet of Things" technology within the framework of the speciality "Telecommunications and Radio Engineering". It is given a practice of organization and sequencing courses...

Method of calculation broadband asymmetric vibrator with variable radius along the axis of symmetry

New approach to calculation of the bandwidth of microwave elements for antenna system is offered. It is necessary to develop a method of calculating the basic CWT element, namely broadband pin for optimum performance, co...

Methodology for determining the reliability of fault-tolerant hardware-software radioelectronic systems

Introduction. The majority of radioelectronic systems are hardware-software systems. Their reliability is defined as the reliability of hardware and software. Methods for estimating software allow to predict reliability...

Download PDF file
  • EP ID EP308243
  • DOI 10.20535/RADAP.2018.73.40-49
  • Views 68
  • Downloads 0

How To Cite

A. Hryvachevskyi, I. Prudyus (2018). Enhancing the Informativeness of Multispectral Images by means of Multimodal Image Fusion. Вісник НТУУ КПІ. Серія Радіотехніка, Радіоапаратобудування, 0(73), 40-49. https://europub.co.uk/articles/-A-308243