Enhancing the Informativeness of Multispectral Images by means of Multimodal Image Fusion

Abstract

The research is devoted to the problem of combining graphic information from sensors of various physical nature in multispectral monitoring systems using methods of multimodal image fusion. Each of the sensors of the multispectral monitoring system allows to obtain digital images of the observed scene in different ranges of electromagnetic radiation. In this paper, we consider a two-spectral monitoring system, the frst sensor of which operates in the visible range, and the second in the infrared. The main problem with multimodal image fusion is that each partial sensor of the multispectral monitoring system represents specifc characteristics of the environment (brightness, thermal or radar contrasts of objects, etc). Another, no less important problem is the different spatial resolution of sensors of different physical nature and the inconsistency of their felds of view. Therefore, the problem of effective multimodal image fusion is not trivial. As a criterion for the effectiveness of combining graphical information in a single fused image, which should contain the maximum available useful information from various sensors, the informativeness of this image is chosen. A quantitative assessment of image informativeness is proposed to be performed using an improved method based on multicriteria analysis of image parameters. Multimodal image fusion is performed using the proposed method based on the discrete wavelet transform with the formation of low-frequency wavelet coefcients of the resulting wavelet spectrum by analyzing the regression communication model between the input images from different sensors. Confrmed experimentally that the proposed method of image fusion makes it possible to synthesize more informative multispectral images than known algorithms. The application of proposed method of image fusion for monitoring objects in difcult observation conditions (smoke, fog, low illumination) allows to increase the efciency of the multispectral monitoring system and signifcantly reduce the amount of redundant information coming to the operator of the system.

Authors and Affiliations

A. Hryvachevskyi, I. Prudyus

Keywords

Related Articles

Ultra wideband horn antenna with operating frequency range 1–20 GHz and low side lobe level

Results of numerical research and optimization of electric characteristics of ultra wideband double ridged horn antenna are presented. End-fire radiation patterns with side lobe level less than −10 dB and VSWR<1.9 ove...

Model of the managment and control device for mobile radio systems

The article presents a mathematical model of a common panel for control and monitoring (PCM) of combined mobile radio engineering systems and its physical interpretation. The model describes management as a ramified proc...

Weak periodic signal detection with the fractional order modified Duffing-Holmes system

Introduction. The problem of the weak periodic signal detection is very important in the modern radio engineering and communications. The new chaotic systems have been being proposed for the weak signal detection for the...

Solution of direct task of impedance tomography by the methods of theory of circuits

The algorithm of decision of direct task (analysis)  of impedansnoy tomography, based on the generalized method of modifications, allowing to take into account the rarity of matrix of conductivities, structure-borne phan...

The study of the amplitudes of the fields excited linear grating horn irradiators

The problem of scattering from a linear grating of horns can be solved only with approximate methods because known mathematical methods allow to obtain solutions only for simple mathematical models for example for the en...

Download PDF file
  • EP ID EP308243
  • DOI 10.20535/RADAP.2018.73.40-49
  • Views 64
  • Downloads 0

How To Cite

A. Hryvachevskyi, I. Prudyus (2018). Enhancing the Informativeness of Multispectral Images by means of Multimodal Image Fusion. Вісник НТУУ КПІ. Серія Радіотехніка, Радіоапаратобудування, 0(73), 40-49. https://europub.co.uk/articles/-A-308243