A Visible and Passive Millimeter Wave Image Fusion Algorithm Based on Pulse-Coupled Neural Network in Tetrolet Domain for Early Risk Warning

Abstract EN

An algorithm based on pulse-coupled neural network (PCNN) constructed in the Tetrolet transform domain is proposed for the fusion of the visible and passive millimeter wave images in order to effectively identify concealed targets.

The Tetrolet transform is applied to build the framework of the multiscale decomposition due to its high sparse degree.

Meanwhile, a Laplacian pyramid is used to decompose the low-pass band of the Tetrolet transform for improving the approximation performance.

In addition, the maximum criterion based on regional average gradient is applied to fuse the top layers along with selecting the maximum absolute values of the other layers.

Furthermore, an improved PCNN model is employed to enhance the contour feature of the hidden targets and obtain the fusion results of the high-pass band based on the firing time.

Finally, the inverse transform of Tetrolet is exploited to obtain the fused results.

Some objective evaluation indexes, such as information entropy, mutual information, and QAB/F, are adopted for evaluating the quality of the fused images.

The experimental results show that the proposed algorithm is superior to other image fusion algorithms.