Spectral denoising with uneven noise distribution based on local mean decomposition
writer：Mengxuan Ling, Xihui Bian*, Shuaishuai Wang, Tao Huang, Peng Liu, Shuyu Wang, Xiaoyao Tan
keywords：Near-infrared spectrum; Local mean decomposition; Uneven noise; Mirror extension; Piecewise
source：期刊
specific source：Chemometrics and Intelligent Laboratory Systems, 2022
Issue time：2022年
As a new spectral analysis tool, local mean decomposition (LMD) can decompose a signal into a set of single-component signals with different frequencies. However, LMD may produce endpoint effect. At the same time, due to instrumental instability and experimental errors, uneven noise may occur in the measurement process of near-infrared (NIR) spectra. A piecewise mirror extension local mean decomposition (PME-LMD) method is proposed for denoising of NIR spectrum with uneven noise. Firstly, the NIR spectrum with uneven noise is segmented to obtain several intervals. Then, each interval is mirrored extension to the left and right to overcome the endpoint effect. Subsequently, a series of product functions (PFs) are obtained by LMD for each piecewise mirror extended NIR spectrum. Finally, the denoised NIR spectrum is obtained by intercepting and reconstructing the components without noise. The NIR spectra of artificially noised, traditional Chinese medicine (TCM) and beer samples are used to validate the performance of this method. As comparison to PME-LMD method, Savitzky-Golay (SG) smoothing, discrete wavelet transform (DWT), empirical mode decomposition (EMD) and full spectral LMD have also been investigated. Visualization spectra, signal-to-noise ratio (SNR) and modeling results of partial least squares (PLS) are used as evaluation indicators. The results demonstrate that the proposed method performed best in terms of SNR, root mean squared error of prediction (RMSEP) and coefficient of determination (R) of PLS. Furthermore, the piecewise is critical to perform LMD denoising for NIR spectrum with uneven noise. At the same time, the endpoint effect of LMD is effectively improved by mirror extension.