A Hybrid Network Integrating MHSA and 1D CNN–Bi-LSTM for Interference Mitigation in Faster-than-Nyquist MIMO Optical Wireless Communications
<p>Schematic of MIMO-FTN-OWC system.</p> "> Figure 2
<p>The structure of 1D CNN (Different colors represent different filters).</p> "> Figure 3
<p>The structure of Bi-LSTM.</p> "> Figure 4
<p>Calculation process of the double-head self-attention mechanism.</p> "> Figure 5
<p>The structure of MHSA–1D CNN–Bi-LSTM network (Blue represents the input and output signals; purple represents the 1D-CNN; light yellow represents the normalization layer; green represents the Bi-LSTM network; red represents the multi-head self-attention mechanism layer; and orange represents the fully connected layer).</p> "> Figure 6
<p>Magnitude–frequency characteristics.</p> "> Figure 7
<p>Comparison of signal sampling values (<b>a</b>) 4PAM signals (<b>b</b>) FTN signals (<b>c</b>) signals after ISI cancellation.</p> "> Figure 8
<p>Relationship between BER and SNR for our proposal and orthogonal system (OTS refers to Orthogonal Transmission System).</p> "> Figure 9
<p>Relationship between BER and SNR under different numbers of antennas.</p> "> Figure 10
<p>Relationship between BER and SNR under different turbulence intensities.</p> "> Figure 11
<p>Relationship between BER and SNR under different laser wavelengths.</p> "> Figure 12
<p>Relationship between BER and SNR under different acceleration factors.</p> "> Figure 13
<p>Relationship between acceleration factor and BER.</p> ">
Abstract
:1. Introduction
2. System Model
3. MHSA–1D CNN–Bi-LSTM Interference Cancellation Scheme
3.1. D CNN
3.2. Bi-LSTM
3.3. Multi-Head Self-Attention
3.4. MHSA–1D CNN–Bi-LSTM Interference Cancellation Algorithm
4. Simulation and Analysis
4.1. Evaluation Index
4.2. System Performance Analysis
4.3. Computational Complexity
5. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- Dash, S.P.; Kaushik, A. Ris-assisted 6g wireless communications: A novel statistical framework in the presence of direct channel. IEEE Commun. Lett. 2024, 28, 717–721. [Google Scholar] [CrossRef]
- Jeyapal, R.; Matrouk, K.; Purushothaman, D. An efficient heuristic-aided adaptive autoencoder-based dilated DNN with attention mechanism for enhancing the performance of the MIMO system in 5G communication. Multimed. Syst. 2024, 30, 116. [Google Scholar] [CrossRef]
- Gemeda, M.D.; Han, M.S.; Abebe, A.T.; Kang, C.G. Design of Deep Learning-based One-bit Transceiver with Oversampling and Faster-Than-Nyquist (FTN) Signaling. IEEE Access 2024, 12, 43968–43983. [Google Scholar] [CrossRef]
- Chen, C.; Zhong, W.D.; Yang, H.; Du, P. On the performance of MIMO-NOMA-based visible light communication systems. IEEE Photonics Technol. Lett. 2018, 30, 307–310. [Google Scholar] [CrossRef]
- Li, Y.T.; Geng, T.W.; Gao, S.J. On the signal combinations for a uniquely decodable coded MIMO-FSO communication system. Opt. Laser Technol. 2024, 172, 110533. [Google Scholar] [CrossRef]
- Zhang, Z.; Yuksel, M.; Yanikomeroglu, H. Faster-than-Nyquist signaling for MIMO communications. IEEE Trans. Wirel. Commun. 2023, 22, 2379–2392. [Google Scholar] [CrossRef]
- Tong, M.; Huang, X.; Zhang, J.A. Faster-Than-Nyquist Transmission with Frame-by-Frame Decision-Directed Successive Interference Cancellation. IEEE Trans. Commun. 2023, 71, 4851–4861. [Google Scholar] [CrossRef]
- Yuan, W.; Wu, N.; Wang, H.; Kuang, J. Variational inference-based frequency-domain equalization for faster-than-Nyquist signaling in doubly selective channels. IEEE Signal Process Lett. 2016, 23, 1270–1274. [Google Scholar] [CrossRef]
- Jana, M.; Medra, A.; Lampe, L.; Mitra, J. Pre-equalized faster-than-Nyquist transmission. IEEE Trans. Commun. 2017, 65, 4406–4418. [Google Scholar] [CrossRef]
- Cao, M.; Zhang, W.; Wang, H.; Lv, J. Adaptive pre-equalisation algorithm for point-by-point cancellation in super-Nyquist wireless optical communications. Acta Opt. Sin. 2020, 40, 46–53. [Google Scholar]
- Baek, M.S.; Park, W.; Lee, Y.T. Deep learning-based signal detection technique for ftn signaling-based emergency alert communication system. In Proceedings of the 2021 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB), Chengdu, China, 4–6 August 2021; pp. 1–3. [Google Scholar]
- Lai, S.; Li, M. Recurrent neural network assisted equalization for FTN signaling. In Proceedings of the ICC 2020—2020 IEEE International Conference on Communications (ICC), Dublin, Ireland, 7–11 July 2020; pp. 1–6. [Google Scholar]
- Cao, M.; Wu, Z.; Wang, H.; Xia, J.; Zhang, J.; Li, W. Deep Learning Assisted Pre-equalization Scheme for Faster-than-Nyquist Optical Wireless Communications. In Proceedings of the 2021 13th International Conference on Advanced Infocomm Technology (ICAIT), Yanji, China, 15–18 October 2021; pp. 118–121. [Google Scholar]
- Oh, S.; Yu, M.; Cho, S.; Noh, S.; Chun, H. Bi-LSTM-Augmented deep neural network for multi-Gbps VCSEL-based visible light communication link. Sensors 2022, 22, 4145. [Google Scholar] [CrossRef] [PubMed]
- Palitharathna, K.W.; Wickramasinghe, N.D.; Vegni, A.M.; Suraweera, H.A. Neural Network-Based Optimization for SLIPT-Enabled Indoor VLC Systems with Energy Constraints. IEEE Trans. Green. Commun. Netw. 2024, 8, 839–851. [Google Scholar] [CrossRef]
- Li, L.; Zhu, Z.; Zhang, J. Neural Network-Based Transceiver Design for VLC System over ISI Channel. Photonics 2022, 9, 190. [Google Scholar] [CrossRef]
- Zou, D.; Wang, W.; Li, F.; Sui, Q.; Yi, X.; Lu, C.; Li, Z. Colored Noise Suppressed FTN vs. PS in Peak Power Constrained IM-DD PAM Systems. J. Light. Technol. 2024, 42, 550–559. [Google Scholar] [CrossRef]
- Che, D.; Chen, X. Modulation format and digital signal processing for IM-DD optics at post-200G era. J. Light. Technol. 2024, 42, 588–605. [Google Scholar] [CrossRef]
- Ke, J.; Gao, M.; Chen, B.; Shao, W. Partial response THP for high-speed PAM-4 transmission. Opt. Fiber Technol. 2023, 81, 103487. [Google Scholar] [CrossRef]
- Zedini, E.; Ata, Y.; Alouini, M.S. Improving Performance of Integrated Ground-HAPS FSO Communication Links with MIMO Application. IEEE Photonics J. 2024, 16, 1–14. [Google Scholar] [CrossRef]
- Li, Q.; Wang, Y.; Dong, J.; Zhang, C.; Peng, K. Multi-node knowledge graph assisted distributed fault detection for large-scale industrial processes based on graph attention network and bidirectional LSTMs. Neural Netw. 2024, 173, 106210. [Google Scholar] [CrossRef]
- Liang, R.; Xie, Y.; Cheng, J.; Pang, C.; Schuller, B. A non-invasive speech quality evaluation algorithm for hearing aids with multi-head self-attention and audiogram-based features. IEEE/ACM Trans. Audio Speech Lang. Process 2024, 32, 2166–2176. [Google Scholar] [CrossRef]
- Guo, R.; Liu, H.; Xie, G.; Zhang, Y.; Liu, D. A Self-Interpretable Soft Sensor Based on Deep Learning and Multiple Attention Mechanism: From Data Selection to Sensor Modeling. IEEE Trans. Ind. Inform. 2023, 19, 6859–6871. [Google Scholar] [CrossRef]
- Cao, M.; Wang, R.; Zhang, Y.; Zhang, X.; Wang, H. End-to-end performance of a CNN-AE based faster-than-Nyquist rate free space optical communication system. J. Chongqing Univ. Posts Telecommun. (Nat. Sci. Ed.) 2024, 36, 181–190. [Google Scholar]
- Zhou, H.; Huang, L.; Yang, J.; Zhou, J.; Song, D.; Chen, X.; Dong, M. Low Complexity Double Vector Model Predictive Control with Minimum Root Mean Square Error for Three-phase Three-Level Inverters. IEEE J. Emerg. Sel. Top. Power Electron. 2023, 11, 5809–5819. [Google Scholar] [CrossRef]
- Zafar, M.H.; Khan, N.M.; Abou Houran, M.; Mansoor, M.; Akhtar, N.; Sanfilippo, F. A novel hybrid deep learning model for accurate state of charge estimation of Li-Ion batteries for electric vehicles under high and low temperature. Energy 2024, 292, 130584. [Google Scholar] [CrossRef]
- Huang, F.; Zhang, X. A new interpretable streamflow prediction approach based on SWAT-BiLSTM and SHAP. Environ. Sci. Pollut. Res. 2024, 31, 23896–23908. [Google Scholar] [CrossRef]
Algorithm | Bi-LSTM | |
---|---|---|
Start Input: Input Sequence , is the length of the sequence. | ||
Parameters: LSTM cell parameters is weights and is biases. | ||
Output: Output Sequence | ||
Step 1: Initialize hidden and cell states. | ||
Step 2: Forward propagation. for t = 1 to T do, Loop statement that iterates from 1 to T. Calculate the output of forward LSTM: Step 3: Backward propagation. for t = T to 1 do, Loop statement that iterates from T to 1. Calculate the output of backward LSTM: Step 4: Combine forward and backward outputs. for t = 1 to T do, Splice forward and backward hidden states. . End |
Parameter | Value |
---|---|
size of data | 2 × 106 |
training dataset | 1.6 × 106 |
test dataset | 4 × 105 |
batch size | 256 |
cycle index | 100 |
dropout | 0.3 |
learning rate | 0.0001 |
loss function | MSE |
optimizer | Adam |
atmospheric refractive [24] | strong:1.13 × 10−13 m−2/3 |
medium:1.13 × 10−14 m−2/3 | |
weak:1.13 × 10−17 m−2/3 |
Indicator Name | Indicator Meaning | Formula |
---|---|---|
RMSE | The square root of the ratio of the square of the deviation of the predicted value from the true value to the number of observations [25]. | |
MAE | The average of the absolute values of the deviations of all individual observations from the arithmetic mean [26]. | |
R2 | The degree of fit of the regression line to the observations [27]. |
Model | RMSE | MAE | R2 |
---|---|---|---|
LSTM | 0.68733 | 0.56313 | 0.62213 |
Bi-LSTM | 0.64597 | 0.55962 | 0.66623 |
CNN–Bi-LSTM | 0.36303 | 0.31812 | 0.89458 |
MHSA–1D CNN–Bi-LSTM | 0.31499 | 0.24220 | 0.92060 |
Algorithm | τ | |||
---|---|---|---|---|
0.6 | 0.7 | 0.8 | 0.9 | |
Algorithm proposed in [10] | ||||
MHSA–1D CNN–Bi-LSTM interference cancellation algorithm |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Cao, M.; Yang, Q.; Zhou, G.; Zhang, Y.; Zhang, X.; Wang, H. A Hybrid Network Integrating MHSA and 1D CNN–Bi-LSTM for Interference Mitigation in Faster-than-Nyquist MIMO Optical Wireless Communications. Photonics 2024, 11, 982. https://doi.org/10.3390/photonics11100982
Cao M, Yang Q, Zhou G, Zhang Y, Zhang X, Wang H. A Hybrid Network Integrating MHSA and 1D CNN–Bi-LSTM for Interference Mitigation in Faster-than-Nyquist MIMO Optical Wireless Communications. Photonics. 2024; 11(10):982. https://doi.org/10.3390/photonics11100982
Chicago/Turabian StyleCao, Minghua, Qing Yang, Genxue Zhou, Yue Zhang, Xia Zhang, and Huiqin Wang. 2024. "A Hybrid Network Integrating MHSA and 1D CNN–Bi-LSTM for Interference Mitigation in Faster-than-Nyquist MIMO Optical Wireless Communications" Photonics 11, no. 10: 982. https://doi.org/10.3390/photonics11100982
APA StyleCao, M., Yang, Q., Zhou, G., Zhang, Y., Zhang, X., & Wang, H. (2024). A Hybrid Network Integrating MHSA and 1D CNN–Bi-LSTM for Interference Mitigation in Faster-than-Nyquist MIMO Optical Wireless Communications. Photonics, 11(10), 982. https://doi.org/10.3390/photonics11100982