Semantic Communication for Multimodal Machine Services under Imperfect Channel State Information, Heterogeneous Quality-of-Service Demands, and Resource Constraints in Integrated Sensing and Communication Networks
Keywords:
Semantic Communication, Integrated Sensing and Communication, Imperfect Channel State InformationAbstract
The evolution of next-generation wireless networks has catalyzed a paradigm shift from traditional Shannon-based data transmission toward semantic-aware communication architectures. This transition is particularly critical for multimodal machine services operating within Integrated Sensing and Communication networks, where massive volumes of heterogeneous data must be transmitted under strict latency and reliability constraints. However, realizing the full potential of semantic communication in these environments is severely hindered by imperfect channel state information, diverse quality-of-service demands, and stringent computational and spectral resource limitations. This paper provides a comprehensive investigation into the design, optimization, and evaluation of a robust semantic communication framework tailored for multimodal machine-type communications in Integrated Sensing and Communication systems. By treating the semantic extraction and resource allocation processes as a joint optimization problem, this study analyzes how varying degrees of channel state information uncertainty impact semantic fidelity and overall system utility. Furthermore, the research explores the dynamic management of heterogeneous quality-of-service requirements across different machine tasks, ranging from real-time autonomous control to high-resolution environmental monitoring. Through extensive theoretical analysis and systematic evaluations, the study elucidates the complex trade-offs between sensing resolution, semantic compression efficiency, and transmission robustness. The findings offer critical insights into developing adaptive, resource-efficient, and resilient communication protocols that can sustain advanced machine intelligence in highly dynamic and resource-constrained wireless environments.
Downloads
References
1. Sigelman, B. H., Barroso, L. A., Burrows, M., Stephenson, P., Plakal, M., Beaver, D., et al. (2010). Dapper, a large-scale distributed systems tracing infrastructure. Technical Report, Google.
2. Yang, Z., Ji, W., Guo, Q., & Wang, Z. (2023, October). Javp: Joint-aware video processing with edge-cloud collaboration for dnn inference. In Proceedings of the 31st ACM International Conference on Multimedia (pp. 9152-9160).
3. Yang, Z., Ji, W., & Wang, Z. (2024). Adaptive joint configuration optimization for collaborative inference in edge-cloud systems. Science China Information Sciences, 67(4), 149103.
4. Xia, L., Yang, M., Wang, J., Yan, Z., Ren, Y., Yu, G., & Lei, K. (2025, September). Mamba4Net: Distilled Hybrid Mamba Large Language Models For Networking. In2025 IEEE 33rd International Conference on Network Protocols (ICNP)(pp. 1-10). IEEE.
5. Li, X., Wang, P., Li, G., Ni, L., & Zhang, Y. (2023). Design of interface circuits and lightweight PUF for TMR sensors. IEEE Sensors Journal, 23(11), 11754-11761.
6. Xu, C., Wang, C., & Li, Z. (2026). H2-LBM: A Hierarchical Hybrid Deep Reinforcement Learning Framework for L7 Load Balancing and Global Traffic Scheduling in Multi-Cloud LLM Serving. Fundamental Scientific Reports in Multidisciplinary Areas, 2 (02), 109-120.
7. Li, X., Yin, L., Chen, W., Liu, X., & Fu, Q. (2016). Study of a three-axis digital tunneling resistance-type magnetic sensor.IEICE Electronics Express,13(13), 20160319-20160319.
8. Yang, W., Qin, Y., Jiang, Z., & Chu, X. (2021, June). Traffic Management for Distributed Machine Learning in RDMA-enabled Data Center Networks. In ICC 2021-IEEE International Conference on Communications (pp. 1-6). IEEE.
9. Tian, Y., & Yang, Z. (2026, May). SAEC: scene-aware enhanced edge-cloud collaborative industrial vision inspection with multimodal LLM. In ICASSP 2026-2026 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) (pp. 19747-19751). IEEE.
10. Wang, S., Zhang, X., Wang, P., & Li, X. (2026). Design of Magnetic Sensor Array-Based PUFs for IoT Security. IEEE Transactions on Instrumentation and Measurement, 75, 1-9.
11. Wuyang Zhang and Shichao Pei. 2026. Your LLM Agent Can Leak Your Data: Data Exfiltration via Backdoored Tool Use. arXiv:2604.05432 [cs.CR] doi:10.48550/arXiv.2604.05432
12. Zhang, W., Li, M., & Chen, X. (2026). Distributed Edge-Fog-Cloud Architecture for Intelligent Fault Diagnosis of Permanent Magnet Synchronous Motors Using Temporal Fusion Transformers and Federated Learning. Fundamental Scientific Reports in Multidisciplinary Areas, 2 (02), 121-131.
13. Yang, Y., Ma, X., Li, C., Zheng, Z., Zhang, Q., Huang, G., ... & Zhao, Q. (2021). Believe what you see: Implicit constraint approach for offline multi-agent reinforcement learning. Advances in Neural Information Processing Systems, 34, 10299-10312.
14. Liao, Qiuyue, et al. "Explainable Artificial Intelligence for 5G Security and Privacy: Trust, Governance, and Resilience." (2025).
15. Yao, Y., Sun, J., Miao, P., Chen, G., & Tafazolli, R. (2026). Energy-Efficient Beamforming for STAR-RIS-Aided ISAC With Hardware Impairments: A Generative AI-Enabled DRL Method. IEEE Transactions on Wireless Communications.
16. Yang, Z., Liang, B., & Ji, W. (2021). An intelligent end–edge–cloud architecture for visual IoT-assisted healthcare systems. IEEE internet of things journal, 8(23), 16779-16786.
17. Yao, Y., Zhu, Z., Miao, P., Cheng, X., Shu, F., & Wang, J. (2025). Optimizing hybrid RIS-aided ISAC systems in V2X networks: A deep reinforcement learning method for anti-eavesdropping techniques. IEEE Transactions on Vehicular Technology, 74 (6), 9224-9239.
18. Li, X., Hu, J., & Liu, X. (2020). Harmonic Distortion Optimization for Sigma-Delta Modulators Interface Circuit of TMR Sensors.Sensors,20(4), 1041.
19. Yang, W., Qin, Y., & Yang, Z. (2022). A reinforcement learning based data storage and traffic management in information-centric data center networks. Mobile Networks and Applications, 27(1), 266-275.
20. Wan, H., Zhang, Y., Wang, J., Wu, D., Li, M., Chen, X., ... & Ji, X. (2025). Toward universal embodied planning in scalable heterogeneous field robots collaboration and control. Journal of Field Robotics, 42(5), 2318-2336.
21. Ren, S., Li, X., Shao, Z., Gong, M., & Ren, M. (2025). A Hybrid Structure Noise Shaping SAR ADC.Journal of Circuits, Systems and Computers,34(05), 2550135.
22. Xiao, W., Tan, Q., Chen, M., Yao, Y., & Shu, F. (2026). Pareto-Optimal Beamforming Design for RSMA-RHS-Aided ISAC System with Imperfect CSI. IEEE Transactions on Vehicular Technology.
23. Ou, J., Guo, J., Chen, Y., Jiang, S., Xue, R., & Tian, W. (2025, June). A Neural Network-Based Pipeline Parallel Strategy Solver for Heterogeneous Environments. In 2025 International Joint Conference on Neural Networks (IJCNN) (pp. 1-9). IEEE.
24. Hu, Y., Yang, Z., Zhao, C., & Ji, W. (2026, May). Adaptive guidance semantically enhanced via multimodal llm for edge-cloud object detection. In ICASSP 2026-2026 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) (pp. 12962-12966). IEEE.
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Chris Yip, Benjamin Mak

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
This article is licensed under the Creative Commons Attribution 4.0 International License. This license permits use, sharing, and adaptation of the article for non-commercial purposes, provided the original authors and source are properly credited.
Alternatively, you may choose other Creative Commons licenses based on your preferences:
-
CC Attribution-NonCommercial-NoDerivatives 4.0: This license allows others to download the works and share them with others as long as they credit the author, but they can’t change them in any way or use them commercially.
-
CC Attribution-NonCommercial 4.0: This license allows others to remix, tweak, and build upon the work non-commercially, as long as they credit the author, but they cannot use the material for commercial purposes.
-
CC Attribution-NonCommercial-ShareAlike 4.0: This allows others to remix, tweak, and build upon the work non-commercially, as long as they credit the author and license their new creations under identical terms.
These terms ensure that your article is freely accessible and usable, while respecting the rights of the original authors.
