This work focuses on using advanced techniques for structural health monitoring (SHM) for bridges with Traffic. We propose an approach using deep reinforcement learning (DRL)-based control for Unmanned Aerial Vehicle (UAV). Our approach conducts a concrete bridge deck survey while traffic is ongoing and detects cracks. The UAV performs the crack detection, and the location of cracks is initially unknown. We use two edge detection techniques. First, we use canny edge detection for crack detection. We also use a Convolutional Neural Network (CNN) for crack detection and compare it with canny edge detection. Transfer learning is applied using CNN with pre-trained weights obtained from a crack image dataset. This enables the model to adapt and improve its performance in identifying and localizing cracks. Proximal Policy Optimization (PPO) is applied for UAV control and bridge surveys. The experimentation across various scenarios is performed to evaluate the performance of the proposed methodology. Key metrics such as task completion time and reward convergence are observed to gauge the effectiveness of the approach. We observe that the Canny edge detector offers up to 40\% lower task completion time, while the CNN excels in up to 12\% better damage detection and 1.8 times better rewards.
DRL-Based Resource Allocation for Energy-Efficient IRS-Assisted UAV Spectrum Sharing Systems
School of Information Science and Technology, Beijing University of Technology(信息科学与技术学院,北京理工大学);Faculty of Electrical and Electronic Engineering, University of Nottingham(电子与电气工程学院,诺丁汉大学)
Lyapunov Stability-Aware Stackelberg Game for Low-Altitude Economy: A Control-Oriented Pruning-Based DRL Approach
School of Automation, Guangdong University of Technology(广东工业大学自动化学院);Department of Computer Science, Hong Kong Baptist University(香港 Baptist 大学计算机科学系);Department of Electrical and Computer Engineering, Sungkyunkwan University(Sungkyunkwan 大学电子与计算机工程系);School of Electrical and Computer Engineering, University of Sydney(悉尼大学电气与计算机工程学院);Graduate School of Information Sciences, Tohoku University(东北大学信息科学研究生院)
AoI-Sensitive Data Forwarding with Distributed Beamforming in UAV-Assisted IoT
College of Computer Science and Technology, Jilin University(吉林大学计算机科学与技术学院);College of Computing and Data Science, Nanyang Technological University(南洋理工大学计算与数据科学学院);Artificial Intelligence Research Institute, Shenzhen MSU-BIT University(深圳北理莫斯科大学人工智能研究院);Department of Electrical and Computer Engineering, The University of British Columbia(不列颠哥伦比亚大学电气与计算机工程系)
Safe and Economical UAV Trajectory Planning in Low-Altitude Airspace: A Hybrid DRL-LLM Approach with Compliance Awareness
Beijing Key Laboratory of Security and Privacy in Intelligent Transportation, Beijing Jiaotong University, P.R. China(北京智能交通安全与隐私北京市重点实验室,北京交通大学,中国);School of Computer Science and Engineering, Nanyang Technological University, Singapore(计算机科学与工程学院,南洋理工大学,新加坡)
Age of Information Minimization in UAV-Enabled Integrated Sensing and Communication Systems
Department of Information and Communications Engineering, Aalto University(艾尔沃斯大学信息与通信工程系);School of Computer Science and Engineering, University of Electronic Science and Technology of China(电子科技大学计算机科学与工程学院);Faculty of Information Technology, University of Jyväskylä(于韦斯屈莱大学信息学院);Shenzhen Institute for Advanced Study, University of Electronic Science and Technology of China(电子科技大学深圳先进研究 institute);Department of Electrical and Computer Engineering, University of Houston(休斯顿大学电气与计算机工程系);Department of Computer Science and Engineering, Kyung Hee University(庆熙大学计算机科学与工程系)
Communication-Free Collective Navigation for a Swarm of UAVs via LiDAR-Based Deep Reinforcement Learning
Department of Mechanical Engineering, Ulsan National Institute of Science and Technology(机械工程系,釜山国立科学技术研究院);Department of Mechanical Engineering, Korea Advanced Institute of Science and Technology(机械工程系,韩国科学技术院)
Graph Neural Assisted Actor-Critic for Latency-Efficient Edge Vision System
CISTER Research Center(CISTER研究中心);Instituto de Telecomunicações(电信研究所);Faculdade de Engenharia, Universidade do Porto(波尔图大学工程学院);Kennesaw State University(肯尼索州立大学);OmniVision Technologies Inc.(豪威科技公司);Pontificia Universidad Católica de Chile(智利天主教大学)
Cyber Deception for Mission Surveillance via Hypergame-Theoretic Deep Reinforcement Learning
Department of Computer Science, Virginia Tech(弗吉尼亚理工大学计算机科学系);Computer Network Information Center, Chinese Academy of Sciences(中国科学院计算机网络信息中心);Department of Computer Science, North Carolina State University(北卡罗来纳州立大学计算机科学系);US Army Research Laboratory(美国陆军研究实验室)
RadDQN: a Deep Q Learning-based Architecture for Finding Time-efficient Minimum Radiation Exposure Pathway
Health Physics Division, Health Safety and Environment Group, Bhabha Atomic Research Center, Mumbai – 400085, India(健康物理学部、健康安全与环境组、Bhabha原子研究中心,印度孟买,400085);Birla Institute of Technology, PILANI, Rajasthan – 333031, India(比拉理工学院,印度帕利尼,拉贾斯坦,333031)
Tiny Multi-Agent DRL for Twins Migration in UAV Metaverses: A Multi-Leader Multi-Follower Stackelberg Game Approach
Guangdong University of Technology (GDUT)(广东工业大学);School of Automation(自动化学院);Center for Intelligent Batch Manufacturing based on IoT Technology(基于物联网技术的智能分批制造111中心);Key Laboratory of Intelligent Information Processing and System Integration of IoT, Ministry of Education(物联网智能信息处理与系统集成教育部重点实验室);Guangdong-HongKong-Macao Joint Laboratory for Smart Discrete Manufacturing(粤港澳智能离散制造联合实验室);Key Laboratory of Intelligent Detection and IoT in Manufacturing, Ministry of Education(智能制造智能检测与物联网技术教育部重点实验室);Guangdong Key Laboratory of IoT Information Technology(广东省物联网信息技术重点实验室)
Spatio-Temporal Attention Enhanced Multi-Agent DRL for UAV-Assisted Wireless Networks with Limited Communications
School of Intelligent Systems Engineering, Shenzhen Campus of Sun Yat-sen University(中山大学智能系统工程学院深圳校区);Southern Marine Science and Engineering Guangdong Laboratory (Zhuhai)(广东海洋工程科学实验室(珠海));Department of Equipment Management and Unmanned Aerial Vehicle Engineering, Air Force Engineering University(空军工程大学装备管理与无人机工程系);School of Computing and Artificial Intelligence, Jiangxi University of Finance and Economics(江西财经大学计算机与人工智能学院);College of Computing and Data Science, Nanyang Technological University(南洋理工大学计算机与数据科学学院)
Emergency Caching: Coded Caching-based Reliable Map Transmission in Emergency Networks
School of Computer Science, Beijing University of Posts and Telecommunications(北京邮电大学计算机学院);School of Electronic Engineering, Beijing University of Posts and Telecommunications(北京邮电大学电子工程学院);Frontier Research Center, Peng Cheng Laboratory(鹏城实验室前沿研究中心)
FRSICL: LLM-Enabled In-Context Learning Flight Resource Allocation for Fresh Data Collection in UAV-Assisted Wildfire Monitoring
Real-Time and Embedded Computing Systems Research Centre (CISTER)(实时嵌入式计算系统研究中心);Carnegie Mellon University(卡内基梅隆大学);Pontificia Universidad Católica de Chile(天主教智利大学);Instituto de Telecomunicações(电信研究院);Faculdade de Engenharia, Universidade do Porto(工程学院,葡萄牙里斯本大学)
LLM-Enabled In-Context Learning for Data Collection Scheduling in UAV-assisted Sensor Networks
Real-Time and Embedded Computing Systems Research Centre (CISTER)(实时与嵌入式计算系统研究中心(CISTER));Faculdade de Engenharia da Universidade do Porto(葡萄牙波尔图大学工程学院);School of Computer Science, McGill University(麦吉尔大学计算机科学学院);Knight Foundation School of Computing and Information Sciences, Florida International University(国际大学计算与信息科学学院(Knight基金会))
Embodied AI-Enhanced IoMT Edge Computing: UAV Trajectory Optimization and Task Offloading with Mobility Prediction
School of Sports Engineering, Beijing Sport University(体育工程学院,北京体育大学);School of Computer and Information Technology, Beijing Jiaotong University(计算机与信息学院,北京交通大学);State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications(网络与交换技术国家重点实验室,北京邮电大学);School of Electronics and Information Engineering, Beijing Jiaotong University(电子与信息工程学院,北京交通大学)