by Xiao Cao, Wei Hu, Hui Liu
Abstract:
Human-machine interaction, especially driver posture estimation is important to the development of autonomous driving, which can facilitate safe and smooth driving behaviours. Besides, it also contributes to ergonomics research and human-machine interaction design for automated vehicles. The existing studies have got great achievements in body estimation, hand pose estimation, and even face feature estimation thanks to the rapid development of deep learning approaches and the upgrade of hardware equipment. However, most existing models can only process body estimation or hand estimation separately, which will impede the research on driver-vehicle interaction in autonomous driving. This is because the driving process is highly dependent on the cooperation between the body and hands behaviours. In this study, five popular deep learning models, including Simple Faster R-CNN, RootNet, PoseNet, Yolo v3, and graph convolutional neural network, are combined through a cascade method to develop an integrated model which can estimate body and hand simultaneously during the driving process. The coordinate transform system is proposed to connect models in series. Experiment results demonstrate the proposed method can produce 2D and 3D reorganization of the human body and hands simultaneously with acceptable accuracy.
Reference:
Integrated Driver Pose Estimation for Autonomous Driving (Xiao Cao, Wei Hu, Hui Liu), In Proceedings of the 17th International Joint Conference on Biomedical Engineering Systems and Technologies (BIOSTEC 2024) - Volume 1: BIOSIGNALS, SCITEPRESS - Science and Technology Publications, 2024.
Bibtex Entry:
@inproceedings{cao2024driver_pose,
title = {Integrated Driver Pose Estimation for Autonomous Driving},
author = {Cao, Xiao and Hu, Wei and Liu, Hui},
booktitle = {Proceedings of the 17th International Joint Conference on Biomedical Engineering Systems and Technologies (BIOSTEC 2024) - Volume 1: BIOSIGNALS},
pages = {695--702},
organization = {INSTICC},
publisher = {SCITEPRESS - Science and Technology Publications},
year = {2024},
isbn = {978-989-758-688-0},
issn = {2184-4305},
doi = {10.5220/0012639400003657},
url = {https://www.csl.uni-bremen.de/cms/images/documents/publications/CaoHuLiu_BIOSIGNALS2024.pdf},
abstract = {Human-machine interaction, especially driver posture estimation is important to the development of autonomous driving, which can facilitate safe and smooth driving behaviours. Besides, it also contributes to ergonomics research and human-machine interaction design for automated vehicles. The existing studies have got great achievements in body estimation, hand pose estimation, and even face feature estimation thanks to the rapid development of deep learning approaches and the upgrade of hardware equipment. However, most existing models can only process body estimation or hand estimation separately, which will impede the research on driver-vehicle interaction in autonomous driving. This is because the driving process is highly dependent on the cooperation between the body and hands behaviours. In this study, five popular deep learning models, including Simple Faster R-CNN, RootNet, PoseNet, Yolo v3, and graph convolutional neural network, are combined through a cascade method to develop an integrated model which can estimate body and hand simultaneously during the driving process. The coordinate transform system is proposed to connect models in series. Experiment results demonstrate the proposed method can produce 2D and 3D reorganization of the human body and hands simultaneously with acceptable accuracy.}
}