Chapter Integrating Real-Time Object Detection into an AR-Driven Task Assistance Prototype: An Approach Towards Reducing Specific Motions in Therbligs Theory
Due to challenges in filling vacant positions and the heightened demands posed on existing staff, employers and project managers are progressively considering the recruitment of inexperienced individuals and seeking strategies to swiftly provide them with essential job-specific knowledge. The potent...
I tiakina i:
| Ngā kaituhi matua: | , , |
|---|---|
| Hōputu: | Online |
| Reo: | Ingarihi |
| I whakaputaina: |
Firenze University Press
2024
|
| Ngā marau: | |
| Urunga tuihono: | ONIX_20240402_9791221502893_93 |
| Ngā Tūtohu: |
Kāore He Tūtohu, Me noho koe te mea tuatahi ki te tūtohu i tēnei pūkete!
|
| _version_ | 1869529132503662592 |
|---|---|
| author | Yuan, Xiang Mei, Qipei Li, Xinming |
| author_browse | Li, Xinming Mei, Qipei Yuan, Xiang |
| author_facet | Yuan, Xiang Mei, Qipei Li, Xinming |
| author_sort | Yuan, Xiang |
| collection | Directory of Open Access Books |
| description | Due to challenges in filling vacant positions and the heightened demands posed on existing staff, employers and project managers are progressively considering the recruitment of inexperienced individuals and seeking strategies to swiftly provide them with essential job-specific knowledge. The potential of industrial AR has been widely researched to support workers in overcoming skill-related knowledge and enhancing industrial processes. However, most studies focus on demonstrating technology usability across different processes and overcoming engineering hurdles on a case-by-case basis. There is no direct benefit analysis on how AR assists construction tasks at human motion level, and how to eliminate the ineffective motions and reduce the duration of effective motions. To fill this gap, this paper first establishes an AR-based near real-time object detection system of small tools and components involved in task processes for egocentric perception of workers in the construction industry. Later, the Standard Operating Procedure (SOP) for scaffolding assembly activities is deconstructed from a manual process into Therbligs-based elemental motions. Finally, this research conducted a comparative study of two prototypes across four dimensions of evaluation. As a step forward in this direction, this paper renews the connotations of Therbligs theory under industry 5.0 era, rethinks the AR-assisted construction task processes, and applies appropriate technologies enhancing the adaptability of AR technology for construction workers’ needs |
| format | Online |
| id | doab-20.500.12854ir-136246 |
| institution | Directory of Open Access Books |
| language | eng |
| publishDate | 2024 |
| publishDateRange | 2024 |
| publishDateSort | 2024 |
| publisher | Firenze University Press |
| publisherStr | Firenze University Press |
| record_format | ojs |
| spelling | doab-20.500.12854ir-1362462025-07-18T09:46:50Z Chapter Integrating Real-Time Object Detection into an AR-Driven Task Assistance Prototype: An Approach Towards Reducing Specific Motions in Therbligs Theory Yuan, Xiang Mei, Qipei Li, Xinming Augmented Reality (AR) Microsoft HoloLens 2 Object Detection Task Assistance Therbligs thema EDItEUR::U Computing and Information Technology::UT Computer networking and communications::UTV Virtualization thema EDItEUR::U Computing and Information Technology::UT Computer networking and communications::UTV Virtualization Due to challenges in filling vacant positions and the heightened demands posed on existing staff, employers and project managers are progressively considering the recruitment of inexperienced individuals and seeking strategies to swiftly provide them with essential job-specific knowledge. The potential of industrial AR has been widely researched to support workers in overcoming skill-related knowledge and enhancing industrial processes. However, most studies focus on demonstrating technology usability across different processes and overcoming engineering hurdles on a case-by-case basis. There is no direct benefit analysis on how AR assists construction tasks at human motion level, and how to eliminate the ineffective motions and reduce the duration of effective motions. To fill this gap, this paper first establishes an AR-based near real-time object detection system of small tools and components involved in task processes for egocentric perception of workers in the construction industry. Later, the Standard Operating Procedure (SOP) for scaffolding assembly activities is deconstructed from a manual process into Therbligs-based elemental motions. Finally, this research conducted a comparative study of two prototypes across four dimensions of evaluation. As a step forward in this direction, this paper renews the connotations of Therbligs theory under industry 5.0 era, rethinks the AR-assisted construction task processes, and applies appropriate technologies enhancing the adaptability of AR technology for construction workers’ needs 2024-04-07T19:31:03Z 2024-04-07T19:31:03Z 2024-04-02T15:47:17Z 2023 chapter ONIX_20240402_9791221502893_93 2704-5846 https://library.oapen.org/handle/20.500.12657/89124 9791221502893 https://directory.doabooks.org/handle/20.500.12854/136246 eng Proceedings e report open access image/jpeg n/a https://library.oapen.org/bitstream/20.500.12657/89124/1/9791221502893_12.pdf Firenze University Press 10.36253/979-12-215-0289-3.12 10.36253/979-12-215-0289-3.12 2ec4474d-93b1-4cfa-b313-9c6019b51b1a 9791221502893 12 Florence open access |
| spellingShingle | Augmented Reality (AR) Microsoft HoloLens 2 Object Detection Task Assistance Therbligs thema EDItEUR::U Computing and Information Technology::UT Computer networking and communications::UTV Virtualization thema EDItEUR::U Computing and Information Technology::UT Computer networking and communications::UTV Virtualization Yuan, Xiang Mei, Qipei Li, Xinming Chapter Integrating Real-Time Object Detection into an AR-Driven Task Assistance Prototype: An Approach Towards Reducing Specific Motions in Therbligs Theory |
| title | Chapter Integrating Real-Time Object Detection into an AR-Driven Task Assistance Prototype: An Approach Towards Reducing Specific Motions in Therbligs Theory |
| title_full | Chapter Integrating Real-Time Object Detection into an AR-Driven Task Assistance Prototype: An Approach Towards Reducing Specific Motions in Therbligs Theory |
| title_fullStr | Chapter Integrating Real-Time Object Detection into an AR-Driven Task Assistance Prototype: An Approach Towards Reducing Specific Motions in Therbligs Theory |
| title_full_unstemmed | Chapter Integrating Real-Time Object Detection into an AR-Driven Task Assistance Prototype: An Approach Towards Reducing Specific Motions in Therbligs Theory |
| title_short | Chapter Integrating Real-Time Object Detection into an AR-Driven Task Assistance Prototype: An Approach Towards Reducing Specific Motions in Therbligs Theory |
| title_sort | chapter integrating real time object detection into an ar driven task assistance prototype an approach towards reducing specific motions in therbligs theory |
| topic | Augmented Reality (AR) Microsoft HoloLens 2 Object Detection Task Assistance Therbligs thema EDItEUR::U Computing and Information Technology::UT Computer networking and communications::UTV Virtualization thema EDItEUR::U Computing and Information Technology::UT Computer networking and communications::UTV Virtualization |
| topic_facet | Augmented Reality (AR) Microsoft HoloLens 2 Object Detection Task Assistance Therbligs thema EDItEUR::U Computing and Information Technology::UT Computer networking and communications::UTV Virtualization thema EDItEUR::U Computing and Information Technology::UT Computer networking and communications::UTV Virtualization |
| url | ONIX_20240402_9791221502893_93 |
| work_keys_str_mv | AT yuanxiang chapterintegratingrealtimeobjectdetectionintoanardriventaskassistanceprototypeanapproachtowardsreducingspecificmotionsintherbligstheory AT meiqipei chapterintegratingrealtimeobjectdetectionintoanardriventaskassistanceprototypeanapproachtowardsreducingspecificmotionsintherbligstheory AT lixinming chapterintegratingrealtimeobjectdetectionintoanardriventaskassistanceprototypeanapproachtowardsreducingspecificmotionsintherbligstheory |