Exploring Large Language Model AI tools in Construction Project Risk Assessment: Chat GPT Limitations in Risk Identification, Mitigation Strategies, and User Experience
Authors’ abstract
The last 3 years have witnessed an increasing awareness and consensus on using artificial intelligence (AI) to enhance decision-making in the construction sector. This study explores the integration of ChatGPT (Generative Pre-trained Transformer) into traditional risk management frameworks within the construction industry, contributing to the ongoing discourse on AI’s role in enhancing risk identification, analysis, and mitigation. Using a mixed-method approach comparing ChatGPT-assisted to human evaluations, interviews, and a case study, the research develops a better understanding of construction risk analysis processes and discusses decision-making errors of omission, over-and underestimation of probabilities and impacts, and treatment of the residual risk after proposed mitigation strategies. Results suggest that users’ experience of ChatGPT is primarily favorable, characterized by quick responses and an intuitive interface that enhances decision-making efficiency. Findings indicate that GPT may be especially beneficial for less experienced practitioners since it provides comprehensive risk awareness. However, experienced professionals contend that the software lacks contextual depth. The study contributes a ChatGPT-4 prompt to evaluate infrastructure risk for a given project scope. An evidenced case study on a road upgrade project in Ireland demonstrates a lessened dependence on the quality of user prompting skills and emphasizes the quality of project scope data input. A collaborative approach, including Chat-GPT early involvement and human refinement, promises to enhance conventional risk management speed and efficiency and reduce bias and inflexibility while maintaining the adaptability and ethical rigour required in the industry’s evolving risk landscape. DOI: 10.1061/JCEMD4.COENG-16658. This work is made available under the terms of the Creative Commons Attribution 4.0 International license, https://creativecommons.org/licenses/by/4.0/. Practical Applications: The abilities to accurately identify risk early in project development and develop effective contingencies to mitigate potential impacts are highly desired skills among project managers and leaders. Careful implementation of risk measures can minimize their immediate and long-term impact on project performance and viability. Established risk evaluation methods and protocols are tenuous and require expertise beyond an individual’s knowledge capacity, leading to unidentified risks and implementation inefficiencies. This research draws on the unique experiences of AI (ChatGPT) and practitioners to compare their evaluation of project risk. Identified gaps and limitations were analyzed with the aim of developing a GPT prompt as an immediate practical recommendation that all project personnel could use. The findings can be applied to expedite the identification of hidden risks, analyze their effects on projects and society, and design control strategies to limit their immediate and long-term impact. The developed prompt aids in better understanding the underlying safety, cost, time, quality, and environmental risks across construction projects and their supply and logistics chains. It also reduces reliance on individual competencies and aligns more with the quality of project context information provided by risk evaluators. Moreover, while the research adds to the growing body of knowledge of AI in construction, a pathway is presented for construction organizations seeking to integrate AI into their risk management workflows. Author keywords: Artificial intelligence (AI); ChatGPT; Risk management; Natural language processing; Project management; Construction; Prompt; Large language model.
Paper
- Authors
- H. Martin, J. James, A. Chadee
- Publication date
- 2025
Transcript
A transcript has not been published for this episode yet.
Licensing
- Source license
- Creative Commons Attribution 4.0 International
- Recording license
- CC-BY-4.0
The authors and publisher do not sponsor or endorse this recording.