Have Large Language Models Enhanced the Way Civil & Environmental Engineers Write? A Quantitative Analysis of Scholarly Communication over 25 Years
Morgan D. Sanger, Brett W. Maurer
原文摘要
Large language models (LLMs) have rapidly emerged in civil and environmental engineering (CEE) research, education, and practice as tools for project ideation, execution, and communication. However, a gap remains in understanding how prevalent LLM adoption is across CEE scholarship and whether it measurably alters research prose. This study applies a vocabulary-based frequency-shift methodology to 149,452 abstracts published by the American Society of Civil Engineers between 2000 and 2025. Deviations from long-term vocabulary trends suggest that 15.3% and 26.9% of 2024 and 2025 abstracts, respectively, are likely LLM-influenced. Prior to the introduction of LLMs in 2022, CEE publications exhibit long-term trends toward longer abstracts, greater use of segmenting punctuation, higher required reading levels, and use of active, first-person verb constructions. Beginning around 2023, however, the frequencies of many stylistic marker words (e.g., enhance) sharply depart from their historical trajectories, a shift consistent with the emergence of LLMs. Abstracts classified as likely LLM-influenced also depart from historical semantic trends, exhibiting increased lexical diversity, comma use, and complexity, with reduced passive voice and hedging language, producing prose that is more segmented, complex, and confident. The artificial intelligence contribution of this study is the use of natural language processing to detect population-level linguistic signals of LLM-generated text, estimating the prevalence of LLM use and its influence on CEE writing. Together, these novel findings provide the first large-scale, data-driven assessment of how CEE scholarly communication is changing alongside LLM adoption.
cs.DL