Structuring large language models for chemical health risk reasoning in environmental and occupational exposure
Clinical Snapshot
PICO Framework
| P — Population | Environmental and occupational health professionals requiring chemical risk assessment |
| I — Intervention | LLM-RAG system with semantic structuring and domain-aware prompting |
| C — Comparator | Baseline language models without structured reasoning framework |
| O — Outcomes | Correctness, faithfulness, and domain-specific helpfulness in chemical risk assessment |
Bottom Line
This technology development study presents a promising approach to enhance chemical risk assessment through structured language models. The integration of retrieval-augmented generation with domain-specific prompting addresses key limitations in current AI applications to environmental health. While the concept shows merit for supporting occupational health decisions and regulatory assessments, the study lacks rigorous validation methodology and statistical analysis. The 100-question benchmark evaluation, though showing positive results, needs independent validation and clearer performance metrics. For Australian practitioners, this technology could potentially support chemical risk assessments aligned with Safe Work Australia frameworks, but requires careful validation before implementation in clinical or regulatory contexts. The approach represents an important step toward trustworthy AI in environmental health, though more robust evaluation is needed to establish clinical utility and safety.
Key Findings
P Value: Not reported
Effect Size: Not quantified - described as 'consistent outperformance'
Primary Outcome: LLM-RAG system outperformed baseline models in correctness, faithfulness, and domain-specific helpfulness
Nnt Or Sensitivity: Performance metrics not quantified with specific values
Confidence Interval: Not reported
Clinical Application
Requires technical infrastructure and validation before clinical deployment Relevant to Safe Work Australia guidelines, NOHSC exposure standards, and TGA chemical assessment processes Environmental health professionals, occupational hygienists, toxicologists, and regulatory assessors
Abstract
Large language models (LLMs) have revolutionized numerous scientific fields. However, their application in environmental health remains limited, as they are prone to hallucinations and struggle with reasoning over complex, real-world exposure data. Chemical risks, especially from rare or poorly studied compounds, span diverse occupational and everyday scenarios, where structured knowledge is often incomplete and poorly integrated. To address these challenges, we present a health risk assistant that integrates deep learning-based compound property prediction, retrieval-augmented generation (RAG), and prompt engineering into a unified reasoning framework. Central to our design are two synergistic strategies: semantic structuring, which reorganizes heterogeneous knowledge into context-consistent and semantically rich profiles, and domain-aware prompting, which guides large language models through structured and role-specific reasoning aligned with toxicological goals. The framework enables the system to map physicochemical attributes to exposure pathways and disease outcomes with improved relevance and fidelity. Evaluated on a 100-question benchmark spanning chronic toxicity, occupational hazards, and exposure-specific risks, our LLM-RAG system consistently outperforms baseline models in correctness, faithfulness, and domain-specific helpfulness. Beyond answering queries, our approach demonstrates how integrated knowledge curation and tailored prompting can enable trustworthy and scalable AI reasoning for public and environmental health protection.
References
- 1.Chen, Z., Du, M., Qian, C., & Yu, H-Q. (2026). Structuring large language models for chemical health risk reasoning in environmental and occupational exposure. Journal of Hazardous Materials, 141820. https://doi.org/10.1016/j.jhazmat.2026.141820
Related Research
JMIR mHealth and uHealth
Machine Learning Frameworks for Wearable-Based Stress Modeling in Naturalistic Settings: Scoping Review
1 Aug 2026
Lasers in medical science
Effect of photobiomodulation on trapezius myofascial pain: a randomized, sham-controlled, double-blind clinical trial.
28 July 2026
Journal of neural engineering
Multimodal quantification of cognitive load using a printed wearable facial bio-potential system
23 July 2026
This content is for educational purposes for healthcare professionals only and does not constitute clinical advice. Clinical decisions should be based on individual patient assessment, current guidelines, and appropriate specialist consultation. Editorial Standards · Privacy Policy · Terms of Service