Cultural Relevance and Acceptability of Cognitive Behavioral Therapy Techniques Adapted by AI or a Human Psychologist: Experimental Study

Clinical Snapshot

Key Findings

• P Value: P=0.02 for cultural relevance main effect

• Effect Size: η²=0.045 for text generator type main effect

• Primary Outcome: Cultural relevance rating of CBT techniques

• Nnt Or Sensitivity: Small to moderate effect size (η²=0.045) suggests limited clinical significance

• Confidence Interval: Not reported in abstract

Clinical Application

Moderate - requires validated AI systems and cultural competency frameworks for implementation Limited direct applicability - Australian refugee populations differ culturally and linguistically. Would require validation with local refugee communities and alignment with RACGP cultural competency guidelines Arabic-speaking refugees and immigrants requiring culturally adapted psychological interventions

Abstract

BACKGROUND: Evidence-based psychological interventions are usually not accessed by marginalized groups such as refugees. Culturally adapted psychological interventions have reported larger effect sizes than nonadapted psychological interventions. However, the cultural adaptation of interventions is a lengthy process, entailing a challenge. One potential solution to overcome this challenge is the use of artificial intelligence (AI). OBJECTIVE: The aim of this study was to investigate and compare the perceived cultural relevance and acceptability of 2 common cognitive behavioral therapy (CBT) techniques when translated and culturally adapted by AI versus a human psychologist. METHODS: In a 2×2 factorial design, the text generator type (AI vs human psychologist) and the CBT technique (cognitive restructuring vs behavior modification) were compared. CBT technique texts translated and culturally adapted either by AI or by a human psychologist were blindly rated using the Cultural Relevance Questionnaire and the Theoretical Framework of Acceptability. Raters were Arabic-speaking refugees and immigrants, aged between 18 and 69 years, residing in Sweden, Denmark, and Germany. Raters were randomly allocated to 1 of 4 conditions. Each condition consisted of 2 stimuli. Two-factor between-subject design analyses were used to analyze the data. RESULTS: A significant main effect of the text generator domain type (P=.02; η²=0.045) was found in the first rating, with texts adapted by the AI domain perceived as more culturally relevant than those adapted by the human domain. No significant main effect of the CBT technique was found in the first rating (P=.10; η²=0.022). There were no differences in the second rating. Regarding acceptability, no significant main effects of text generator domain type (P=.09; η²=0.024) or the CBT technique (P=.88; η²=0.001) were found in either of the ratings. CONCLUSIONS: CBT technique materials adapted by AI may be perceived as similarly culturally relevant as those adapted by a human psychologist. This finding implies the potential to accelerate the cultural adaptation of psychological interventions. However, AI still needs to be used with caution and in accordance with rigorous safety standards and robust frameworks.

References

1. 1.Demetry, Y., Carlbring, P., & Andersson, G. (2026). Cultural Relevance and Acceptability of Cognitive Behavioral Therapy Techniques Adapted by AI or a Human Psychologist: Experimental Study. JMIR Formative Research. https://doi.org/10.2196/91056