Research Appraisalother

Twelve quick tips for AI-assisted coding in science.

PLoS computational biologyBridgeford, Eric W, Campbell, Iain Declan, Chen, Zijiao et al.1 July 2026DOI

Clinical Snapshot

35CEBM
Evidence: Weakother

PICO Framework

P — PopulationResearchers and scientists engaged in computational or data-driven scientific work who use or are considering using AI-assisted coding tools
I — InterventionTwelve structured practical tips for AI-assisted coding, organised around four themes: problem preparation and understanding, managing context and interaction, testing and validation, and code quality assurance and iterative improvement
C — ComparatorNo formal comparator; implicitly contrasted with unguided or ad hoc use of AI coding tools, or traditional manual coding practices
O — OutcomesCode quality, scientific validity, reproducibility, reliability, and research integrity in computational science workflows

Bottom Line

This paper from Bridgeford and colleagues at Stanford and Princeton offers twelve structured tips for researchers using AI coding tools in scientific work, organised around problem preparation, context management, testing, and quality assurance. The core message — that human agency, domain expertise, and rigorous validation must remain central even when AI accelerates code development — is sound and timely. However, clinicians and researchers should recognise that this is an expert opinion piece, not an empirical study. The recommendations carry no quantitative evidence of effectiveness and have not been validated in real-world scientific workflows. The authorship panel, while credentialed, is narrow in disciplinary and institutional scope. For Australian researchers, the principles align well with existing research integrity obligations under the Australian Code for the Responsible Conduct of Research, particularly regarding reproducibility and transparency. The paper is best used as a practical starting checklist for teams developing AI coding policies, not as definitive evidence-based guidance. Institutions should supplement these tips with discipline-specific validation standards, formal code review processes, and ongoing monitoring as AI tool capabilities evolve rapidly. The absence of any citations at time of appraisal means peer scrutiny of the recommendations is still pending.

Evidence: Weak

Key Findings

  • Effect Size: Not applicable — no empirical effect size reported; this is a qualitative guidance document

  • Primary Outcome: Twelve structured practical recommendations for AI-assisted coding in scientific research, organised across four thematic domains: (1) problem preparation and understanding, (2) managing context and interaction, (3) testing and validation, and (4) code quality assurance and iterative improvement

  • Nnt Or Sensitivity: Not applicable — no diagnostic, therapeutic, or prognostic metrics reported; the paper does not provide NNT, sensitivity, specificity, or hazard ratio estimates

  • Confidence Interval: Not applicable — no quantitative analyses performed

Clinical Application

The tips are presented as immediately actionable with no requirement for additional resources, training infrastructure, or institutional approval. Feasibility is high for individual researchers. However, implementation fidelity across teams or institutions would require additional scaffolding such as code review policies, documentation standards, and training programmes not described in the paper. Australian researchers are increasingly using AI coding tools across NHMRC-funded projects, clinical trials units, and university-based computational health research. The Australian Code for the Responsible Conduct of Research (2018) and institutional research integrity frameworks already require reproducibility and transparency in computational methods — the tips in this paper are broadly consistent with these obligations. The Australian Research Data Commons (ARDC) and relevant discipline-specific bodies (e.g., AMSI, SSA) may find this guidance useful as a starting point for developing institution-level AI coding policies. There are no PBS or TGA implications. The RACGP does not directly govern computational research practice, though general practitioners engaged in clinical research or quality improvement projects using data analysis tools would benefit from the validation and reproducibility principles outlined. Australian universities and the ARC may wish to develop more formal, evidence-based guidance building on this foundation. Researchers conducting computational analyses in any scientific discipline, including clinical researchers, biostatisticians, health data scientists, and clinician-scientists who write or review code for data analysis, modelling, or software development. Particularly relevant for early- to mid-career researchers integrating AI coding assistants into their workflows.

Abstract

While AI coding tools have demonstrated potential to accelerate software development, their use in scientific computing raises critical questions about code quality and scientific validity. In this paper, we provide twelve practical tips for AI-assisted coding that balance the capabilities of AI with the demands of scientific and methodological rigor. We address how AI can be leveraged strategically throughout the development cycle with four key themes: problem preparation and understanding, managing context and interaction, testing and validation, and code quality assurance and iterative improvement. These principles serve to emphasize maintaining human agency in coding decisions, establishing robust validation procedures, and preserving the domain expertise essential for methodologically sound research. These tips are intended to help researchers harness AI's transformative potential for faster software development while ensuring that their code meets the standards of reliability, reproducibility, and scientific validity that research integrity demands.

References

  1. 1.Bridgeford, E. W., Campbell, I. D., Chen, Z., Lin, Z., Ritz, H., Vandekerckhove, J., & Poldrack, R. A. (2026). Twelve quick tips for AI-assisted coding in science. PLoS Computational Biology. https://doi.org/10.1371/journal.pcbi.1014428
Share:XLinkedIn

This content is for educational purposes for healthcare professionals only and does not constitute clinical advice. Clinical decisions should be based on individual patient assessment, current guidelines, and appropriate specialist consultation. Editorial Standards · Privacy Policy · Terms of Service