Research Appraisaldiagnostic

Training a Smoking Status Probabilistic Model Using Cotinine Levels in a Large Claims Database

Nicotine & tobacco research : official journal of the Society for Research on Nicotine and TobaccoMedaglio, Dominique, Leonard, Charles E, Stephens Shields, Alisa J et al.22 May 2026DOI

Clinical Snapshot

65CEBM
Evidence: Moderatediagnostic

PICO Framework

P — PopulationBeneficiaries in a large claims database with at least one cotinine measurement
I — InterventionProbabilistic model using 26 predictors from claims data
C — ComparatorCotinine levels as reference standard (≥5 ng/mL serum/plasma or ≥30 ng/mL urine)
O — OutcomesDiscrimination (AUC), calibration, sensitivity, specificity of smoking status prediction

Bottom Line

This study developed a probabilistic model to predict smoking status from claims data using cotinine biomarkers as the reference standard, achieving moderate discrimination (AUC 0.77). While innovative in using objective biomarkers rather than self-reported smoking, the model has important limitations. The development sample was restricted to patients with cotinine measurements, which may not represent typical claims populations where such testing is uncommon. The model showed high specificity but low sensitivity, limiting its utility for identifying all smokers. Key diagnostic accuracy measures (specific sensitivity/specificity values, likelihood ratios) were not reported, hampering clinical interpretation. The 26-predictor model requires external validation before implementation in epidemiological research. For Australian applications, validation would be essential given different coding systems and healthcare contexts. This represents a methodological advance but requires further development before routine use.

Evidence: Moderate

Key Findings

  • P Value: Not reported

  • Effect Size: AUC = 0.77

  • Primary Outcome: Area under the receiver operating characteristic curve for smoking status prediction

  • Nnt Or Sensitivity: High specificity, low sensitivity at probability cutoffs ≥0.2 (specific values not provided)

  • Confidence Interval: 95% CI: 0.75-0.78

Clinical Application

Requires 26 specific predictors from claims data; feasibility depends on local database capabilities and coding practices Would require validation in Australian claims data (Medicare, PBS) given different coding systems (ICD-10-AM vs ICD-10-CM) and healthcare delivery patterns Claims databases with similar coding structures and patient populations to the development dataset

Abstract

INTRODUCTION: Smoking status is an important confounder for many epidemiologic studies, yet it is not well documented in common sources of real-world data, including administrative claims. Probabilistic models can be used to create a proxy for smoking status, yet most published models have been trained using self-reported data. The objective of this study was to train a smoking status probabilistic model using cotinine values available in a large claims database. METHODS: Beneficiaries were included if they had at least one cotinine measurement and were categorized as a "current smoker" if their serum or plasma cotinine value was ≥5 ng/mL or urine cotinine value was ≥30 ng/mL. Predictors were collected across one year prior to the cotinine assessment date. The model was fit using logistic regression with stepwise forward selection. Model performance was assessed using discrimination and calibration. RESULTS: The final model yielded an area under the receiver operating characteristic curve of 0.77 (95%CI:0.75-0.78) and was well calibrated across most prediction deciles. The strongest predictors included diagnosis codes for smoking and drug abuse, and number of medications. The model was found to be highly specific, yet not sensitive at probability cutoffs ≥0.2. CONCLUSIONS: A smoking status model was developed and internally validated for application in claims data, using available cotinine values to define smoking status and found to have acceptable discrimination and calibration. The model is based on 26 predictors, fewer than other similar published smoking status models. External validation of the model should be a next step toward utilizing the model for epidemiological research. IMPLICATIONS: This study tests the utility of cotinine values to validate a smoking status probabilistic model, which has not been done in the literature to date. The results were robust to various cotinine levels used to define smoking status, per current guidance. The final model uses only 26 factors to predict smoking status, simplifying the application of the model in other claims databases.

References

  1. 1.Medaglio, D., Leonard, C. E., Stephens Shields, A. J., Schnoll, R. A., & Gross, R. (2026). Training a smoking status probabilistic model using cotinine levels in a large claims database. Nicotine & Tobacco Research, advance online publication. https://doi.org/10.15620/cdc:129966
Share:XLinkedIn

This content is for educational purposes for healthcare professionals only and does not constitute clinical advice. Clinical decisions should be based on individual patient assessment, current guidelines, and appropriate specialist consultation. Editorial Standards · Privacy Policy · Terms of Service